D4Science Infrastructure

Jan 14, 2019

06:09 PM VM Creation #13112 (In Progress): perform-service development instance

new VM perform.dev.d4science.org ready to be provisioned Tommaso Piccioli

03:32 PM Task #13134 (Closed): infrastructure-monitor: I'm not able to create a ServiceEndpoint

Now it works properly. Roberto Cirillo

11:15 AM Task #13134 (Closed): infrastructure-monitor: I'm not able to create a ServiceEndpoint

In order to test the correct encryption/decryption with the new preproduction key, I need to create a new ServiceEndp... Roberto Cirillo

Jan 11, 2019

06:58 PM Task #10270 (Closed): Configure the xen hypervisor to let the guests talk to the storage network

After reading the documentation again, in particular http://docs.ceph.com/docs/master/rados/configuration/network-con... Andrea Dell'Amico

05:56 PM Task #12799: Memory problems on ckan-d4s1.d4science.org

Andrea Dell'Amico wrote:
> @tommaso.piccioli@isti.cnr.it @francesco.mangiacrapa@isti.cnr.it was the RAM amount incre... Andrea Dell'Amico

03:00 PM Task #13130 (Paused): DataMiner - Update service on preprod to latest release 4.13.1

Roberto Cirillo

03:00 PM Task #13130 (In Progress): DataMiner - Update service on preprod to latest release 4.13.1

The dataminer service is failing on gCube 4.13.1.
The service will be upgraded when the new version is available in... Roberto Cirillo

02:41 PM Task #13130 (Closed): DataMiner - Update service on preprod to latest release 4.13.1

In order to work with DataMiner in Preprod it is necessary to update the service to the latest version gCube 4.13.1
... Giancarlo Panichi

12:23 PM Task #13050 (Closed): Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

Tried on both ckan-ecoevo and ckan-sobigdata, both the version with and without the template changes. They do not bre... Andrea Dell'Amico

Jan 10, 2019

08:21 PM Task #13050: Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

OK. The playbook is ready, let's coordinate us to install the patch when a restart of the server is not a problem. Andrea Dell'Amico

04:07 PM Task #13050: Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

Andrea Dell'Amico wrote:
> New patch that includes the changes to the template snippets.
Hi Andrea, thanks for yo... Francesco Mangiacrapa

12:46 PM VRE #12946 (Removed): D4Research/FAIR_DM VRE Removal

Massimiliano Assante

Jan 09, 2019

05:59 PM Task #13050: Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

New patch that includes the changes to the template snippets.
Andrea Dell'Amico

05:06 PM Task #13050: Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

A fixed one, the first ad a syntax error in it. Andrea Dell'Amico

04:56 PM Task #13050: Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

I'm attaching the diff file. Andrea Dell'Amico

04:52 PM Task #13050: Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

The changes are active on ckan-d-d4s.d4science.org. @francesco.mangiacrapa@isti.cnr.it can you test if the involved p... Andrea Dell'Amico

04:40 PM Task #13050: Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

I can anticipate that the changes here: https://github.com/ckan/ckan/pull/3430/commits/5d6949ca7602eb5039227229a01132... Andrea Dell'Amico

04:10 PM Task #13050 (In Progress): Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

I'm going to duplicate the sources on the dev instance and I'll try to produce a patch. Andrea Dell'Amico

Jan 08, 2019

06:45 PM VM Creation #13112 (Closed): perform-service development instance

A new VM is needed in order to test the new service 'perform-service'.
Such service needs to connect to the VRE's ... Fabio Sinibaldi

Jan 07, 2019

11:55 AM Task #12935 (Closed): sdi-service: upgrade commons-codec library

The library has been upgraded in production and preproduction environments. Roberto Cirillo

10:26 AM Task #11229 (Closed): Upgrade jdk on tagme.d4science.org

Roberto Cirillo

Jan 04, 2019

05:39 PM Incident #13096: Share Updates mentioning in some VRE may not work

Could not reproduce, the issue is due to the fact that it seems that arrives an empty mentioned id somehow. Patching ... Massimiliano Assante

05:21 PM Incident #13096 (In Progress): Share Updates mentioning in some VRE may not work

Massimiliano Assante

05:18 PM Incident #13096 (Closed): Share Updates mentioning in some VRE may not work

The following exception is reported.
~~~
16:10:21,919 WARN [ajp-bio-8009-exec-7][SecurityPortletContainerWrapper... Massimiliano Assante

10:44 AM Incident #13090 (Rejected): HomeLibrary stil not return VRE folder in prepod

The error was not related to the VRE folder Luca Frosini

10:24 AM Incident #13090: HomeLibrary stil not return VRE folder in prepod

Lucio please check what's the issue with the preprod repository, if necessary we can "destroy" it and recreate it. Massimiliano Assante

Dec 31, 2018

01:29 PM Incident #13090 (Rejected): HomeLibrary stil not return VRE folder in prepod

Luca Frosini

09:55 AM Task #13087: Please upgrade grsf-publisher-ws to latest version

I'm still getting the same error:
~~~
$ ./run.sh smartgears-node.yml -i inventory/hosts.production -t grsf_publis... Luca Frosini

Dec 28, 2018

02:54 PM Task #13087: Please upgrade grsf-publisher-ws to latest version

Luca Frosini wrote:
> Thanks a lot.
>
> Let me know when you find a solution and what I have to do in the future.... Andrea Dell'Amico

02:39 PM Task #13087: Please upgrade grsf-publisher-ws to latest version

Thanks a lot.
Let me know when you find a solution and what I have to do in the future. Luca Frosini

02:36 PM Task #13087 (Closed): Please upgrade grsf-publisher-ws to latest version

I run the playbook successfully.
About your authentication problems: limiting the run to a selected role it's not e... Andrea Dell'Amico

09:21 AM Task #13087: Please upgrade grsf-publisher-ws to latest version

@andrea.dellamico@isti.cnr.it I'm getting the same error:
~~~
$ ./run.sh smartgears-node.yml -i inventory/hosts.p... Luca Frosini

Dec 27, 2018

06:07 PM Task #13087: Please upgrade grsf-publisher-ws to latest version

You must limit the scope of the playbook, as usual: if you run it without specifying any tags it will try to execute ... Andrea Dell'Amico

04:07 PM Task #13087: Please upgrade grsf-publisher-ws to latest version

The installed war must be:
~~~
grsf-publisher-ws-1.8.0-4.13.1-176225.war
~~~ Luca Frosini

04:05 PM Task #13087 (Closed): Please upgrade grsf-publisher-ws to latest version

Using the following command:
~~~
./run.sh smartgears-node.yml -i inventory/hosts.production -l smart_grsf_prod
~... Luca Frosini

12:28 PM Support #13083 (Closed): mongo2-d-d4s, mongo4-d-d4s: Certificate expired

Done also on production environment. I'm going to close this ticket Roberto Cirillo

11:50 AM Support #13083: mongo2-d-d4s, mongo4-d-d4s: Certificate expired

Roberto Cirillo wrote:
> Andrea Dell'Amico wrote:
> > On the other mongo instances is installed the wrong hook scri... Andrea Dell'Amico

11:43 AM Support #13083: mongo2-d-d4s, mongo4-d-d4s: Certificate expired

Andrea Dell'Amico wrote:
> On the other mongo instances is installed the wrong hook script too.
> A recap: mongodb ... Roberto Cirillo

11:41 AM Support #13083: mongo2-d-d4s, mongo4-d-d4s: Certificate expired

Andrea Dell'Amico wrote:
> Roberto Cirillo wrote:
> > After the restart I see the same error on mongo2-d-d4s and mo... Roberto Cirillo

11:35 AM Support #13083: mongo2-d-d4s, mongo4-d-d4s: Certificate expired

Roberto Cirillo wrote:
> After the restart I see the same error on mongo2-d-d4s and mongo4-d-d4s
But mongodb on m... Andrea Dell'Amico

11:34 AM Support #13083: mongo2-d-d4s, mongo4-d-d4s: Certificate expired

On the other mongo instances is installed the wrong hook script too.
A recap: mongodb does not support a service rel... Andrea Dell'Amico

11:25 AM Support #13083: mongo2-d-d4s, mongo4-d-d4s: Certificate expired

After the restart I see the same error on mongo2-d-d4s and mongo4-d-d4s Roberto Cirillo

11:20 AM Support #13083: mongo2-d-d4s, mongo4-d-d4s: Certificate expired

OK thanks. I'm going to run the playbook as requested Roberto Cirillo

11:16 AM Support #13083 (In Progress): mongo2-d-d4s, mongo4-d-d4s: Certificate expired

The certificates were correctly renewed on all the dev mongo instances, Dec 1st. But I see that the restart action is... Andrea Dell'Amico

10:47 AM Support #13083 (Closed): mongo2-d-d4s, mongo4-d-d4s: Certificate expired

The certificate seems to be expired on the hosts above and the lag is very high now. I see the following logs:
~~~... Roberto Cirillo

11:15 AM Incident #13084 (Closed): SoBigData: collector corrupted

db restored from backup of 20/12. There weren't any more recent backup. Roberto Cirillo

11:07 AM Incident #13084 (In Progress): SoBigData: collector corrupted

Roberto Cirillo

11:06 AM Incident #13084 (Closed): SoBigData: collector corrupted

The IS-collector service doesn't work anymore. A db restore is needed. Roberto Cirillo

Dec 20, 2018

03:32 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

@roberto.cirillo@isti.cnr.it this ticket has been closed, follow the discussion in the associated Task. The problem i... Giancarlo Panichi

03:18 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

The problem here was due to an incompatibility between jdk 8 build 161 and registry service. In order to fix this inc... Roberto Cirillo

Dec 19, 2018

06:30 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

I think the issue is in the fact that the Generic Workers do not find the algorithm in the private category and they ... Gianpaolo Coro

06:13 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

I was talking about the publication on the IS done at every execution of the addAlgorithm, this is what Giancarlo is ... Lucio Lelii

03:00 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

Lucio Lelii wrote:
> My fear is that what is now modifying Giancarlo is not a bug but a choice, because it's impossi... Massimiliano Assante

02:55 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

My fear is that what is now modifying Giancarlo is not a bug but a choice, because it's impossible we didn't notice i... Lucio Lelii

12:41 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

@roberto.cirillo@isti.cnr.it , Yes the same component is also present in all the dataminer*-proto instances. Giancarlo Panichi

12:34 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

@roberto.cirillo@isti.cnr.it I have already answered above this depends on the fact that that code does not behave c... Giancarlo Panichi

11:21 AM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

Just two comments:
If the problem is in the dataminer-algorithms-importer, why only the gw proto instances have remo... Roberto Cirillo

11:13 AM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

Hi @massimiliano.assante@isti.cnr.it , it is part of the code that was written by Gianpaolo and Lucio to install the ... Giancarlo Panichi

11:09 AM Incident #13029 (Closed): Private algorithm disappeared in SoBigDataLab VRE

I close this ticket Giancarlo Panichi

11:04 AM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

Giancarlo Panichi wrote:
> The answer is that the dataniner*-gw-proto are also dataminer in the proto cluster, so th... Massimiliano Assante

10:55 AM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

The answer is that the dataniner*-gw-proto are also dataminer in the proto cluster, so they also execute the java cod... Giancarlo Panichi

10:25 AM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

As shown in the registry logs, the resource has been deleted several times by someone:
~~~
2018-12-18 18:28:42,18... Roberto Cirillo

10:11 AM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

Giancarlo Panichi wrote:
> After investigating in depth I think there are two problems:
>
> 1. The code of addAlg... Roberto Cirillo

02:51 PM Incident #13066 (Closed): DataMiner algorithm on FARM/PerformFISH-KPIs not working

Yes it works now, i'll relate the ticket to the other one talking about algorithms "desaparecidos" Massimiliano Assante

02:46 PM Incident #13066 (Feedback): DataMiner algorithm on FARM/PerformFISH-KPIs not working

Gianpaolo Coro

02:45 PM Incident #13066 (In Progress): DataMiner algorithm on FARM/PerformFISH-KPIs not working

After the re-installation it is working. Could you check please? Gianpaolo Coro

02:38 PM Incident #13066: DataMiner algorithm on FARM/PerformFISH-KPIs not working

Gianpaolo Coro wrote:
> The error indicates that the algorithm is no more installed on the production DataMiners. I'... Roberto Cirillo

01:22 PM Incident #13066: DataMiner algorithm on FARM/PerformFISH-KPIs not working

The error indicates that the algorithm is no more installed on the production DataMiners. I'm going to reinstall it. ... Gianpaolo Coro

12:47 PM Incident #13066: DataMiner algorithm on FARM/PerformFISH-KPIs not working

Clearly this reflects on the PerformFISH KPI Form Submission app as well Massimiliano Assante

12:45 PM Incident #13066: DataMiner algorithm on FARM/PerformFISH-KPIs not working

Adding @roberto.cirillo@isti.cnr.it to check if it's a misconfiguration Massimiliano Assante

12:44 PM Incident #13066 (Closed): DataMiner algorithm on FARM/PerformFISH-KPIs not working

The error is: the computation 49d696e5-4809-461c-910d-f1457064da97 of Performfish Data Validator V2 has failed.
java... Massimiliano Assante

12:50 PM Task #13054 (Closed): Infrastructure-monitor: The new VO D4OS is not shown anymore

Massimiliano Assante

11:59 AM Task #13054 (In Progress): Infrastructure-monitor: The new VO D4OS is not shown anymore

Massimiliano Assante

12:14 PM Task #12384 (Closed): Provide a cronjob for restarting VREModeler service

Andrea Dell'Amico

12:13 PM Task #12799: Memory problems on ckan-d4s1.d4science.org

@tommaso.piccioli@isti.cnr.it @francesco.mangiacrapa@isti.cnr.it was the RAM amount increased? if not, let's do that.
Andrea Dell'Amico

Dec 18, 2018

09:02 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

After investigating in depth I think there are two problems:
1. The code of addAlgorithm that run on the DataMiner... Giancarlo Panichi

06:37 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

So, here's the thing. It disappeared again 5 minutes ago when I triggered an algorithm deployment via the DM Deployer... Massimiliano Assante

04:12 PM Incident #13029 (In Progress): Private algorithm disappeared in SoBigDataLab VRE

Massimiliano Assante

04:12 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

Si I was told to re publish again the SortWords algorithm in the SoBigData Lab VRE and to paste the resource UID in t... Massimiliano Assante

03:00 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

Just to add that last Thursday (13/12) I republished the algorithm sortWords again in SoBigDataLab (see the email I r... Massimiliano Assante

Dec 17, 2018

03:00 PM Incident #13053: DataMiner does not show computations

There seems to be a problem with the folders shared with the old HL. @lucio.lelii@isti.cnr.it please, can you invest... Giancarlo Panichi

01:29 PM Incident #13053 (Closed): DataMiner does not show computations

The user marco.palma does not retrieve any computation from the DataMiner interface. The check the computations page ... Gianpaolo Coro

02:51 PM Task #13054 (Closed): Infrastructure-monitor: The new VO D4OS is not shown anymore

The new VO D4OS is missing on every infrastructure-monitor.
Please could you re enable it on Production and PreProdu... Roberto Cirillo

11:40 AM Incident #13051: Unable to add Generic Resourec to Scope

you are welcome Roberto Cirillo

11:11 AM Incident #13051: Unable to add Generic Resourec to Scope

Thank you Luca Frosini

11:07 AM Incident #13051 (Closed): Unable to add Generic Resourec to Scope

Added. The problem was due to the ResourceManager service. Roberto Cirillo

11:01 AM Incident #13051 (In Progress): Unable to add Generic Resourec to Scope

Roberto Cirillo