D4Science Infrastructure

Jan 10, 2019

08:21 PM Task #13050: Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

OK. The playbook is ready, let's coordinate us to install the patch when a restart of the server is not a problem. Andrea Dell'Amico

04:07 PM Task #13050: Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

Andrea Dell'Amico wrote:
> New patch that includes the changes to the template snippets.
Hi Andrea, thanks for yo... Francesco Mangiacrapa

12:46 PM VRE #12946 (Removed): D4Research/FAIR_DM VRE Removal

Massimiliano Assante

Jan 09, 2019

05:59 PM Task #13050: Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

New patch that includes the changes to the template snippets.
Andrea Dell'Amico

05:06 PM Task #13050: Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

A fixed one, the first ad a syntax error in it. Andrea Dell'Amico

04:56 PM Task #13050: Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

I'm attaching the diff file. Andrea Dell'Amico

04:52 PM Task #13050: Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

The changes are active on ckan-d-d4s.d4science.org. @francesco.mangiacrapa@isti.cnr.it can you test if the involved p... Andrea Dell'Amico

04:40 PM Task #13050: Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

I can anticipate that the changes here: https://github.com/ckan/ckan/pull/3430/commits/5d6949ca7602eb5039227229a01132... Andrea Dell'Amico

04:10 PM Task #13050 (In Progress): Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

I'm going to duplicate the sources on the dev instance and I'll try to produce a patch. Andrea Dell'Amico

Jan 08, 2019

06:45 PM VM Creation #13112 (Closed): perform-service development instance

A new VM is needed in order to test the new service 'perform-service'.
Such service needs to connect to the VRE's ... Fabio Sinibaldi

Jan 07, 2019

11:55 AM Task #12935 (Closed): sdi-service: upgrade commons-codec library

The library has been upgraded in production and preproduction environments. Roberto Cirillo

10:26 AM Task #11229 (Closed): Upgrade jdk on tagme.d4science.org

Roberto Cirillo

Jan 04, 2019

05:39 PM Incident #13096: Share Updates mentioning in some VRE may not work

Could not reproduce, the issue is due to the fact that it seems that arrives an empty mentioned id somehow. Patching ... Massimiliano Assante

05:21 PM Incident #13096 (In Progress): Share Updates mentioning in some VRE may not work

Massimiliano Assante

05:18 PM Incident #13096 (Closed): Share Updates mentioning in some VRE may not work

The following exception is reported.
~~~
16:10:21,919 WARN [ajp-bio-8009-exec-7][SecurityPortletContainerWrapper... Massimiliano Assante

10:44 AM Incident #13090 (Rejected): HomeLibrary stil not return VRE folder in prepod

The error was not related to the VRE folder Luca Frosini

10:24 AM Incident #13090: HomeLibrary stil not return VRE folder in prepod

Lucio please check what's the issue with the preprod repository, if necessary we can "destroy" it and recreate it. Massimiliano Assante

Dec 31, 2018

01:29 PM Incident #13090 (Rejected): HomeLibrary stil not return VRE folder in prepod

Luca Frosini

09:55 AM Task #13087: Please upgrade grsf-publisher-ws to latest version

I'm still getting the same error:
~~~
$ ./run.sh smartgears-node.yml -i inventory/hosts.production -t grsf_publis... Luca Frosini

Dec 28, 2018

02:54 PM Task #13087: Please upgrade grsf-publisher-ws to latest version

Luca Frosini wrote:
> Thanks a lot.
>
> Let me know when you find a solution and what I have to do in the future.... Andrea Dell'Amico

02:39 PM Task #13087: Please upgrade grsf-publisher-ws to latest version

Thanks a lot.
Let me know when you find a solution and what I have to do in the future. Luca Frosini

02:36 PM Task #13087 (Closed): Please upgrade grsf-publisher-ws to latest version

I run the playbook successfully.
About your authentication problems: limiting the run to a selected role it's not e... Andrea Dell'Amico

09:21 AM Task #13087: Please upgrade grsf-publisher-ws to latest version

@andrea.dellamico@isti.cnr.it I'm getting the same error:
~~~
$ ./run.sh smartgears-node.yml -i inventory/hosts.p... Luca Frosini

Dec 27, 2018

06:07 PM Task #13087: Please upgrade grsf-publisher-ws to latest version

You must limit the scope of the playbook, as usual: if you run it without specifying any tags it will try to execute ... Andrea Dell'Amico

04:07 PM Task #13087: Please upgrade grsf-publisher-ws to latest version

The installed war must be:
~~~
grsf-publisher-ws-1.8.0-4.13.1-176225.war
~~~ Luca Frosini

04:05 PM Task #13087 (Closed): Please upgrade grsf-publisher-ws to latest version

Using the following command:
~~~
./run.sh smartgears-node.yml -i inventory/hosts.production -l smart_grsf_prod
~... Luca Frosini

12:28 PM Support #13083 (Closed): mongo2-d-d4s, mongo4-d-d4s: Certificate expired

Done also on production environment. I'm going to close this ticket Roberto Cirillo

11:50 AM Support #13083: mongo2-d-d4s, mongo4-d-d4s: Certificate expired

Roberto Cirillo wrote:
> Andrea Dell'Amico wrote:
> > On the other mongo instances is installed the wrong hook scri... Andrea Dell'Amico

11:43 AM Support #13083: mongo2-d-d4s, mongo4-d-d4s: Certificate expired

Andrea Dell'Amico wrote:
> On the other mongo instances is installed the wrong hook script too.
> A recap: mongodb ... Roberto Cirillo

11:41 AM Support #13083: mongo2-d-d4s, mongo4-d-d4s: Certificate expired

Andrea Dell'Amico wrote:
> Roberto Cirillo wrote:
> > After the restart I see the same error on mongo2-d-d4s and mo... Roberto Cirillo

11:35 AM Support #13083: mongo2-d-d4s, mongo4-d-d4s: Certificate expired

Roberto Cirillo wrote:
> After the restart I see the same error on mongo2-d-d4s and mongo4-d-d4s
But mongodb on m... Andrea Dell'Amico

11:34 AM Support #13083: mongo2-d-d4s, mongo4-d-d4s: Certificate expired

On the other mongo instances is installed the wrong hook script too.
A recap: mongodb does not support a service rel... Andrea Dell'Amico

11:25 AM Support #13083: mongo2-d-d4s, mongo4-d-d4s: Certificate expired

After the restart I see the same error on mongo2-d-d4s and mongo4-d-d4s Roberto Cirillo

11:20 AM Support #13083: mongo2-d-d4s, mongo4-d-d4s: Certificate expired

OK thanks. I'm going to run the playbook as requested Roberto Cirillo

11:16 AM Support #13083 (In Progress): mongo2-d-d4s, mongo4-d-d4s: Certificate expired

The certificates were correctly renewed on all the dev mongo instances, Dec 1st. But I see that the restart action is... Andrea Dell'Amico

10:47 AM Support #13083 (Closed): mongo2-d-d4s, mongo4-d-d4s: Certificate expired

The certificate seems to be expired on the hosts above and the lag is very high now. I see the following logs:
~~~... Roberto Cirillo

11:15 AM Incident #13084 (Closed): SoBigData: collector corrupted

db restored from backup of 20/12. There weren't any more recent backup. Roberto Cirillo

11:07 AM Incident #13084 (In Progress): SoBigData: collector corrupted

Roberto Cirillo

11:06 AM Incident #13084 (Closed): SoBigData: collector corrupted

The IS-collector service doesn't work anymore. A db restore is needed. Roberto Cirillo

Dec 20, 2018

03:32 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

@roberto.cirillo@isti.cnr.it this ticket has been closed, follow the discussion in the associated Task. The problem i... Giancarlo Panichi

03:18 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

The problem here was due to an incompatibility between jdk 8 build 161 and registry service. In order to fix this inc... Roberto Cirillo

Dec 19, 2018

06:30 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

I think the issue is in the fact that the Generic Workers do not find the algorithm in the private category and they ... Gianpaolo Coro

06:13 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

I was talking about the publication on the IS done at every execution of the addAlgorithm, this is what Giancarlo is ... Lucio Lelii

03:00 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

Lucio Lelii wrote:
> My fear is that what is now modifying Giancarlo is not a bug but a choice, because it's impossi... Massimiliano Assante

02:55 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

My fear is that what is now modifying Giancarlo is not a bug but a choice, because it's impossible we didn't notice i... Lucio Lelii

12:41 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

@roberto.cirillo@isti.cnr.it , Yes the same component is also present in all the dataminer*-proto instances. Giancarlo Panichi

12:34 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

@roberto.cirillo@isti.cnr.it I have already answered above this depends on the fact that that code does not behave c... Giancarlo Panichi

11:21 AM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

Just two comments:
If the problem is in the dataminer-algorithms-importer, why only the gw proto instances have remo... Roberto Cirillo

11:13 AM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

Hi @massimiliano.assante@isti.cnr.it , it is part of the code that was written by Gianpaolo and Lucio to install the ... Giancarlo Panichi

11:09 AM Incident #13029 (Closed): Private algorithm disappeared in SoBigDataLab VRE

I close this ticket Giancarlo Panichi

11:04 AM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

Giancarlo Panichi wrote:
> The answer is that the dataniner*-gw-proto are also dataminer in the proto cluster, so th... Massimiliano Assante

10:55 AM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

The answer is that the dataniner*-gw-proto are also dataminer in the proto cluster, so they also execute the java cod... Giancarlo Panichi

10:25 AM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

As shown in the registry logs, the resource has been deleted several times by someone:
~~~
2018-12-18 18:28:42,18... Roberto Cirillo

10:11 AM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

Giancarlo Panichi wrote:
> After investigating in depth I think there are two problems:
>
> 1. The code of addAlg... Roberto Cirillo

02:51 PM Incident #13066 (Closed): DataMiner algorithm on FARM/PerformFISH-KPIs not working

Yes it works now, i'll relate the ticket to the other one talking about algorithms "desaparecidos" Massimiliano Assante

02:46 PM Incident #13066 (Feedback): DataMiner algorithm on FARM/PerformFISH-KPIs not working

Gianpaolo Coro

02:45 PM Incident #13066 (In Progress): DataMiner algorithm on FARM/PerformFISH-KPIs not working

After the re-installation it is working. Could you check please? Gianpaolo Coro

02:38 PM Incident #13066: DataMiner algorithm on FARM/PerformFISH-KPIs not working

Gianpaolo Coro wrote:
> The error indicates that the algorithm is no more installed on the production DataMiners. I'... Roberto Cirillo

01:22 PM Incident #13066: DataMiner algorithm on FARM/PerformFISH-KPIs not working

The error indicates that the algorithm is no more installed on the production DataMiners. I'm going to reinstall it. ... Gianpaolo Coro

12:47 PM Incident #13066: DataMiner algorithm on FARM/PerformFISH-KPIs not working

Clearly this reflects on the PerformFISH KPI Form Submission app as well Massimiliano Assante

12:45 PM Incident #13066: DataMiner algorithm on FARM/PerformFISH-KPIs not working

Adding @roberto.cirillo@isti.cnr.it to check if it's a misconfiguration Massimiliano Assante

12:44 PM Incident #13066 (Closed): DataMiner algorithm on FARM/PerformFISH-KPIs not working

The error is: the computation 49d696e5-4809-461c-910d-f1457064da97 of Performfish Data Validator V2 has failed.
java... Massimiliano Assante

12:50 PM Task #13054 (Closed): Infrastructure-monitor: The new VO D4OS is not shown anymore

Massimiliano Assante

11:59 AM Task #13054 (In Progress): Infrastructure-monitor: The new VO D4OS is not shown anymore

Massimiliano Assante

12:14 PM Task #12384 (Closed): Provide a cronjob for restarting VREModeler service

Andrea Dell'Amico

12:13 PM Task #12799: Memory problems on ckan-d4s1.d4science.org

@tommaso.piccioli@isti.cnr.it @francesco.mangiacrapa@isti.cnr.it was the RAM amount increased? if not, let's do that.
Andrea Dell'Amico

Dec 18, 2018

09:02 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

After investigating in depth I think there are two problems:
1. The code of addAlgorithm that run on the DataMiner... Giancarlo Panichi

06:37 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

So, here's the thing. It disappeared again 5 minutes ago when I triggered an algorithm deployment via the DM Deployer... Massimiliano Assante

04:12 PM Incident #13029 (In Progress): Private algorithm disappeared in SoBigDataLab VRE

Massimiliano Assante

04:12 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

Si I was told to re publish again the SortWords algorithm in the SoBigData Lab VRE and to paste the resource UID in t... Massimiliano Assante

03:00 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

Just to add that last Thursday (13/12) I republished the algorithm sortWords again in SoBigDataLab (see the email I r... Massimiliano Assante

Dec 17, 2018

03:00 PM Incident #13053: DataMiner does not show computations

There seems to be a problem with the folders shared with the old HL. @lucio.lelii@isti.cnr.it please, can you invest... Giancarlo Panichi

01:29 PM Incident #13053 (Closed): DataMiner does not show computations

The user marco.palma does not retrieve any computation from the DataMiner interface. The check the computations page ... Gianpaolo Coro

02:51 PM Task #13054 (Closed): Infrastructure-monitor: The new VO D4OS is not shown anymore

The new VO D4OS is missing on every infrastructure-monitor.
Please could you re enable it on Production and PreProdu... Roberto Cirillo

11:40 AM Incident #13051: Unable to add Generic Resourec to Scope

you are welcome Roberto Cirillo

11:11 AM Incident #13051: Unable to add Generic Resourec to Scope

Thank you Luca Frosini

11:07 AM Incident #13051 (Closed): Unable to add Generic Resourec to Scope

Added. The problem was due to the ResourceManager service. Roberto Cirillo

11:01 AM Incident #13051 (In Progress): Unable to add Generic Resourec to Scope

Roberto Cirillo

Dec 15, 2018

10:41 AM Support #13052 (Closed): Please allow postgres database connection to gcat service

This task was already done. I created a ticket for future references Luca Frosini

10:38 AM Support #13052 (Closed): Please allow postgres database connection to gcat service

The database is ckan_prod_aginfra which is hosted on ckan-pg-d4s.d4science.org.
The gcat service is hosted on gcat.d... Luca Frosini

Dec 14, 2018

06:38 PM Incident #13051 (Closed): Unable to add Generic Resourec to Scope

I'm not able to add the resource with id '23d827cd-ba8e-4d8c-9ab4-6303bdb7d1db' to the scope '/d4science.research-inf... Luca Frosini

05:34 PM Task #13050 (Closed): Try to improve CKAN 2.6.X performance by adding fixes released for CKAN 2.7.X

We know that the CKAN system 2.6.X (currently installed for the gCube Catalogues) degrades its performance after a ce... Francesco Mangiacrapa

12:24 PM Task #13043 (Closed): Provide a cronjob for removing old access.log files on IS-Registry instances

cronjob added to all the Registry instances. Roberto Cirillo

12:10 PM Task #13043 (In Progress): Provide a cronjob for removing old access.log files on IS-Registry instances

Roberto Cirillo

11:50 AM Task #13043 (Closed): Provide a cronjob for removing old access.log files on IS-Registry instances

Roberto Cirillo

Dec 13, 2018

05:48 PM Task #12527: Undeploy FARM/AquaMaps VRE

The Aquamaps VRE has been dismissed and all the related resources cleaned. I'm going to assign this ticket to @lucio.... Roberto Cirillo

04:31 PM Upgrade #13039 (Completed): Infra-gateways fourth update to gCube 4.13.0

Massimiliano Assante

03:42 PM Upgrade #13039 (In Progress): Infra-gateways fourth update to gCube 4.13.0

Massimiliano Assante

02:49 PM Upgrade #13039 (Planned): Infra-gateways fourth update to gCube 4.13.0

Massimiliano Assante

02:47 PM Upgrade #13039 (Completed): Infra-gateways fourth update to gCube 4.13.0

This update fixes the Incident #13013, it contains the Messages portlet only:
* messages-2.2.0-4.13.1-174717
On... Massimiliano Assante

Dec 12, 2018

05:52 PM Task #9115 (Closed): VRE Modeler fails to undeploy VREs under gCubeApps

Resources cleaned Roberto Cirillo

05:02 PM Task #9115 (In Progress): VRE Modeler fails to undeploy VREs under gCubeApps

I'm going to run a script in order to clean all the ServiceEndpoints and GenericResources under gCubeApps. Roberto Cirillo

05:37 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

Giancarlo Panichi wrote:
> The problem is that there is no resource on the IS and it is also missing the SecondaryTy... Massimiliano Assante

04:36 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

The problem is that there is no resource on the IS and it is also missing the SecondaryType:
~~~
<SecondaryTyp... Giancarlo Panichi

04:32 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

Look this morning I have not republished in RPrototypingLab for sure (and it says .... Simple method that sort words ... Massimiliano Assante

04:18 PM Incident #13029: Private algorithm disappeared in SoBigDataLab VRE

Looking on svn it seems that SAI and DMPoolManager have correctly published the algorithm on svn, and for what I see ... Giancarlo Panichi

03:24 PM Incident #13029 (Closed): Private algorithm disappeared in SoBigDataLab VRE

On Monday 10 Dec, I could see my method named SortWords (Python Examples category), also took the screenshot attached... Massimiliano Assante

04:28 PM Task #12252 (Closed): VRE Modeler FARM VO reports only 12 VREs whereas they are circa 28

Massimiliano Assante wrote:
> > > There is a confusion here Roberto, look at the VO!, at the time of the ticket (Jun... Roberto Cirillo

04:07 PM Task #12252: VRE Modeler FARM VO reports only 12 VREs whereas they are circa 28

> > There is a confusion here Roberto, look at the VO!, at the time of the ticket (June 2017) we moved the 3 VREs abo... Massimiliano Assante

04:01 PM Task #12252: VRE Modeler FARM VO reports only 12 VREs whereas they are circa 28

Massimiliano Assante wrote:
> Roberto Cirillo wrote:
> > Roberto Cirillo wrote:
> > > This is the list of all the ... Roberto Cirillo

03:52 PM Task #12252: VRE Modeler FARM VO reports only 12 VREs whereas they are circa 28

Roberto Cirillo wrote:
> Roberto Cirillo wrote:
> > This is the list of all the VREs that are present only on infra... Massimiliano Assante

03:45 PM Task #12252 (Feedback): VRE Modeler FARM VO reports only 12 VREs whereas they are circa 28

iMarineBoardVRE is back.
Finally, all the VREs have been successfully restored. I'm going to re assign this ticket ... Roberto Cirillo

03:21 PM Task #12252: VRE Modeler FARM VO reports only 12 VREs whereas they are circa 28

iLKNAK_Aquaculture restored Roberto Cirillo

02:38 PM Task #12252: VRE Modeler FARM VO reports only 12 VREs whereas they are circa 28

SustainableBlueEconomy restored Roberto Cirillo

12:35 PM Task #12252: VRE Modeler FARM VO reports only 12 VREs whereas they are circa 28

STRATOS_AQUACULTURES restored Roberto Cirillo

12:13 PM Task #12252: VRE Modeler FARM VO reports only 12 VREs whereas they are circa 28

NHREUS_Aquaculture restored Roberto Cirillo

11:21 AM Task #12252: VRE Modeler FARM VO reports only 12 VREs whereas they are circa 28

MARKELLOS_Aquaculture is back Roberto Cirillo

10:11 AM Task #11522 (Closed): Provide a cronjob for removing old access.log files

The job works properly Roberto Cirillo