D4Science Infrastructure

Sep 02, 2017

05:29 PM Task #9576: provision the smartgear logback configuration starting from a template

Since logback 1.1.7 there's an appender called `SizeAndTimeBasedRollingPolicy` that does exactly what I'm asking. A r... Andrea Dell'Amico

05:27 PM Task #9576: provision the smartgear logback configuration starting from a template

Last: if a size based rolling appender can be configured, this would be very helpful to keep the total log size under... Andrea Dell'Amico

05:26 PM Task #9576: provision the smartgear logback configuration starting from a template

Another parameter that can be configured is `maxHistory`: 30 days is usually too much.
Andrea Dell'Amico

05:24 PM Task #9576: provision the smartgear logback configuration starting from a template

Also, add the following configuration on the dataminers (the log path will change):
~~~
<appender name="ANALYSIS"... Andrea Dell'Amico

05:23 PM Task #9576 (Closed): provision the smartgear logback configuration starting from a template

The in place xml editing is not reliable, and it's impossible to include or exclude chunks of configuration settings.... Andrea Dell'Amico

02:17 PM VM Creation #9301 (Closed): VM creation for GeoNetwork connector development

Andrea Dell'Amico

02:14 PM VM Creation #8990 (Feedback): new instance of FusionRegistry in production

@g.panichi@isti.cnr.it any news about it? Andrea Dell'Amico

02:08 PM VM Creation #7465 (Closed): Please Create a VM to install SmartExecutor for SmartArea

Andrea Dell'Amico

Sep 01, 2017

06:39 PM Task #9571 (Closed): HL: not add extensions to files during the zip creation

During the zip creation, the extensions are automatically added to files.
We should skip this step to avoid communi... Valentina Marioli

06:34 PM Task #9570 (Rejected): Metadata information not correctly reported to SAI

Randomly, a project's full metadata information is not correctly reported to SAI and thus is not correctly saved on t... Valentina Marioli

06:32 PM Task #9569 (Closed): HL: Problem with locks

In some cases, the lock is not released when the file is overwritten.
This issue is related to communication proble... Valentina Marioli

06:29 PM Support #9536 (Closed): Critical Workspace-SAI issues

To fix the issues:
1. during the zip creation, the extensions are automatically added to files. We can skip this ste... Valentina Marioli

06:03 PM Support #9536 (In Progress): Critical Workspace-SAI issues

Valentina Marioli

05:10 PM Task #9549: Make R scripts inherit user name and VRE

this feature has been released in 4.6.1 Lucio Lelii

03:20 PM Task #9549 (Closed): Make R scripts inherit user name and VRE

It works well, now three parameters are inherited: gcube_username, gcube_context, and gcube_token Gianpaolo Coro

03:47 PM Task #9551: Some jobs wrote big chunks of data into the persistence jackrabbit table

Gianpaolo Coro wrote:
> One of the big blobs contains a large quantity of objects generated by the old-good Statisti... Costantino Perciante

02:46 PM Task #9551: Some jobs wrote big chunks of data into the persistence jackrabbit table

One of the big blobs contains a large quantity of objects generated by the old-good Statistical Manager between 2014 ... Gianpaolo Coro

01:10 PM Task #9551: Some jobs wrote big chunks of data into the persistence jackrabbit table

@valentina.marioli@isti.cnr.it just asked to restore those backups. You can find them on workspace-repository-prod1.d... Andrea Dell'Amico

01:02 PM Task #9551: Some jobs wrote big chunks of data into the persistence jackrabbit table

If we really want to understand how the content is stored in there, then we will need to inspect the jackrabbit code.... Costantino Perciante

12:15 PM Task #9551: Some jobs wrote big chunks of data into the persistence jackrabbit table

Gianpaolo Coro wrote:
> When a computation fails, a gCube Item is created having a stacktrace attached. In the case ... Andrea Dell'Amico

12:09 PM Task #9551: Some jobs wrote big chunks of data into the persistence jackrabbit table

I also uploaded a blob of something that seems an execution log, with failures: https://goo.gl/VNmpeJ
Andrea Dell'Amico

11:47 AM Task #9551: Some jobs wrote big chunks of data into the persistence jackrabbit table

When a computation fails, a gCube Item is created having a stacktrace attached. In the case of BiOnym, this can be lo... Gianpaolo Coro

11:02 AM Task #9551 (In Progress): Some jobs wrote big chunks of data into the persistence jackrabbit table

Valentina Marioli

03:33 PM Incident #9522: Authorisation service not working in DEV

I cannot find the logs on the standard error. Regarding the log level is fine with me to change it to WARN or ERROR. Lucio Lelii

02:39 PM Task #9477 (Closed): Create new Postgres Database

Ok, perfect.
I succesfully created tables, views, etc... On the Dev environment.
Tested succesfully the Prod.
Than... Eric Perrone

02:34 PM Task #9477: Create new Postgres Database

Ok, perfect.
I succesfully created tables, views, etc... On the Dev environment.
Tested succesfully the Prod.
Than... Eric Perrone

01:24 PM VM Creation #9354 (Closed): VM Creation for AquacultureAtlasGeneration dedicated GeoNetwork

I guess we can close this one, the DB management is a matter of #9511 Andrea Dell'Amico

12:35 PM VM Creation #9354: VM Creation for AquacultureAtlasGeneration dedicated GeoNetwork

any news? Pasquale Pagano

Aug 31, 2017

05:55 PM Task #9549 (Feedback): Make R scripts inherit user name and VRE

the 2 new environment properties are **gcube_username** and **gcube_context**. This version is deplyed in **gcube/dev... Lucio Lelii

03:59 PM VM Creation #9558 (Closed): Updated VM for GN3 Migration

In order to migrate development infrastructure to GeoNetwork 3.x we need an updated VM with java 8 and SmartGears. Fabio Sinibaldi

11:28 AM Task #9543 (Closed): Add a TODO plugin to redmine

Also installed in production. Andrea Dell'Amico

10:29 AM Upgrade #9541 (Planned): /gcube/preprod upgrade to gCube 4.6.1 (CommonApps)

Roberto Cirillo

Aug 30, 2017

11:32 PM Task #9551 (In Progress): Some jobs wrote big chunks of data into the persistence jackrabbit table

From Aug 19th and 21th something (someone) wrote repeatedly into the workspace big chunks of data into the persistenc... Andrea Dell'Amico

04:41 PM Support #9548 (Closed): Smaph app: error from remote server

ok thanks. Roberto Cirillo

04:25 PM Support #9548: Smaph app: error from remote server

Hi Roberto,
that service is hosted on an unstable machine that may give errors from time to time. I have checked i... Marco Cornolti

03:09 PM Support #9548 (Closed): Smaph app: error from remote server

The smaph app seems to receive an error from a remote server.
I see in the catalina log the following url:
~~~
h... Roberto Cirillo

04:10 PM Task #9549 (Closed): Make R scripts inherit user name and VRE

The R scripts are going to inherit the user's token. Indeed, also the user name and the called VRE should be added, w... Gianpaolo Coro

02:34 PM Upgrade #9541: /gcube/preprod upgrade to gCube 4.6.1 (CommonApps)

**Hosting Nodes**
* **(CNR) DONE** data-d.d4science.org
* **(NKUA) DONE** dl001.madgik.di.uoa.gr - install
*GH... Roberto Cirillo

12:51 PM Upgrade #9547 (Completed): D4Science Root VO upgrade to gCube 4.6.1

Roberto Cirillo

Aug 29, 2017

08:03 PM Task #9543 (In Progress): Add a TODO plugin to redmine

The plugin is available on the dev instance: https://redmine-d.d4science.org
It is active on the D4Science Infrastru... Andrea Dell'Amico

05:39 PM Task #9543 (Closed): Add a TODO plugin to redmine

A *TODO list* plugin could be useful to some users. A candidate is https://redmine.org/plugins/redmine_issue_todo_lis... Andrea Dell'Amico

02:45 PM Task #5447 (In Progress): Provide maintainable solution for hosting static web-apps + SFTP access for easy maintenance

I'm reopening since the request is not yet satisfied. As you mentioned above, it depends on #5699.
If the latter can... Emmanuel Blondel

12:31 PM Upgrade #9541 (Completed): /gcube/preprod upgrade to gCube 4.6.1 (CommonApps)

Roberto Cirillo

Aug 28, 2017

06:27 PM Task #9323 (Closed): Move some hadoop workers from the old cluster to the HDP one

The new nodes have been named worker[4:11]-hadoop.d4science.org. They are now part of the HDP cluster.
Andrea Dell'Amico

11:43 AM Support #9536: Critical Workspace-SAI issues

The project TEST_SAI_WS_INTERACTION has been shared and already presents error n. 3 Gianpaolo Coro

11:34 AM Support #9536 (Closed): Critical Workspace-SAI issues

Here I report a number of issues that are preventing users to integrate algorithms with the e-Infrastructure. These i... Gianpaolo Coro

Aug 25, 2017

03:33 PM Task #9323 (In Progress): Move some hadoop workers from the old cluster to the HDP one

workers node[6:13].t.hadoop.research-infrastructures.eu have been decommissioned.
I'm going to rename and reinstall ... Andrea Dell'Amico

Aug 23, 2017

01:28 PM Task #9532 (Closed): workspace: lots of rows into the datastore_datastore postgresql tables

I was told that the datastore was not used, but I see that the datastore table lists thousand of rows:
~~~
# se... Andrea Dell'Amico

Aug 22, 2017

04:05 PM Incident #9531 (Closed): Shared disk between Portal cluster nodes not responding - file system problem?

The NFS server stopped working, now it's running again.
Investigating.
Andrea Dell'Amico

03:59 PM Incident #9531 (Closed): Shared disk between Portal cluster nodes not responding - file system problem?

Something is wrong with the file system of the 2 nodes of the cluster, as a result the portal do not show any image o... Massimiliano Assante

Aug 21, 2017

05:34 PM Task #9526 (Closed): Enable Postgres DB "survey-db" on postgresql-srv.d4science.org to be contacted by EDISON Portal instance

Done. Andrea Dell'Amico

05:22 PM Task #9526 (In Progress): Enable Postgres DB "survey-db" on postgresql-srv.d4science.org to be contacted by EDISON Portal instance

Andrea Dell'Amico

04:53 PM Task #9526 (Closed): Enable Postgres DB "survey-db" on postgresql-srv.d4science.org to be contacted by EDISON Portal instance

The EDISON production instance has an IP address 194.149.136.227
it should be able to contact the DB survey-db > p... Massimiliano Assante

03:38 PM Task #9525 (Closed): Enable D4Science ElasticSearch cluster to be contacted by EDISON Portal instance

Done. Andrea Dell'Amico

03:23 PM Task #9525 (In Progress): Enable D4Science ElasticSearch cluster to be contacted by EDISON Portal instance

Andrea Dell'Amico

03:22 PM Task #9525 (Closed): Enable D4Science ElasticSearch cluster to be contacted by EDISON Portal instance

Andrea Dell'Amico

03:18 PM Task #9525 (In Progress): Enable D4Science ElasticSearch cluster to be contacted by EDISON Portal instance

Andrea Dell'Amico

02:28 PM Task #9525 (Closed): Enable D4Science ElasticSearch cluster to be contacted by EDISON Portal instance

The production instance has an IP address 194.149.136.227 (datasciencepro.eu) Massimiliano Assante

03:29 PM Task #9524 (Closed): Enable D4Science Cassandra cluster to be contacted by EDISON Portal instance

Done.
Andrea Dell'Amico

02:27 PM Task #9524 (Closed): Enable D4Science Cassandra cluster to be contacted by EDISON Portal instance

The production portal instance has an IP address 194.149.136.227 (datasciencepro.eu)
Massimiliano Assante

03:24 PM Task #9523 (Closed): EDISON Portal instance IP to be authorised on Production Infrastructure

Andrea Dell'Amico

01:11 PM Task #9523 (Closed): EDISON Portal instance IP to be authorised on Production Infrastructure

As reported by @boro.jakimovski@finki.ukim.mk the EDISON Portal production instance has an IP address 194.149.136.227... Massimiliano Assante

01:20 PM Incident #9522 (Closed): Authorisation service not working in DEV

There was more than one problem:
* The auth service failed to authenticate against postgresql (certificate problem... Andrea Dell'Amico

12:41 PM Incident #9522 (Closed): Authorisation service not working in DEV

it seems the Authorisation service not working in the development infrastructure
~~~
2017-08-21 10:40:05,799 ERR... Massimiliano Assante

01:11 PM Task #9203 (In Progress): Enable access for production EDISON Portal instance

Massimiliano Assante

Aug 18, 2017

07:55 PM Incident #9520 (Closed): Impossible to connect to Sardara DB

Tommaso Piccioli

07:15 PM Incident #9520 (In Progress): Impossible to connect to Sardara DB

Sorry, still problems with the host, I was already working on it, will start again in minutes. Tommaso Piccioli

06:51 PM Incident #9520: Impossible to connect to Sardara DB

Thanks. However, it crashed again. I think it is due to a query that I execute. Can you fix it again? And i will avoi... Paul Taconet

06:05 PM Incident #9520 (Closed): Impossible to connect to Sardara DB

There was a problem with the server, now it works. Tommaso Piccioli

05:17 PM Incident #9520 (Closed): Impossible to connect to Sardara DB

When I try to connect to Sardara PostgreSQL DB I get the following error:
Error in postgresqlNewConnection(drv, ..... Paul Taconet

Aug 16, 2017

05:58 PM Incident #9519 (Closed): Problem with my R studio on Tuna Atlas VRE

Paul Taconet

05:57 PM Incident #9519: Problem with my R studio on Tuna Atlas VRE

It is working again, thanks
Paul Paul Taconet

02:01 PM Incident #9519: Problem with my R studio on Tuna Atlas VRE

Ok, now it seems to work.
Let me make some tries and if it is ok, I close the ticket Paul Taconet

01:59 PM Incident #9519: Problem with my R studio on Tuna Atlas VRE

It is still not working. I get the enclosed error Paul Taconet

01:45 PM Incident #9519 (In Progress): Problem with my R studio on Tuna Atlas VRE

Paul Taconet wrote:
> What do you mean by 'server'?
Never mind, I was checking in the wrong place. I removed you ... Andrea Dell'Amico

01:26 PM Incident #9519: Problem with my R studio on Tuna Atlas VRE

What do you mean by 'server'? Paul Taconet

01:23 PM Incident #9519: Problem with my R studio on Tuna Atlas VRE

Do you know what server you were connected to?
Andrea Dell'Amico

01:09 PM Incident #9519 (Closed): Problem with my R studio on Tuna Atlas VRE

Hi,
My Rstudio session on the FAO Tuna Atlas VRE is not working anymore. I guess it is because of a process that I h... Paul Taconet

Aug 13, 2017

03:54 PM Task #9368: JackRabbit Repo cluster over Postgres for development infra

I've added a wiki page with the steps needed to add/remove a node to/from the cluster, here: https://support.d4scienc... Andrea Dell'Amico

03:25 PM Task #6308: Migrate production infrastructure nodes to Java 8

Also the geonetwork servers run with Java7, it's an old version that do not work with java 8. Andrea Dell'Amico

Aug 12, 2017

07:05 PM Task #9498 (Closed): Add cronjob for restarting the registry service in preproduction environment

Done. Andrea Dell'Amico

05:17 PM Task #9477 (Feedback): Create new Postgres Database

Andrea Dell'Amico

04:52 PM Task #9477 (In Progress): Create new Postgres Database

Andrea Dell'Amico

04:40 PM Task #9512 (Closed): geonetwork 2.6 is not compatible with Java 8

I configured the ansible playbooks to use openjdk 7 on all the production geonetworks.
Andrea Dell'Amico

04:14 PM Task #9512 (Closed): geonetwork 2.6 is not compatible with Java 8

The latest supported is Java 7.
Andrea Dell'Amico

Aug 11, 2017

12:56 PM Task #9356: Jackrabbit configuration files needed to complete the provisioning

We can close it, if you can confirm that no manual change to the configuration files was needed.
The operations need... Andrea Dell'Amico

11:44 AM Incident #9510: last backup of the table metadata.metadata of Sardara database

OK, I was extracting the August 10th early backup right now.
We have (almost) daily backups of the database, but w... Andrea Dell'Amico

11:40 AM Incident #9510 (Closed): last backup of the table metadata.metadata of Sardara database

I have manually fixed the problem with the help of my colleagues
I therefore close the issue.
Paul Paul Taconet

Aug 10, 2017

04:12 PM Incident #9510 (Closed): last backup of the table metadata.metadata of Sardara database

I have made a wrong 'UPDATE' query on the Sardara database and I have lost some data.
Would it be possible to get ... Paul Taconet