D4science

Sep 05, 2017

06:03 PM D4Science Infrastructure Task #9582 (In Progress): Thredds on smartgears: it's needed to complete the provisioning

A new role that installs thredds is here: library/roles/thredds
It has been installed on thredds-d-d4s.d4science.org Andrea Dell'Amico

12:40 PM D4Science Infrastructure Task #9576 (Feedback): provision the smartgear logback configuration starting from a template

The new logback configuration has been installed on dataminer1-pre.d4science.org. @roberto.cirillo@isti.cnr.it @lucio... Andrea Dell'Amico

11:49 AM D4Science Infrastructure Task #9576: provision the smartgear logback configuration starting from a template

@lucio.lelii@isti.cnr.it smartgear comes with logback 1.0.13 and it's too old to support the new rolling appender. We... Andrea Dell'Amico

Sep 04, 2017

08:01 PM D4Science Infrastructure Task #9576: provision the smartgear logback configuration starting from a template

I have a prototype that uses the new rolling policy and also sets a global cap.
The log files will be moved into t... Andrea Dell'Amico

07:49 PM D4Science Infrastructure Task #9576 (In Progress): provision the smartgear logback configuration starting from a template

Andrea Dell'Amico

05:49 PM D4Science Infrastructure Task #9104: data.d4science: remove rootLogger inside webapps

I forgot to tell you that you need to set the variable:
~~~
tomcat_install_the_log4j_properties: False
~~~
Ot... Andrea Dell'Amico

04:57 PM D4Science Infrastructure VM Creation #8990: new instance of FusionRegistry in production

I wrote down the steps required to actually activate FusionSecurity inside FusionRegistry here: https://support.d4sci... Andrea Dell'Amico

01:27 PM D4Science Infrastructure VM Creation #8990: new instance of FusionRegistry in production

Giancarlo Panichi wrote:
> The only configuration that was made is on FusionSecurity where I added the user tabulard... Andrea Dell'Amico

04:42 PM D4Science Infrastructure Task #9585: FusionRegistry - Update data in new FusionRegistry 8.4.15 in prod

I see that FusionRegistry also supports postgresql. Isn't there a way to migrate the contents to postgresql? We have ... Andrea Dell'Amico

Sep 02, 2017

05:29 PM D4Science Infrastructure Task #9576: provision the smartgear logback configuration starting from a template

Since logback 1.1.7 there's an appender called `SizeAndTimeBasedRollingPolicy` that does exactly what I'm asking. A r... Andrea Dell'Amico

05:27 PM D4Science Infrastructure Task #9576: provision the smartgear logback configuration starting from a template

Last: if a size based rolling appender can be configured, this would be very helpful to keep the total log size under... Andrea Dell'Amico

05:26 PM D4Science Infrastructure Task #9576: provision the smartgear logback configuration starting from a template

Another parameter that can be configured is `maxHistory`: 30 days is usually too much.
Andrea Dell'Amico

05:24 PM D4Science Infrastructure Task #9576: provision the smartgear logback configuration starting from a template

Also, add the following configuration on the dataminers (the log path will change):
~~~
<appender name="ANALYSIS"... Andrea Dell'Amico

05:23 PM D4Science Infrastructure Task #9576 (Closed): provision the smartgear logback configuration starting from a template

The in place xml editing is not reliable, and it's impossible to include or exclude chunks of configuration settings.... Andrea Dell'Amico

02:17 PM D4Science Infrastructure VM Creation #9301 (Closed): VM creation for GeoNetwork connector development

Andrea Dell'Amico

02:14 PM D4Science Infrastructure VM Creation #8990 (Feedback): new instance of FusionRegistry in production

@g.panichi@isti.cnr.it any news about it? Andrea Dell'Amico

02:08 PM D4Science Infrastructure VM Creation #7465 (Closed): Please Create a VM to install SmartExecutor for SmartArea

Andrea Dell'Amico

Sep 01, 2017

01:24 PM D4Science Infrastructure VM Creation #9354 (Closed): VM Creation for AquacultureAtlasGeneration dedicated GeoNetwork

I guess we can close this one, the DB management is a matter of #9511 Andrea Dell'Amico

01:10 PM D4Science Infrastructure Task #9551: Some jobs wrote big chunks of data into the persistence jackrabbit table

@valentina.marioli@isti.cnr.it just asked to restore those backups. You can find them on workspace-repository-prod1.d... Andrea Dell'Amico

12:15 PM D4Science Infrastructure Task #9551: Some jobs wrote big chunks of data into the persistence jackrabbit table

Gianpaolo Coro wrote:
> When a computation fails, a gCube Item is created having a stacktrace attached. In the case ... Andrea Dell'Amico

12:09 PM D4Science Infrastructure Task #9551: Some jobs wrote big chunks of data into the persistence jackrabbit table

I also uploaded a blob of something that seems an execution log, with failures: https://goo.gl/VNmpeJ
Andrea Dell'Amico

Aug 31, 2017

11:28 AM D4Science Infrastructure Task #9543 (Closed): Add a TODO plugin to redmine

Also installed in production. Andrea Dell'Amico

Aug 30, 2017

11:32 PM D4Science Infrastructure Task #9551 (In Progress): Some jobs wrote big chunks of data into the persistence jackrabbit table

From Aug 19th and 21th something (someone) wrote repeatedly into the workspace big chunks of data into the persistenc... Andrea Dell'Amico

Aug 29, 2017

08:03 PM D4Science Infrastructure Task #9543 (In Progress): Add a TODO plugin to redmine

The plugin is available on the dev instance: https://redmine-d.d4science.org
It is active on the D4Science Infrastru... Andrea Dell'Amico

05:39 PM D4Science Infrastructure Task #9543 (Closed): Add a TODO plugin to redmine

A *TODO list* plugin could be useful to some users. A candidate is https://redmine.org/plugins/redmine_issue_todo_lis... Andrea Dell'Amico

Aug 28, 2017

06:27 PM D4Science Infrastructure Task #9323 (Closed): Move some hadoop workers from the old cluster to the HDP one

The new nodes have been named worker[4:11]-hadoop.d4science.org. They are now part of the HDP cluster.
Andrea Dell'Amico

Aug 25, 2017

03:33 PM D4Science Infrastructure Task #9323 (In Progress): Move some hadoop workers from the old cluster to the HDP one

workers node[6:13].t.hadoop.research-infrastructures.eu have been decommissioned.
I'm going to rename and reinstall ... Andrea Dell'Amico

Aug 23, 2017

01:28 PM D4Science Infrastructure Task #9532 (Closed): workspace: lots of rows into the datastore_datastore postgresql tables

I was told that the datastore was not used, but I see that the datastore table lists thousand of rows:
~~~
# se... Andrea Dell'Amico

Aug 22, 2017

04:05 PM D4Science Infrastructure Incident #9531 (Closed): Shared disk between Portal cluster nodes not responding - file system problem?

The NFS server stopped working, now it's running again.
Investigating.
Andrea Dell'Amico

Aug 21, 2017

05:34 PM D4Science Infrastructure Task #9526 (Closed): Enable Postgres DB "survey-db" on postgresql-srv.d4science.org to be contacted by EDISON Portal instance

Done. Andrea Dell'Amico

05:22 PM D4Science Infrastructure Task #9526 (In Progress): Enable Postgres DB "survey-db" on postgresql-srv.d4science.org to be contacted by EDISON Portal instance

Andrea Dell'Amico

03:38 PM D4Science Infrastructure Task #9525 (Closed): Enable D4Science ElasticSearch cluster to be contacted by EDISON Portal instance

Done. Andrea Dell'Amico

03:23 PM D4Science Infrastructure Task #9525 (In Progress): Enable D4Science ElasticSearch cluster to be contacted by EDISON Portal instance

Andrea Dell'Amico

03:22 PM D4Science Infrastructure Task #9525 (Closed): Enable D4Science ElasticSearch cluster to be contacted by EDISON Portal instance

Andrea Dell'Amico

03:18 PM D4Science Infrastructure Task #9525 (In Progress): Enable D4Science ElasticSearch cluster to be contacted by EDISON Portal instance

Andrea Dell'Amico

03:29 PM D4Science Infrastructure Task #9524 (Closed): Enable D4Science Cassandra cluster to be contacted by EDISON Portal instance

Done.
Andrea Dell'Amico

03:24 PM D4Science Infrastructure Task #9523 (Closed): EDISON Portal instance IP to be authorised on Production Infrastructure

Andrea Dell'Amico

01:20 PM D4Science Infrastructure Incident #9522 (Closed): Authorisation service not working in DEV

There was more than one problem:
* The auth service failed to authenticate against postgresql (certificate problem... Andrea Dell'Amico

Aug 16, 2017

01:45 PM D4Science Infrastructure Incident #9519 (In Progress): Problem with my R studio on Tuna Atlas VRE

Paul Taconet wrote:
> What do you mean by 'server'?
Never mind, I was checking in the wrong place. I removed you ... Andrea Dell'Amico

01:23 PM D4Science Infrastructure Incident #9519: Problem with my R studio on Tuna Atlas VRE

Do you know what server you were connected to?
Andrea Dell'Amico

Aug 13, 2017

03:54 PM D4Science Infrastructure Task #9368: JackRabbit Repo cluster over Postgres for development infra

I've added a wiki page with the steps needed to add/remove a node to/from the cluster, here: https://support.d4scienc... Andrea Dell'Amico

03:25 PM D4Science Infrastructure Task #6308: Migrate production infrastructure nodes to Java 8

Also the geonetwork servers run with Java7, it's an old version that do not work with java 8. Andrea Dell'Amico

Aug 12, 2017

07:05 PM D4Science Infrastructure Task #9498 (Closed): Add cronjob for restarting the registry service in preproduction environment

Done. Andrea Dell'Amico

05:17 PM D4Science Infrastructure Task #9477 (Feedback): Create new Postgres Database

Andrea Dell'Amico

04:52 PM D4Science Infrastructure Task #9477 (In Progress): Create new Postgres Database

Andrea Dell'Amico

04:40 PM D4Science Infrastructure Task #9512 (Closed): geonetwork 2.6 is not compatible with Java 8

I configured the ansible playbooks to use openjdk 7 on all the production geonetworks.
Andrea Dell'Amico

04:14 PM D4Science Infrastructure Task #9512 (Closed): geonetwork 2.6 is not compatible with Java 8

The latest supported is Java 7.
Andrea Dell'Amico

Aug 11, 2017

12:56 PM D4Science Infrastructure Task #9356: Jackrabbit configuration files needed to complete the provisioning

We can close it, if you can confirm that no manual change to the configuration files was needed.
The operations need... Andrea Dell'Amico

11:44 AM D4Science Infrastructure Incident #9510: last backup of the table metadata.metadata of Sardara database

OK, I was extracting the August 10th early backup right now.
We have (almost) daily backups of the database, but w... Andrea Dell'Amico