D4science

Jun 07, 2017

07:32 PM D4Science Infrastructure Task #8750 (In Progress): Create Accounting Service Cluster

Andrea Dell'Amico

07:31 PM D4Science Infrastructure Task #8749 (In Progress): Create Resource Registry Cluster

Andrea Dell'Amico

07:26 PM D4Science Infrastructure Task #8752: HA Proxy Instance for accounting service

We're going to use the infra load balancer for this service. It has plenty of resources and it's in HA.
Andrea Dell'Amico

07:26 PM D4Science Infrastructure Task #8751: HA Proxy Instance for resource registry service

We're going to use the infra load balancer for this service. It has plenty of resources and it's in HA.
Andrea Dell'Amico

06:29 PM D4Science Infrastructure VM Creation #8855 (Feedback): Create a clone of CKAN instance for BB

The VM has been configured. The scopes are:
~~~
/d4science.research-infrastructures.eu/gCubeApps
/d4science.rese... Andrea Dell'Amico

06:27 PM D4Science Infrastructure VM Creation #8854 (Feedback): Create a clone of CKAN instance for SBD

The instance has beed configured.
Note that I added the three scopes that are present on ckan-sobigdata.d4science.or... Andrea Dell'Amico

Jun 05, 2017

03:39 PM D4Science Infrastructure Task #8735 (Feedback): create a new database in the postgresql dev cluster

Andrea Dell'Amico

Jun 02, 2017

03:31 PM D4Science Infrastructure Task #8103 (Closed): a nagios script must be scheduled every 24 h to add a list of resources to all scopes

Done. The check goes to CRITICAL if the `/home/gcube/missing_resources/identifiers` file contains anything different ... Andrea Dell'Amico

May 18, 2017

05:22 PM D4Science Infrastructure Task #8679: New Python Packages Installation on DataMiners

Do you know the exact packages name? scipy and numpy are already installed on all dataminers, but there are no packag... Andrea Dell'Amico

May 17, 2017

07:20 PM D4Science Infrastructure Task #8674: Tuna Atlas GeoServer - OpenLayers preview doesn't work under https

@tommaso.piccioli@isti.cnr.it if there is no geoserver configuration to force it using https internally, it's possibl... Andrea Dell'Amico

07:05 PM D4Science Infrastructure Task #8673 (Closed): Reconfigure the authorization clients in dev to use https://auth-d.dev.d4science.org/ as the URL for the authentication service

So that the traffic goes over https and we can get rid of the old hostname node7.d.d4science.research-infrastructures... Andrea Dell'Amico

06:53 PM D4Science Infrastructure VM Creation #8561: Move authorization service instance on a new VM called auth-dev.d4science.org

I just moved the hostname node7.d.d4science.research-infrastructures.eu as alias of auth-d.dev.d4science.org Andrea Dell'Amico

06:52 PM D4Science Infrastructure VM Creation #8563: Move tabulardata service instance on a new VM called tabulardata-devnext.d4science.org

I shut down the tabulardata service on the old VM Andrea Dell'Amico

06:47 PM D4Science Infrastructure Task #8564: Move tabulardata databases hosted on node7.d to postgresql-srv-dev

For the time being, because the hostname node7.d.d4science.research-infrastructures.eu needs to be moved as alias of ... Andrea Dell'Amico

06:43 PM D4Science Infrastructure Support #8498 (Closed): Adding SSH keys to RPrototypingLab VRE

OK, I guess we will need a new call to fix the production environment details.
Andrea Dell'Amico

06:42 PM D4Science Infrastructure VM Creation #8472 (Closed): New VM dataminer needed

Andrea Dell'Amico

06:32 PM D4Science Infrastructure Task #8645: Please provide Access to gCube SVN to CLS

@massimiliano.assante@isti.cnr.it we talked about two new VREs, some days ago: gcube-developers and dnet-developers (... Andrea Dell'Amico

04:33 PM D4Science Infrastructure Task #8645 (Feedback): Please provide Access to gCube SVN to CLS

Done. They just need to complete their registration on manage.research-infrastructures.eu.
Andrea Dell'Amico

04:31 PM D4Science Infrastructure Task #8645 (In Progress): Please provide Access to gCube SVN to CLS

Andrea Dell'Amico

03:45 PM D4Science Infrastructure Support #8596: Install Knime on DataMiner machines

A couple of questions:
1. did you need the basic o full version?
2. do we will need to install it on the other dat... Andrea Dell'Amico

May 16, 2017

06:35 PM D4Science Infrastructure Task #8564: Move tabulardata databases hosted on node7.d to postgresql-srv-dev

@tommaso.piccioli@isti.cnr.it it seems that the old tabulardata database is more than 100GB in size. We need to sligh... Andrea Dell'Amico

12:06 PM D4Science Infrastructure Task #8564 (In Progress): Move tabulardata databases hosted on node7.d to postgresql-srv-dev

Lucio already changed the service endpoints.
@lucio.lelii@isti.cnr.it an import of the old databases is needed? Andrea Dell'Amico

04:17 PM D4Science Infrastructure Support #8596: Install Knime on DataMiner machines

I changed the script so that it runs without leaving the directory from where it's called.
Andrea Dell'Amico

01:30 PM D4Science Infrastructure Support #8596: Install Knime on DataMiner machines

I can confirm that it works on linux too.
On dataminer1-devnext.d4science.org I created the script `/usr/local/bin... Andrea Dell'Amico

12:50 PM D4Science Infrastructure Support #8596 (Feedback): Install Knime on DataMiner machines

I downloaded and tried to run it on dataminer1-devnext.d4science.org but it always requires a graphical display. It c... Andrea Dell'Amico

03:28 PM D4Science Infrastructure VM Creation #8561 (Feedback): Move authorization service instance on a new VM called auth-dev.d4science.org

The service is up. The database configuration is the same as we have on the running dev authorization service.
The... Andrea Dell'Amico

01:33 PM D4Science Infrastructure VM Creation #8561: Move authorization service instance on a new VM called auth-dev.d4science.org

auth-d.dev.d4science.org 146.48.123.127
Andrea Dell'Amico

01:00 PM D4Science Infrastructure VM Creation #8561 (In Progress): Move authorization service instance on a new VM called auth-dev.d4science.org

Andrea Dell'Amico

02:29 PM D4Science Infrastructure Task #8622 (Feedback): Install a newer version of pgpool2 to fix the shutdown problem when the network goes away

pgpool2 3.6.2 is running on both the dev instances (note: different versions cannot be run together). No configuratio... Andrea Dell'Amico

02:12 PM D4Science Infrastructure Task #8622 (In Progress): Install a newer version of pgpool2 to fix the shutdown problem when the network goes away

Andrea Dell'Amico

02:11 PM D4Science Infrastructure Task #8622 (Closed): Install a newer version of pgpool2 to fix the shutdown problem when the network goes away

See #8617, we don't want that a network failure causes a shutdown of the pgpool server Andrea Dell'Amico

02:08 PM D4Science Infrastructure Incident #8617 (Closed): both pgpool2 instances stopped themselves

The service was manually restarted.
The behaviour we have experienced seems to be a bug of our running version tha... Andrea Dell'Amico

02:03 PM D4Science Infrastructure Incident #8617 (Closed): both pgpool2 instances stopped themselves

After a local network failure, both the pgpool2 instances failed because they thought they were disconnected from the... Andrea Dell'Amico

12:18 PM D4Science Infrastructure Task #8613 (Feedback): Porting data-d.d4science.org and its applications to JAVA 8

Done. tomcat is running against java 8.
Andrea Dell'Amico

12:12 PM D4Science Infrastructure Task #8613 (In Progress): Porting data-d.d4science.org and its applications to JAVA 8

Andrea Dell'Amico

12:04 PM D4Science Infrastructure VM Creation #8563 (Feedback): Move tabulardata service instance on a new VM called tabulardata-devnext.d4science.org

The VM is up and running. Available on both http and https.
Andrea Dell'Amico

11:44 AM D4Science Infrastructure VM Creation #8563 (In Progress): Move tabulardata service instance on a new VM called tabulardata-devnext.d4science.org

Andrea Dell'Amico

11:20 AM D4Science Infrastructure VM Creation #8563: Move tabulardata service instance on a new VM called tabulardata-devnext.d4science.org

The instance will use the database already defined on `postgresql-srv-dev.d4science.org`
Andrea Dell'Amico

11:39 AM D4Science Infrastructure Support #8498: Adding SSH keys to RPrototypingLab VRE

Done.
Andrea Dell'Amico

May 15, 2017

06:55 PM D4Science Infrastructure Task #8363: We need a new dataminer distribution to build the EGI image

A note for @nunzioandrea.galante@eng.it: the contextualization script need to manage a new variable: `AUTHORIZE_CHILD... Andrea Dell'Amico

06:40 PM D4Science Infrastructure VM Creation #8563: Move tabulardata service instance on a new VM called tabulardata-devnext.d4science.org

Andrea Dell'Amico wrote:
> I've just seen that on postgresql-srv-dev.d4science.org two databases named tabulardata... Andrea Dell'Amico

06:36 PM D4Science Infrastructure VM Creation #8563: Move tabulardata service instance on a new VM called tabulardata-devnext.d4science.org

@roberto.cirillo@isti.cnr.it can you provide the missing information?
I've just seen that on postgresql-srv-dev.d4... Andrea Dell'Amico

06:28 PM D4Science Infrastructure VM Creation #8563: Move tabulardata service instance on a new VM called tabulardata-devnext.d4science.org

tabulardata-devnext-d.dev.d4science.org. 146.48.123.126 Andrea Dell'Amico

12:48 PM D4Science Infrastructure Task #7577 (Closed): A new dataminer distribution is needed

We used the zip file to build the egi image. Andrea Dell'Amico

May 12, 2017

06:58 PM D4Science Infrastructure Support #8498 (Feedback): Adding SSH keys to RPrototypingLab VRE

Andrea Dell'Amico

06:57 PM D4Science Infrastructure Support #8498: Adding SSH keys to RPrototypingLab VRE

gcube@node2-d-d4s.d4science.org -> root@dataminer1-devnext.d4science.org, done. Andrea Dell'Amico

04:50 PM D4Science Infrastructure Support #8498: Adding SSH keys to RPrototypingLab VRE

There will be no preprod deployment for the service for the time being, btw.
Andrea Dell'Amico

02:38 PM D4Science Infrastructure Support #8498: Adding SSH keys to RPrototypingLab VRE

node65.d4science.org -> dataminer-proto-ghost.d4science.org
Andrea Dell'Amico

06:21 PM D4Science Infrastructure Incident #8474 (Closed): Move the databases hosted on statistical-manager.d.d4science.org to postgresql-srv-dev.d4science.org

databases moved, I shut down statistical-manager.d.d4science.org again.
Andrea Dell'Amico

05:24 PM D4Science Infrastructure Task #8555: Please provide more resource to Redmine

Yes, it's slow. The first move will be to move the database on a different server. We are going to build a dedicate p... Andrea Dell'Amico

05:17 PM D4Science Infrastructure Task #8553 (Closed): Please provide me ssh access to orientdb production cluster

You already have access as both root and orientdb.
Andrea Dell'Amico

05:14 PM D4Science Infrastructure Task #8553 (In Progress): Please provide me ssh access to orientdb production cluster

Andrea Dell'Amico

04:52 PM D4Science Infrastructure Task #8363: We need a new dataminer distribution to build the EGI image

The EGI image is ready to be tested.
@fabio.sinibaldi@isti.cnr.it you can find it on egi-images.d4science.org, the f... Andrea Dell'Amico

04:49 PM D4Science Infrastructure Task #8442: Authorization Service to update : auth@node7.d.d4science.research-infrastructures.eu

I spoke to @lucio.lelii@isti.cnr.it that agrees too. He's asking to maintain node7.d.d4science.research-infrastructur... Andrea Dell'Amico

12:21 PM D4Science Infrastructure Task #8442: Authorization Service to update : auth@node7.d.d4science.research-infrastructures.eu

Pasquale Pagano wrote:
> Andrea Dell'Amico wrote:
> > node7.d.d4science.research-infrastructures.eu is running ubun... Andrea Dell'Amico

02:28 PM D4Science Infrastructure VM Creation #8472 (Feedback): New VM dataminer needed

The VM is online. smartgears has been configured with
~~~
<container mode='offline'>
~~~
node65.d4science.org... Andrea Dell'Amico

12:26 PM D4Science Infrastructure Task #8103: a nagios script must be scheduled every 24 h to add a list of resources to all scopes

Pasquale Pagano wrote:
> This activity was urgent one month ago. Please try to complete it asap.
As soon as the p... Andrea Dell'Amico

12:19 PM D4Science Infrastructure Support #8489 (Feedback): Issues memory (R Studio )

I cleaned up a couple of old sessions, the servers have resources available. There's only one active session right no... Andrea Dell'Amico

May 11, 2017

08:39 PM D4Science Infrastructure Support #8489: Issues memory (R Studio )

Can you point me to the rstudio instance? I didn't nee any stale process, so maybe we need to investigate more.
Andrea Dell'Amico

08:15 PM D4Science Infrastructure VM Creation #8486 (Feedback): Provide a new SmartGears node for resource-checker plugin

The VM has been configured. I see exceptions in the ghn.log file but I don't know what's wrong:
~~~
20:09:31.476 ... Andrea Dell'Amico

07:44 PM D4Science Infrastructure VM Creation #8486 (In Progress): Provide a new SmartGears node for resource-checker plugin

resource-checker.d4science.org 146.48.123.124 Andrea Dell'Amico

07:44 PM D4Science Infrastructure VM Creation #8472 (In Progress): New VM dataminer needed

dataminer-proto-ghost.d4science.org 146.48.123.125 Andrea Dell'Amico

07:31 PM D4Science Infrastructure VM Creation #8316 (Closed): new VM for sharelatex in dev

Andrea Dell'Amico

07:20 PM D4Science Infrastructure Task #8426 (Feedback): Dataminer service to test : dataminer2-d-d4s.d4science.org

Tomcat is running with java 8.
Andrea Dell'Amico

07:19 PM D4Science Infrastructure Task #8426 (In Progress): Dataminer service to test : dataminer2-d-d4s.d4science.org

Andrea Dell'Amico

07:19 PM D4Science Infrastructure Task #8424 (Feedback): Dataminer service to test : dataminer1-d-d4s.d4science.org.

tomcat is running with java 8.
Andrea Dell'Amico

07:14 PM D4Science Infrastructure Task #8424 (In Progress): Dataminer service to test : dataminer1-d-d4s.d4science.org.

Andrea Dell'Amico

07:11 PM D4Science Infrastructure Task #8439 (Feedback): ckan-connector to test : ckan-d-d4s.d4science.org

Done. Andrea Dell'Amico

07:08 PM D4Science Infrastructure Task #8439 (In Progress): ckan-connector to test : ckan-d-d4s.d4science.org

Andrea Dell'Amico

07:08 PM D4Science Infrastructure Task #8435: tabular-data-manager service to update : gcube@node7.d.d4science.research-infrastructures.eu

Same as #8442 Andrea Dell'Amico

07:04 PM D4Science Infrastructure Task #8442: Authorization Service to update : auth@node7.d.d4science.research-infrastructures.eu

node7.d.d4science.research-infrastructures.eu is running ubuntu 12.04 so we cannot just install java 8: we need Ubunt... Andrea Dell'Amico

06:57 PM D4Science Infrastructure Task #8443: Home Library Webapp to test : node11.d.d4science.research-infrastructures.eu

This one is also manually provisioned. java8 is the default already, the smartgears configuration needs to be modifie... Andrea Dell'Amico

06:51 PM D4Science Infrastructure Task #8444 (Feedback): sdi-service to test : sdi-d-d4s.d4science.org

Tomcat is now running with java8.
Andrea Dell'Amico

06:50 PM D4Science Infrastructure Task #8444 (In Progress): sdi-service to test : sdi-d-d4s.d4science.org

Andrea Dell'Amico

06:43 PM D4Science Infrastructure Task #8445: FHNManager Service to test : node2-d-d4s.d4science.org

Same as #8446 Andrea Dell'Amico

06:40 PM D4Science Infrastructure Task #8446: DataManager Pool Manager Service to test : node2-d-d4s.d4science.org

In this VM smartgears was manually installed, it's running the bundle.
That's against our policies, I'm not touchin... Andrea Dell'Amico

06:36 PM D4Science Infrastructure Support #8498 (In Progress): Adding SSH keys to RPrototypingLab VRE

Sorry, you are supposed to reach the new to be created dataminer host in production, and a dev dataminer for the deve... Andrea Dell'Amico

06:18 PM D4Science Infrastructure Support #8498 (Feedback): Adding SSH keys to RPrototypingLab VRE

Done. Andrea Dell'Amico

06:12 PM D4Science Infrastructure Support #8498: Adding SSH keys to RPrototypingLab VRE

from gcube@node2-d-d4s.d4science.org to root@dataminer[0:1]-proto.d4science.org. Is it correct?
Andrea Dell'Amico

04:46 PM D4Science Infrastructure Task #8493 (Closed): Increment the number of max connections to the infra postgresql server

Raised to 256.
Andrea Dell'Amico

04:41 PM D4Science Infrastructure Task #8493 (In Progress): Increment the number of max connections to the infra postgresql server

Andrea Dell'Amico

04:41 PM D4Science Infrastructure Task #8493 (Closed): Increment the number of max connections to the infra postgresql server

We almost reached the limit, today:
~~~
***** Nagios *****
Notification Type: PROBLEM
Service: Postgresql bac... Andrea Dell'Amico

May 10, 2017

07:12 PM D4Science Infrastructure VM Creation #8473: Please create a machine as copy of #7877

I had to temporarily disable the http -> https redirection because we do not have a valid certificate yet. I'll add i... Andrea Dell'Amico

06:26 PM D4Science Infrastructure Task #8345 (Closed): Dismiss the statistical manager servers

I'm closing this one. Let's open a different ticket when we will be able to kill activemq.
Andrea Dell'Amico

05:48 PM D4Science Infrastructure Incident #8474 (Feedback): Move the databases hosted on statistical-manager.d.d4science.org to postgresql-srv-dev.d4science.org

Andrea Dell'Amico

05:47 PM D4Science Infrastructure Incident #8474 (In Progress): Move the databases hosted on statistical-manager.d.d4science.org to postgresql-srv-dev.d4science.org

I just created the testdb and dataSpace databases on postgresql-srv-dev.d4science.org.
username and password did n... Andrea Dell'Amico

02:46 PM D4Science Infrastructure Incident #8474 (Closed): Move the databases hosted on statistical-manager.d.d4science.org to postgresql-srv-dev.d4science.org

testdb and dataSpace are still in use
devDataSpace, sm_dataspace_devnext, sm_operation_devnext probably not. We st... Andrea Dell'Amico

04:40 PM D4Science Infrastructure VM Creation #8472: New VM dataminer needed

Please, change the tracker type to `VM creation` and fill the required fields. Andrea Dell'Amico

03:35 PM D4Science Infrastructure Support #8354: Sardara Database - extend maximum characters in labels

Massimiliano Assante wrote:
> Well, i don't think that one should know the sardara DB schema to do the job. If I un... Andrea Dell'Amico

01:48 PM D4Science Infrastructure Task #8363: We need a new dataminer distribution to build the EGI image

That would be awesome. If the automati jar reloading works, work on https://support.d4science.org/issues/8034 will no... Andrea Dell'Amico

May 09, 2017

07:04 PM D4Science Infrastructure Task #8363: We need a new dataminer distribution to build the EGI image

The war distribution does not contain the algorithms, that must be downloaded separately.
Problem is, dataminer sear... Andrea Dell'Amico

05:33 PM D4Science Infrastructure Task #8466 (Closed): Give the possibility to install smartgears from the staging repository and the related apps from the snapshots one

I did it this way:
~~~
gcube_repository: 'gcube-staging'
smartgears_gcube_repository: '{{ gcube_repository }}'
... Andrea Dell'Amico

05:20 PM D4Science Infrastructure Task #8466 (Closed): Give the possibility to install smartgears from the staging repository and the related apps from the snapshots one

Right now we use a single variable through all the ansible playbooks, `gcube_repository`.
This is not sufficient a... Andrea Dell'Amico

04:56 PM D4Science Infrastructure VM Creation #8266 (Feedback): VM Creation for Tuna Atlas dedicated GeoNetwork

The installation should be complete, can you verify?
The geonetwork servce is availale at http://geonetwork1-tunaatl... Andrea Dell'Amico