D4science

Jul 02, 2018

11:53 PM D4Science Infrastructure Docker Image #12035: Please deploy a Docker container with the "out of the box" LimeSurvey community version

Never mind, it was my fault. The application is reachable. @massimiliano.assante@isti.cnr.it the docker server is cur... Andrea Dell'Amico

07:10 PM D4Science Infrastructure Docker Image #12035: Please deploy a Docker container with the "out of the box" LimeSurvey community version

Manually fixing all the redirections I am able to reach https://docker-exec1.d4science.org/limesurvey/index.php?r=ins... Andrea Dell'Amico

06:55 PM D4Science Infrastructure Docker Image #12035: Please deploy a Docker container with the "out of the box" LimeSurvey community version

I see that the variable is been passed to the container. The output of `docker container inspect limesurvey` reports
... Andrea Dell'Amico

06:42 PM D4Science Infrastructure Docker Image #12035 (In Progress): Please deploy a Docker container with the "out of the box" LimeSurvey community version

I'm trying to run the container giving it a different location, because the docker server is shared with other contai... Andrea Dell'Amico

04:44 PM D4Science Infrastructure Task #11825: Setup New gateway performfish.d4science.net

Andrea Dell'Amico wrote:
> I just added the hostname. The certificate will have to wait.
We are still unable to o... Andrea Dell'Amico

11:39 AM D4Science Infrastructure Task #11978: Add one DNS resolver in each of the GARR regions

The resolver at region `garr-ct1` has IP 192.168.100.39
The resolver at region `garr-pa1` has IP 192.168.101.68
Andrea Dell'Amico

10:38 AM D4Science Infrastructure Incident #12086 (Closed): ssk.parthenos-project.eu disappeared

The certification renewal for ssk-application.parthenos.d4science.org and ssk.parthenos-project.eu is failing becau... Andrea Dell'Amico

Jun 29, 2018

05:47 PM D4Science Infrastructure Task #11831 (In Progress): Explore new letsencrypt clients to add wildcard certificates support

I tested the procedure on preprod1.d4science.org. Our DNS configuration is working, and I've found the correct workfl... Andrea Dell'Amico

02:43 PM D4Science Infrastructure VM Creation #12053 (In Progress): Create new CKAN instance for SBD catalogue: ckan.sobigdata.d4science.net

We still need to move the hostname and the smartgears scope registration.
Andrea Dell'Amico

Jun 28, 2018

07:01 PM D4Science Infrastructure Task #11978 (In Progress): Add one DNS resolver in each of the GARR regions

The resolvers have been provisioned. Now a new resolv.conf must be deployed to the GARR VMs.
Andrea Dell'Amico

06:00 PM D4Science Infrastructure VM Creation #12053: Create new CKAN instance for SBD catalogue: ckan.sobigdata.d4science.net

The problem has been solved. Andrea Dell'Amico

02:01 PM D4Science Infrastructure VM Creation #12053: Create new CKAN instance for SBD catalogue: ckan.sobigdata.d4science.net

We've found a clash between a file that we overwrite and a newer version of that file. It's `/usr/lib/ckan/default/sr... Andrea Dell'Amico

12:35 PM D4Science Infrastructure VM Creation #12053: Create new CKAN instance for SBD catalogue: ckan.sobigdata.d4science.net

The VM has been provisioned. If the harvesting succeeds, we can switch the hostname and the smartgears scope.
Andrea Dell'Amico

12:36 PM D4Science Infrastructure VM Creation #12055 (Closed): Create SOLR instance for CKAN SBD: ckan-solr.sobigdata.d4science.net

The solr instance is up and running. Andrea Dell'Amico

12:36 PM D4Science Infrastructure VM Creation #12054 (Closed): Create DB instance for CKAN SBD: ckan-pg.sobigdata.d4science.net

The VM has been provisioned, databases created.
Andrea Dell'Amico

Jun 27, 2018

12:49 PM D4Science Infrastructure Support #12032: ip-90-147-166-112.ct1.garrservices.it: too many opened connection to node66.p.d4science

Go on. One at a time, you can restart each one.
If the connections problem persists, we can even restart all the d... Andrea Dell'Amico

Jun 26, 2018

06:08 PM D4Science Infrastructure Task #11831: Explore new letsencrypt clients to add wildcard certificates support

I'll try to use _acme-challenge.d4science.org as CNAME of _acme-challenge.d4science.net. Andrea Dell'Amico

05:44 PM D4Science Infrastructure Task #11831: Explore new letsencrypt clients to add wildcard certificates support

It seems that we can exploit a feature that do not force us to move the `d4science.org` domain before starting the au... Andrea Dell'Amico

05:17 PM D4Science Infrastructure VM Creation #12030 (Feedback): Upgrade VM with Resource Registry instance

The VM is now running smartgears version `2.2.0-4.12.0-162179` and the latest version of the resource registry.
Andrea Dell'Amico

05:08 PM D4Science Infrastructure VM Creation #12030 (In Progress): Upgrade VM with Resource Registry instance

Andrea Dell'Amico

05:01 PM D4Science Infrastructure Task #11982 (Closed): Increase RAM on ckan-grsf-admin2.d4science.org

Andrea Dell'Amico

05:00 PM D4Science Infrastructure Task #11982 (Feedback): Increase RAM on ckan-grsf-admin2.d4science.org

The VM is now running with 5GB of RAM Andrea Dell'Amico

04:59 PM D4Science Infrastructure Task #11982 (In Progress): Increase RAM on ckan-grsf-admin2.d4science.org

Andrea Dell'Amico

04:36 PM D4Science Infrastructure Task #11982: Increase RAM on ckan-grsf-admin2.d4science.org

I'm going to shutdown and start the instance right now.
Andrea Dell'Amico

02:44 PM D4Science Infrastructure Task #11982: Increase RAM on ckan-grsf-admin2.d4science.org

Right now the smartgears instance is not able to start because it cannot allocate enough RAM. Is the publication acti... Andrea Dell'Amico

03:23 PM D4Science Infrastructure VM Creation #11927: Create the new ckan instance: ckan-aginfra.d4science.org

Added the nagios monitoring. Andrea Dell'Amico

02:33 PM D4Science Infrastructure VM Creation #11927: Create the new ckan instance: ckan-aginfra.d4science.org

apache did not restart correctly last night, as often happens (we have a nagios handler that fix the problem, but thi... Andrea Dell'Amico

03:22 PM D4Science Infrastructure Support #12034: ckan-bb1.d4science.org: too many opened connections to node66.p.d4science

No. I tested it and it worked in the past, but I don't remember the specific smartgears version and the logback libra... Andrea Dell'Amico

11:52 AM D4Science Infrastructure Support #12034: ckan-bb1.d4science.org: too many opened connections to node66.p.d4science

The first line of the `logback.xml` file that automatically reload itself is:
~~~
<configuration scan="true" debu... Andrea Dell'Amico

11:35 AM D4Science Infrastructure Support #12034: ckan-bb1.d4science.org: too many opened connections to node66.p.d4science

You should ask @francesco.mangiacrapa@isti.cnr.it as I only install the CKAN nodes. The smartgears part is separate f... Andrea Dell'Amico

02:53 PM D4Science Infrastructure Incident #12043 (Rejected): ckan-grsf-admin2: more memory is needed

Duplicate of #11982, waiting for feedback from @francesco.mangiacrapa@isti.cnr.it Andrea Dell'Amico

02:19 PM D4Science Infrastructure Docker Image #12035: Please deploy a Docker container with the "out of the box" LimeSurvey community version

I was asking because nothing was specified in the request, but the container image runs a mysql instance and saves th... Andrea Dell'Amico

12:33 PM D4Science Infrastructure Docker Image #12035: Please deploy a Docker container with the "out of the box" LimeSurvey community version

Do we need any persistent storage?
Andrea Dell'Amico

11:16 AM D4Science Infrastructure Support #12032: ip-90-147-166-112.ct1.garrservices.it: too many opened connection to node66.p.d4science

It's the IP address that's used by the hosts without a public IP. So there's one (or more than one) of the private IP... Andrea Dell'Amico

Jun 25, 2018

07:09 PM D4Science Infrastructure VM Creation #11927 (Feedback): Create the new ckan instance: ckan-aginfra.d4science.org

The service is running. There are no customisations yet (and no valid x.509 certificate...)
Andrea Dell'Amico

02:09 PM D4Science Infrastructure VM Creation #11927: Create the new ckan instance: ckan-aginfra.d4science.org

Provisioning is in progress
Andrea Dell'Amico

04:13 PM D4Science Infrastructure Task #12018 (Feedback): Please update OrientDB ansible script

The download URL is unchanged, only the compression format is different. I changed the playbook and run it, version 2... Andrea Dell'Amico

04:03 PM D4Science Infrastructure Task #12018 (In Progress): Please update OrientDB ansible script

Andrea Dell'Amico

Jun 18, 2018

07:52 PM D4Science Infrastructure Task #11981 (Closed): Add a ssh shell proxy on the CT1 GARR region

We are using the dataminer load balancer as proxy, but that's not correct. Move the configuration on a dedicated VM. Andrea Dell'Amico

07:49 PM D4Science Infrastructure Task #11980 (Closed): Add the involvement filter plugin to the d4science redmine instance

The plugin is http://www.redmine.org/plugins/involvement_filter Andrea Dell'Amico

07:45 PM D4Science Infrastructure Task #11978 (Closed): Add one DNS resolver in each of the GARR regions

The GARR DNS servers sometimes time out.
Andrea Dell'Amico

07:42 PM D4Science Infrastructure Task #11976: New load balancer for the tagme service

Evaluate the rate limiting configuration to prevent the abuse of the Tagme APIs.
Andrea Dell'Amico

07:37 PM D4Science Infrastructure Task #11976 (Closed): New load balancer for the tagme service

Use a new instance to work around the certificates issue. Andrea Dell'Amico

07:39 PM D4Science Infrastructure VM Creation #11975: New TAGME instance at GARR

Enable JMX by default, and eventually enable the Prometheus JMX exporter. Andrea Dell'Amico

07:36 PM D4Science Infrastructure VM Creation #11975 (Closed): New TAGME instance at GARR

We need a bigger server, maybe behind a load balancer. Andrea Dell'Amico

07:38 PM D4Science Infrastructure Task #11977 (Closed): Make the tagme service more reliable.

* Add (bigger) instances
* Put them behind a load balancer
* Rate limit the requests on the load balancer Andrea Dell'Amico

05:30 PM D4Science Infrastructure VM Creation #11954: VM to host the GRSF-services-updater service

Do we have a way to install and configure it? we usually completely deploy and configure the services hosted here.
Andrea Dell'Amico

Jun 14, 2018

05:53 PM D4Science Infrastructure VM Creation #11927: Create the new ckan instance: ckan-aginfra.d4science.org

hostname and IP address are going to be ckan-aginfra.d4science.org 146.48.122.210
Andrea Dell'Amico

05:52 PM D4Science Infrastructure VM Creation #11927 (In Progress): Create the new ckan instance: ckan-aginfra.d4science.org

Andrea Dell'Amico

Jun 13, 2018

07:15 PM D4Science Infrastructure Task #11924 (Closed): Dismiss https://ckan-eosc.d4science.org

Done. Andrea Dell'Amico

07:07 PM D4Science Infrastructure Task #11924 (In Progress): Dismiss https://ckan-eosc.d4science.org

Andrea Dell'Amico

06:55 PM D4Science Infrastructure Task #11944 (Feedback): Add 1 GB of RAM to accounting service instances

Done. Now the three servers run with 3GB of RAM each. Andrea Dell'Amico

06:23 PM D4Science Infrastructure Task #11944 (In Progress): Add 1 GB of RAM to accounting service instances

I'm doing it, one at a time. Andrea Dell'Amico

05:09 PM D4Science Infrastructure Task #11944: Add 1 GB of RAM to accounting service instances

accounting-service3.d4science.org only had a non working tomcat, now it's on line.
@luca.frosini@isti.cnr.it we add ... Andrea Dell'Amico

11:20 AM D4Science Infrastructure Task #11944: Add 1 GB of RAM to accounting service instances

* It would be better adding 1 GB of RAM each, I've always seen heap memory problems with smartgears nodes with less... Andrea Dell'Amico

05:42 PM D4Science Infrastructure Support #11560: Remove old CDH 5.9 Cluster

@tommaso.piccioli@isti.cnr.it, @sandro.labruzzo@isti.cnr.it just moved all the data from the Hortonworks cluster. The... Andrea Dell'Amico

05:03 PM D4Science Infrastructure Incident #11947: Algorithms are not being installed in the RPrototypingLab

Gianpaolo Coro wrote:
> OK, I confirm the algorithms work now.
>
> As for the issue: The dm-pool-manager only ac... Andrea Dell'Amico

04:48 PM D4Science Infrastructure Incident #11947 (Feedback): Algorithms are not being installed in the RPrototypingLab

Andrea Dell'Amico

04:48 PM D4Science Infrastructure Incident #11947 (In Progress): Algorithms are not being installed in the RPrototypingLab

Gianpaolo Coro wrote:
> That's strange because in the RPrototypingLab SVN commit is only managed by the Pool Manager... Andrea Dell'Amico

04:25 PM D4Science Infrastructure Incident #11947: Algorithms are not being installed in the RPrototypingLab

Also, you can check `/var/log/syslog` to see if the script is running (it's a cron job, so if it's not run there are ... Andrea Dell'Amico

04:23 PM D4Science Infrastructure Incident #11947: Algorithms are not being installed in the RPrototypingLab

On dataminer0-proto.d4science.org I see:
~~~
$ svn update
Updating '.':
Skipped 'software/OPEN_MESH_RECONSTRUCT... Andrea Dell'Amico

Jun 12, 2018

08:31 PM D4Science Infrastructure Task #11938 (Feedback): Enable statistical.manager on SVN

I also added the user to the correct group. When activated, should be able to access subversion in r/w mode. Andrea Dell'Amico

08:27 PM D4Science Infrastructure Task #11938: Enable statistical.manager on SVN

I just gave to @gianpaolo.coro@isti.cnr.it the link to activate the user. Andrea Dell'Amico

08:24 PM D4Science Infrastructure Task #11938 (In Progress): Enable statistical.manager on SVN

Andrea Dell'Amico

07:35 PM D4Science Infrastructure Task #11737 (Feedback): Please setup a Nextcloud instance on D4Science

Andrea Dell'Amico

04:55 PM D4Science Infrastructure Task #11737 (In Progress): Please setup a Nextcloud instance on D4Science

The installation is running, I just have to add the ldap authentication. Andrea Dell'Amico

Jun 08, 2018

10:12 AM D4Science Infrastructure Support #11885 (Closed): pre.d4science.org: certificate expired

The certificate was valid, but haproxy failed to reload itself because of an error in its configuration. Now it's fix... Andrea Dell'Amico

Jun 06, 2018

06:35 PM D4Science Infrastructure VM Creation #11509 (Closed): Create a VM for hosting VocBench

The VM has a basic setup.
Andrea Dell'Amico

Jun 05, 2018

06:40 PM D4Science Infrastructure VM Creation #11509 (In Progress): Create a VM for hosting VocBench

The hostname is going to be vocbench1.d4science.org, IP address 90.147.166.120. Andrea Dell'Amico

06:02 PM D4Science Infrastructure Task #11872: Dismissal of EGIP Gateway (Not EGIP VRE)

Done. Andrea Dell'Amico

Jun 04, 2018

07:47 PM D4Science Infrastructure Task #11872: Dismissal of EGIP Gateway (Not EGIP VRE)

At the next renewal, the load balancer certificate will not have the egip.d4science.org alias. Let us know when the D... Andrea Dell'Amico

07:07 PM D4Science Infrastructure Task #11873 (Closed): Fix the networking bug introduced by cloud-init on Ubuntu 16.04 oVirt guests

I've run it against every oVirt guest. Now the reboot/poweroff/poweron operations should be safe. I tried the operati... Andrea Dell'Amico

07:02 PM D4Science Infrastructure Task #11873: Fix the networking bug introduced by cloud-init on Ubuntu 16.04 oVirt guests

I just added - and run - a role that removes the cloud-init package (default) or tells cloud-init not to mess with th... Andrea Dell'Amico

06:58 PM D4Science Infrastructure Task #11873 (In Progress): Fix the networking bug introduced by cloud-init on Ubuntu 16.04 oVirt guests

Andrea Dell'Amico

06:30 PM D4Science Infrastructure Task #11873: Fix the networking bug introduced by cloud-init on Ubuntu 16.04 oVirt guests

I just made a test on one of the guests. Removing cloud-init - after the VM first initialisation - has no collateral ... Andrea Dell'Amico

06:28 PM D4Science Infrastructure Task #11873 (Closed): Fix the networking bug introduced by cloud-init on Ubuntu 16.04 oVirt guests

The networks is always reset to dhcp, and the server URL from where it gets the host information is wrong. Andrea Dell'Amico

03:30 PM D4Science Infrastructure VM Creation #11852: Create a VM to deploy the new storage hub application.

I forgot to also change the ACL used by the old home library. Your request were intercepted by that rule and redirect... Andrea Dell'Amico

11:40 AM D4Science Infrastructure VM Creation #11852: Create a VM to deploy the new storage hub application.

Done. Now the load balancer is happy. Andrea Dell'Amico