D4science

May 06, 2016

05:07 PM D4Science Infrastructure Support #3917 (Rejected): Add me as a developer in gCube group

You will be automatically assigned to the Gcube (with a 5 minutes lag) group as soon as your request to join the Gcub... Andrea Dell'Amico

04:30 PM D4Science Infrastructure Task #3878 (Feedback): Please create new VM with Elastic Search of Production

elastic0-p-d4s.d4science.org is ready. The configuration is identical to the one on the dev node, the only change is ... Andrea Dell'Amico

03:16 PM D4Science Infrastructure Task #3878 (In Progress): Please create new VM with Elastic Search of Production

elastic0-p-d4s.d4science.org will have IP 146.48.122.131
Andrea Dell'Amico

May 05, 2016

06:07 PM D4Science Infrastructure Support #3881: Enable a portal monitor for discovering new VOs: SmartArea, SoBigData

Roberto Cirillo wrote:
>
> In addition I don't have access to next.d4science.org as life user and to dev3.d4scie... Andrea Dell'Amico

04:32 PM D4Science Infrastructure Task #3860: Spatial Data Infrastructure services on Ganglia

The cluster is active, http://monitoring.research-infrastructures.eu/ganglia/?c=D4Science%20SDI&m=load_one&r=hour&s=b... Andrea Dell'Amico

04:07 PM D4Science Infrastructure Task #3860: Spatial Data Infrastructure services on Ganglia

`wps01.i-marine.d4science.org` is not inside our data center. I have no access to it and it will not be able to join ... Andrea Dell'Amico

04:06 PM D4Science Infrastructure Task #3860 (In Progress): Spatial Data Infrastructure services on Ganglia

Andrea Dell'Amico

02:28 PM D4Science Infrastructure Task #3895: Upgrade the jackrabbit devel environment

@valentina.marioli@isti.cnr.it is it doable? I see that the running tomcat runs a lot of apps, most of them installed... Andrea Dell'Amico

02:23 PM D4Science Infrastructure Task #3895 (Closed): Upgrade the jackrabbit devel environment

It's currently running on a Ubuntu 9.04 and tomcat is 5.5.
It should be reinstalled on a more modern distribution ... Andrea Dell'Amico

02:16 PM D4Science Infrastructure Task #3833 (Closed): Please enable log rotation on jack rabbit's tomcat production (and dev)

Done on the devel instance too.
Andrea Dell'Amico

02:04 PM D4Science Infrastructure Task #3181: Update RStudio on rstudio.d4science.org

@gianpaolo.coro@isti.cnr.it did you have the time to test if rstudio server is working on `rstudio-dev.d4science.org`?
Andrea Dell'Amico

01:59 PM D4Science Infrastructure Task #3480 (Closed): Enable SSL on ldap-liferay.d4science.org

Andrea Dell'Amico

May 04, 2016

07:32 PM D4Science Infrastructure Task #3109: VREModeler: nightly restart

The configured cron job didn't work. I just changed it.
Andrea Dell'Amico

May 02, 2016

07:59 PM D4Science Infrastructure Task #3833: Please enable log rotation on jack rabbit's tomcat production (and dev)

Done on `ws-repository-pre-d4s.d4science.org` too. What's the hostname of the dev instance?
Andrea Dell'Amico

07:51 PM D4Science Infrastructure Task #3833 (In Progress): Please enable log rotation on jack rabbit's tomcat production (and dev)

Done on the production VM.
Andrea Dell'Amico

07:35 PM D4Science Infrastructure Task #3834 (Feedback): Please enable Ganglia and Nagios check on JackRabbit, data.d4science.org, and access.d4science.org

the jackrabbit host is now under ganglia too.
The nagios check was already there, see #2263. I just switched the c... Andrea Dell'Amico

05:03 PM D4Science Infrastructure Task #3834 (In Progress): Please enable Ganglia and Nagios check on JackRabbit, data.d4science.org, and access.d4science.org

data.d4science.org and access.d4science.org added to the portals cluster.
Andrea Dell'Amico

07:33 PM D4Science Infrastructure Task #2263: nagios check for the jackrabbit services

Just changed the check URL from `http://node76.p.d4science.research-infrastructures.eu:8080/...` to `https://node76.p... Andrea Dell'Amico

06:27 PM D4Science Infrastructure Incident #3840 (Closed): Cannot login on wiki.gcube-system.org anymore

Done. Andrea Dell'Amico

06:25 PM D4Science Infrastructure Incident #3840 (In Progress): Cannot login on wiki.gcube-system.org anymore

Yes. Working on it
Andrea Dell'Amico

02:30 PM D4Science Infrastructure Task #3480 (Feedback): Enable SSL on ldap-liferay.d4science.org

Done.
Andrea Dell'Amico

Apr 27, 2016

06:56 PM D4Science Infrastructure Task #2174: Dataminer and Statistical Manager packages

OK.
Andrea Dell'Amico

06:45 PM D4Science Infrastructure Task #2174: Dataminer and Statistical Manager packages

Questions:
* Do they need to be installed on the rstudio servers too?
* Do you want them installed on the datamin... Andrea Dell'Amico

06:00 PM D4Science Infrastructure Task #3803: Dev4 portal errors when uploading files larger than 3MB

Yes. The new infra is not configured at all right now, I think @massimiliano.assante@isti.cnr.it wants to test the to... Andrea Dell'Amico

05:24 PM D4Science Infrastructure Task #3803 (Feedback): Dev4 portal errors when uploading files larger than 3MB

Raised the haproxy timeouts too.
Andrea Dell'Amico

05:13 PM D4Science Infrastructure Task #3803 (In Progress): Dev4 portal errors when uploading files larger than 3MB

Looking at it. Andrea Dell'Amico

04:58 PM D4Science Infrastructure Task #3803 (Feedback): Dev4 portal errors when uploading files larger than 3MB

Done, let me know.
Andrea Dell'Amico

04:43 PM D4Science Infrastructure Task #3803: Dev4 portal errors when uploading files larger than 3MB

What we want as a maximum size for the file uploads?
Andrea Dell'Amico

04:40 PM D4Science Infrastructure Task #3803 (In Progress): Dev4 portal errors when uploading files larger than 3MB

The error comes from the nginx server. The pipeline is `haproxy -> nginx -> tomcat`.
I'm working to raise the limi... Andrea Dell'Amico

02:05 PM D4Science Infrastructure Task #3257 (Closed): Create a letsencrypt callback for each service that will serve letsencrypt certificates

Andrea Dell'Amico

02:04 PM D4Science Infrastructure Task #3257: Create a letsencrypt callback for each service that will serve letsencrypt certificates

More hooks can be added when needed. The schema is always the same.
Andrea Dell'Amico

02:03 PM D4Science Infrastructure Task #3260 (Closed): letsencrypt script for nginx

Fixed a problem with the nginx config snippet, it now works.
Andrea Dell'Amico

Apr 26, 2016

07:09 PM D4Science Infrastructure Task #3480: Enable SSL on ldap-liferay.d4science.org

Thanks. I plan to close the plain text ldap port next Monday.
Andrea Dell'Amico

Apr 22, 2016

06:54 PM D4Science Infrastructure Task #3260 (Feedback): letsencrypt script for nginx

Configuration and hooks are ready to be tested.
Andrea Dell'Amico

06:41 PM D4Science Infrastructure Task #3260 (In Progress): letsencrypt script for nginx

Andrea Dell'Amico

06:07 PM D4Science Infrastructure Task #3259 (Closed): letsencrypt script for apache

Andrea Dell'Amico

06:07 PM D4Science Infrastructure Task #3259 (In Progress): letsencrypt script for apache

apache has its callback now.
Andrea Dell'Amico

Apr 21, 2016

11:46 PM D4Science Infrastructure Task #2174: Dataminer and Statistical Manager packages

The statistical manager nodes now have all the new modules installed. Andrea Dell'Amico

01:26 PM D4Science Infrastructure Task #2174: Dataminer and Statistical Manager packages

I see that the rgl package needs the GL include files. All the other new packages have just been installed on the pro... Andrea Dell'Amico

01:22 PM D4Science Infrastructure Task #2174: Dataminer and Statistical Manager packages

Gianpaolo Coro wrote:
> Hi Andrea, the packages should be aligned between StatMan and Dataminer, because the latter ... Andrea Dell'Amico

11:24 AM D4Science Infrastructure Task #2174: Dataminer and Statistical Manager packages

New requests for packages on the statistical manager (and dataminer too?):
~~~
- lubridate
- dplyr
- tidy... Andrea Dell'Amico

01:15 PM D4Science Infrastructure Task #3257: Create a letsencrypt callback for each service that will serve letsencrypt certificates

The `letsencrypt-acmetool-client` role is to be always preferred to the `letsencrypt-client` one. The alternative cli... Andrea Dell'Amico

01:13 PM D4Science Infrastructure Task #3164: Investigate the procedures needed to obtain valid X.509 TLS certificates from letsencrypt

I also put in place some ansible tasks to create a self signed certificate **before** the first execution of a letsen... Andrea Dell'Amico

01:10 PM D4Science Infrastructure Task #3480: Enable SSL on ldap-liferay.d4science.org

The sobigdata.eu drupal instance has started using ssl, FIY.
Andrea Dell'Amico

Apr 20, 2016

02:13 PM D4Science Infrastructure Task #3480: Enable SSL on ldap-liferay.d4science.org

The ldap server is now running with ssl enabled.
This redmine instance is already configured to bind on the ssl port.
Andrea Dell'Amico

Apr 19, 2016

06:54 PM D4Science Infrastructure Task #3480: Enable SSL on ldap-liferay.d4science.org

It's already there, it's listed together with the production hosts.
Andrea Dell'Amico

06:45 PM D4Science Infrastructure Task #3480: Enable SSL on ldap-liferay.d4science.org

The new keyring has been installed on:
~~~
descramble.d4science.org
egip.d4science.org
i-marine.d4science.org
... Andrea Dell'Amico

05:53 PM D4Science Infrastructure Task #3480: Enable SSL on ldap-liferay.d4science.org

I'm installing the new keyring on all the portal hosts.
It should not be needed on any other servers with an up to d... Andrea Dell'Amico

12:40 PM D4Science Infrastructure Task #3480: Enable SSL on ldap-liferay.d4science.org

The CA used by letsencrypt is not known to the JRE, but the problem lies here:
~~~
-Djavax.net.ssl.trustStore=/... Andrea Dell'Amico

11:24 AM D4Science Infrastructure Task #3480: Enable SSL on ldap-liferay.d4science.org

Andrea Dell'Amico wrote:
> * I also added two aliases, because `ldap-liferay` is now misleading: ldap-d.d4science.... Andrea Dell'Amico

11:17 AM D4Science Infrastructure Task #3480: Enable SSL on ldap-liferay.d4science.org

* Yes, the development ldap server is under ssl already.
* I also added two aliases, because `ldap-liferay` is now... Andrea Dell'Amico

11:21 AM D4Science Infrastructure Task #3481 (Closed): Add ldap.d4science.org as CNAME of ldap-liferay.d4science.org

Also added ldap-d.d4science.org as CNAME for ldap-liferay-d.d4science.org
Andrea Dell'Amico

Apr 15, 2016

08:49 PM D4Science Infrastructure Task #3481 (Closed): Add ldap.d4science.org as CNAME of ldap-liferay.d4science.org

This ldap will serve all the infrastructure.
Andrea Dell'Amico

08:48 PM D4Science Infrastructure Task #3480: Enable SSL on ldap-liferay.d4science.org

@massimiliano.assante@isti.cnr.it let me know when we can make the configuration change. A ldap restart is needed. It... Andrea Dell'Amico

08:46 PM D4Science Infrastructure Task #3480 (Closed): Enable SSL on ldap-liferay.d4science.org

The service is still using non encrypted connections.
When all the services will have switched to the encrypted co... Andrea Dell'Amico

08:43 PM D4Science Infrastructure Task #3164 (Closed): Investigate the procedures needed to obtain valid X.509 TLS certificates from letsencrypt

Closing this one. letsencrypt is a viable solution, the related task is tracking the progress on the services configu... Andrea Dell'Amico

08:41 PM D4Science Infrastructure Task #2705 (Feedback): Create new VM for production Infrastructure Gateway (Liferay 6.2)

Are there any other requirements?
Andrea Dell'Amico

08:40 PM D4Science Infrastructure Task #2892 (Closed): Provide SoBigData colleagues with details for interfacing with LDAP

Andrea Dell'Amico

08:34 PM D4Science Infrastructure Task #3479 (Closed): Letsencrypt hook script for openldap

The openldap playbook has been updated. Andrea Dell'Amico

08:00 PM D4Science Infrastructure Task #3479 (In Progress): Letsencrypt hook script for openldap

And the ldif that add the certificates to the openldap configuration:
~~~
dn: cn=config
add: olcTLSCACertificate... Andrea Dell'Amico

07:59 PM D4Science Infrastructure Task #3479: Letsencrypt hook script for openldap

The hook script:
~~~
#!/bin/bash
. /etc/default/letsencrypt
mkdir -p /etc/pki/openldap
chown openldap:open... Andrea Dell'Amico

07:55 PM D4Science Infrastructure Task #3479 (Closed): Letsencrypt hook script for openldap

A script that copies the certificates in a different place with the correct permissions. Andrea Dell'Amico

07:57 PM D4Science Infrastructure Task #3257: Create a letsencrypt callback for each service that will serve letsencrypt certificates

Or, for the letsencrypt acme tool:
~~~
letsencrypt_acme_install: True
letsencrypt_acme_domains:
- '{{ ansible... Andrea Dell'Amico

05:08 PM D4Science Infrastructure Task #3181: Update RStudio on rstudio.d4science.org

rstudio-dev.d4science.org is now running rstudio-server 0.99 and R 3.2.3 with the same set of R plugins that are curr... Andrea Dell'Amico

03:30 PM D4Science Infrastructure Task #3181 (In Progress): Update RStudio on rstudio.d4science.org

Andrea Dell'Amico

01:35 PM D4Science Infrastructure Support #3252 (Closed): Please add me to the svn for the d4science

Andrea Dell'Amico

Apr 14, 2016

07:32 PM D4Science Infrastructure Task #3258: letsencrypt script for haproxy

Added support for the letsencrypt acme client. It has different paths.
Andrea Dell'Amico

07:02 PM D4Science Infrastructure Task #3164: Investigate the procedures needed to obtain valid X.509 TLS certificates from letsencrypt

And it works. So we can convert to ssl with valid certificates almost all our services.
Andrea Dell'Amico

06:55 PM D4Science Infrastructure Task #3164: Investigate the procedures needed to obtain valid X.509 TLS certificates from letsencrypt

I successfully tested a manual installation on redmine-d.d4science.org. Now trying via provisioning on ldap-liferay-d... Andrea Dell'Amico

02:24 PM D4Science Infrastructure Task #3164 (In Progress): Investigate the procedures needed to obtain valid X.509 TLS certificates from letsencrypt

There are less intrusive clients, that possibly do not need to run as root. I'm going to try this one: https://github... Andrea Dell'Amico