D4science

Oct 09, 2016

12:52 PM D4Science Infrastructure Task #5476 (Closed): Enable OCSP stapling on the ssl enabled web services

We can do this only on Ubuntu >= 14.04, because apache 2.4 and nginx >= 1.3 are required.
Some links:
https://wik... Andrea Dell'Amico

Oct 08, 2016

01:02 PM D4Science Infrastructure Task #4371: same R configuration (R version and packages) on R-Studio as the one on machine(s) used by Dataminer.

The new proposal is the following:
* Three lists are maintained into a subversion repository. One for the debian p... Andrea Dell'Amico

12:52 PM D4Science Infrastructure Task #5292 (Closed): Destroy VM dev.d4science.org (not destroyed anymore)

Done.
Moved the VM configuration and removed the host name from the dns.
Andrea Dell'Amico

12:44 PM D4Science Infrastructure Task #4842: Make the ldap configuration on rstudio(-dev).d4science.org point to ldap.d4science.org

The ldap authentication against the new ldap server is working correctly on dataminer1-prototype, see #4865.
Let me... Andrea Dell'Amico

12:43 PM D4Science Infrastructure Task #4865 (Closed): Installing data analysis machine to develop prototypes

rstudio server is working, and the ldap authentication against the new ldap server too. Andrea Dell'Amico

Oct 07, 2016

08:15 PM D4Science Infrastructure Task #5451 (Feedback): Ensure that dependent libraries invoked by R have same versions in Dataminer / RStudio environment

The R packages and their dependencies are now aligned on all the dataminer and rstudio servers.
Andrea Dell'Amico

04:20 PM D4Science Infrastructure Task #5451: Ensure that dependent libraries invoked by R have same versions in Dataminer / RStudio environment

The R packages update is running right now.
I'm listing the debian packages that provide libraries needed by some ... Andrea Dell'Amico

03:36 PM D4Science Infrastructure Task #5451 (In Progress): Ensure that dependent libraries invoked by R have same versions in Dataminer / RStudio environment

Andrea Dell'Amico

02:16 PM D4Science Infrastructure Task #5451: Ensure that dependent libraries invoked by R have same versions in Dataminer / RStudio environment

The dataminer all have the same set of R packages installed.
On the rstudio/rstudio-dev servers the R installed pack... Andrea Dell'Amico

07:54 PM D4Science Infrastructure Task #5290: Align DataMiner Locale to the RStudio Locale

Emmanuel Blondel wrote:
> Thanks Andrea for the information, and for your prompt action on this ticket (again sorry,... Andrea Dell'Amico

01:45 PM D4Science Infrastructure Task #5290: Align DataMiner Locale to the RStudio Locale

Emmanuel Blondel wrote:
> Sorry, i was not aware of this new ticket, so in the meanwhile i've created a support tick... Andrea Dell'Amico

06:07 PM D4Science Infrastructure Task #5178 (Closed): Enable caching of static content (images) on gateway production cluster

Andrea Dell'Amico

06:06 PM D4Science Infrastructure Incident #5436 (Closed): the authorization-service node is not reachable outside the CNR network

Andrea Dell'Amico

Oct 06, 2016

10:48 PM D4Science Infrastructure Incident #5436 (Feedback): the authorization-service node is not reachable outside the CNR network

Andrea Dell'Amico

10:48 PM D4Science Infrastructure Incident #5436 (In Progress): the authorization-service node is not reachable outside the CNR network

Port 9090 is now open to the world.
Andrea Dell'Amico

Oct 05, 2016

11:39 AM D4Science Infrastructure Task #5169 (Feedback): Prepare environment to test Generic Worker on Dataminer

Andrea Dell'Amico

11:39 AM D4Science Infrastructure Task #5169: Prepare environment to test Generic Worker on Dataminer

It seems it's working now. The correct scopes are `/gcube/devNext /gcube/devNext/NextNext`
Andrea Dell'Amico

10:50 AM D4Science Infrastructure Task #5169: Prepare environment to test Generic Worker on Dataminer

Lucio Lelii wrote:
> java TokenGenerator <TOKEN_GIVEN_BY_LUCIO> dataminer2-d-d4s.d4science.org 80 /home/gcube/.conta... Andrea Dell'Amico

10:40 AM D4Science Infrastructure Task #5169: Prepare environment to test Generic Worker on Dataminer

A question about the `http://thredds.d4science.org/thredds/fileServer/public/netcdf/gebco_08_OCEANS_CLIMATOLOGY_METEO... Andrea Dell'Amico

10:14 AM D4Science Infrastructure Task #5169: Prepare environment to test Generic Worker on Dataminer

Gianpaolo Coro wrote:
> Could you retry now please?
> Anyway, I fear that some snapshots of the authorization libr... Andrea Dell'Amico

Oct 04, 2016

07:44 PM D4Science Infrastructure Task #5169: Prepare environment to test Generic Worker on Dataminer

Gianpaolo Coro wrote:
> The GW-Dataminer machines should be placed behind a proxy named dataminer-d-workers.d4scienc... Andrea Dell'Amico

07:43 PM D4Science Infrastructure Task #5169 (In Progress): Prepare environment to test Generic Worker on Dataminer

I tried using the zip file at last.
The deploy fails with the following exception:
~~~
2016-10-04 19:38:04,614... Andrea Dell'Amico

Oct 03, 2016

10:05 PM D4Science Infrastructure Task #5353: Database + endpoint needed

We already have a dedicated postgresql with a database that has the same name: https://support.d4science.org/issues/3... Andrea Dell'Amico

Sep 30, 2016

07:35 PM D4Science Infrastructure Task #5290 (Feedback): Align DataMiner Locale to the RStudio Locale

Andrea Dell'Amico

07:35 PM D4Science Infrastructure Task #5290 (In Progress): Align DataMiner Locale to the RStudio Locale

Done. The tomcat service needs a restart before being able to see the new setting.
Andrea Dell'Amico

05:03 PM D4Science Infrastructure Task #5290: Align DataMiner Locale to the RStudio Locale

I see that rstudio.d4science.org esplicitly sets the `LANG` variable here:
~~~
cat /etc/default/locale
# File g... Andrea Dell'Amico

06:51 PM D4Science Infrastructure Task #5292 (In Progress): Destroy VM dev.d4science.org (not destroyed anymore)

I shut it down. I'll remove it next monday. It was crashed, btw.
Andrea Dell'Amico

Sep 29, 2016

03:43 PM D4Science Infrastructure Task #4984: Create new VM to host new Resource Registry

I'm ready to set the new properties, now that the orientdb cluster is active. Andrea Dell'Amico

03:41 PM D4Science Infrastructure Task #3475: Add 2 OrientDB instances

The java heap is now configurable. I've set it to 2048MB.
Andrea Dell'Amico

12:56 PM D4Science Infrastructure Task #3475 (Feedback): Add 2 OrientDB instances

Done. The hook has been installed, the configuration updated, the services restarted.
Andrea Dell'Amico

12:58 PM D4Science Infrastructure Task #5227 (Closed): Enable SSL on the orientdb instances

See http://orientdb.com/docs/2.2.x/Using-SSL-with-OrientDB.html
Andrea Dell'Amico

Sep 28, 2016

07:31 PM D4Science Infrastructure Task #5178: Enable caching of static content (images) on gateway production cluster

Done on every instance.
Andrea Dell'Amico

03:47 PM D4Science Infrastructure Task #5178: Enable caching of static content (images) on gateway production cluster

Done. Sorry for the disservice.
Andrea Dell'Amico

07:13 PM D4Science Infrastructure Task #3475: Add 2 OrientDB instances

We also need to tweak the java heap configuration. Andrea Dell'Amico

07:10 PM D4Science Infrastructure Task #3475: Add 2 OrientDB instances

The playbook is ready and the configuration seems corret. We have errors on the hooks, because we didn't create the r... Andrea Dell'Amico

04:42 PM D4Science Infrastructure Task #5210 (Closed): Dismiss iisg-ldap.research-infrastructures.eu

I've shut down the VM. Its configuration is still available if a need arises.
Andrea Dell'Amico

04:41 PM D4Science Infrastructure Task #5210 (Closed): Dismiss iisg-ldap.research-infrastructures.eu

The VM was a slave ldap server for the socialhistoryservices (HOPE) project.
It never had a connection in a while, a... Andrea Dell'Amico

04:38 PM D4Science Infrastructure Task #5209 (Closed): Dismiss auth2.research-infrastructures.eu

The VM has been shut down.
Andrea Dell'Amico

04:38 PM D4Science Infrastructure Task #5209 (Closed): Dismiss auth2.research-infrastructures.eu

The VM wanted to be a redundancy server for auth1.research-infrastructures.eu but no service is installed on it. Andrea Dell'Amico

04:35 PM D4Science Infrastructure Task #5180 (Closed): New playbook that installs the authorization service

The playbook works. It has been tested on the dev authorization server.
Andrea Dell'Amico

Sep 27, 2016

07:32 PM D4Science Infrastructure Task #5178 (Feedback): Enable caching of static content (images) on gateway production cluster

The new configuration is active on dev and preprod. Let me know if it can be provisioned on production too.
Andrea Dell'Amico

06:52 PM D4Science Infrastructure Task #5178 (In Progress): Enable caching of static content (images) on gateway production cluster

I'm going to test in dev, than preproduction. Andrea Dell'Amico

06:25 PM D4Science Infrastructure Task #5180 (In Progress): New playbook that installs the authorization service

The playbook is ready to be tested.
Andrea Dell'Amico

06:24 PM D4Science Infrastructure Task #5180 (Closed): New playbook that installs the authorization service

nginx/tomcat are needed. https too.
The authorization service needs a postgresql backend, and pgpool before postgr... Andrea Dell'Amico

06:16 PM D4Science Infrastructure Task #5179 (Closed): Implement the new container.xml configuration needed by the authorization service in the ansible roles

Done. The new smartgears is running on node17.d4science.org and node19.d4science.org.
Andrea Dell'Amico

06:15 PM D4Science Infrastructure Task #5179: Implement the new container.xml configuration needed by the authorization service in the ansible roles

The container.xml file is now assembled from three different parts. The first and the last are pieces of the old temp... Andrea Dell'Amico

06:11 PM D4Science Infrastructure Task #5179 (Closed): Implement the new container.xml configuration needed by the authorization service in the ansible roles

smartgears need a totally different configuration procedure.
Andrea Dell'Amico

12:54 PM D4Science Infrastructure Task #5162 (Feedback): Disable firewall in node74.d4science.org

Andrea Dell'Amico

12:54 PM D4Science Infrastructure Task #5162 (In Progress): Disable firewall in node74.d4science.org

Andrea Dell'Amico

12:46 PM D4Science Infrastructure Task #5162: Disable firewall in node74.d4science.org

Instead of disabling it, I'm going to open the resultset ports range (3000,3050). Andrea Dell'Amico

Sep 23, 2016

07:10 PM D4Science Infrastructure Task #3475: Add 2 OrientDB instances

I'm assembling a oriendb ansible role to provision all the pieces.
Andrea Dell'Amico

Sep 22, 2016

11:08 AM D4Science Infrastructure Support #5103: access to git ansible repo

Daniele Pavia wrote:
> Thanks Andrea,
> unfortunately I can't access. The account seems to be active, but I get an ... Andrea Dell'Amico

Sep 21, 2016

06:07 PM D4Science Infrastructure Support #5103 (Feedback): access to git ansible repo

Andrea Dell'Amico

05:57 PM D4Science Infrastructure Support #5103 (In Progress): access to git ansible repo

Andrea Dell'Amico

05:03 PM D4Science Infrastructure Task #5105 (Feedback): Enable WebSocket support on nginx for infrastructure gateway

I've possibly found a generic solution. Now running on dev2.d4science.org.
The details:
~~~
map $http_upgrade ... Andrea Dell'Amico

04:26 PM D4Science Infrastructure Task #5105 (In Progress): Enable WebSocket support on nginx for infrastructure gateway

Andrea Dell'Amico

04:25 PM D4Science Infrastructure Task #5105: Enable WebSocket support on nginx for infrastructure gateway

RIght now the situation is the following:
* haproxy already transparently manages the websocket connections
* ngi... Andrea Dell'Amico

Sep 20, 2016

12:18 PM D4Science Infrastructure Task #4984: Create new VM to host new Resource Registry

The VM is active, smartgears and resource-registry installed. The resource-registry app cannot work yet, we need to c... Andrea Dell'Amico

Sep 19, 2016

05:25 PM D4Science Infrastructure Task #4984: Create new VM to host new Resource Registry

Luca Frosini wrote:
>
> In the future this service will be deployed in many instances. Each instance will use the ... Andrea Dell'Amico

02:54 PM D4Science Infrastructure Task #4984 (In Progress): Create new VM to host new Resource Registry

hostname/IP shall be resourceregistry1-d-d4s.d4science.org 146.48.122.34.
Andrea Dell'Amico

03:46 PM D4Science Infrastructure Incident #5069 (Closed): Increase the rstudio disk

50GB added. Andrea Dell'Amico

03:45 PM D4Science Infrastructure Incident #5069 (In Progress): Increase the rstudio disk

Andrea Dell'Amico

03:44 PM D4Science Infrastructure Incident #5069 (Closed): Increase the rstudio disk

rstudio.d4science.org needs more disk space.
I see that the users are accumulating data into their home directories. Andrea Dell'Amico

01:13 PM D4Science Infrastructure Task #5051 (Closed): Change Nagios check from gCore container to Smartgears container

The correct port is 8080 Andrea Dell'Amico

01:05 PM D4Science Infrastructure Task #5051 (In Progress): Change Nagios check from gCore container to Smartgears container

Set up the check for the 9000 port. Andrea Dell'Amico

12:07 PM D4Science Infrastructure Task #5051: Change Nagios check from gCore container to Smartgears container

On port 9000?
Andrea Dell'Amico

11:32 AM D4Science Infrastructure Task #5049 (Closed): Change nagios service alert host name: thredds.research-infrastructures.eu

Done. Andrea Dell'Amico

11:27 AM D4Science Infrastructure Task #5049 (In Progress): Change nagios service alert host name: thredds.research-infrastructures.eu

Andrea Dell'Amico

11:15 AM D4Science Infrastructure Task #5048 (Closed): thredds.d4science.org: increase fd max number

Done. The container needs a restart.
Andrea Dell'Amico

Sep 16, 2016

05:22 PM D4Science Infrastructure Task #5000 (Feedback): Create new VM for hosting SmartExecutor service

The VM is ready, smartgear and the smartexecutor plugins installed. They answer on port 80, there's a reverse proxy b... Andrea Dell'Amico

03:08 PM D4Science Infrastructure Task #5000: Create new VM for hosting SmartExecutor service

hostname and Ip are going to be: smartexecutor1-d-d4s.d4science.org 146.48.122.204 Andrea Dell'Amico

01:51 PM D4Science Infrastructure Task #5000: Create new VM for hosting SmartExecutor service

> Plugin for Smart Executor:
> <dependency>
> <groupId>org.gcube.accounting</groupId>
> <artifactId>accounting... Andrea Dell'Amico

01:50 PM D4Science Infrastructure Task #5000 (In Progress): Create new VM for hosting SmartExecutor service

It's going a smart executor but not a generic worker, right? So no generic worker nor R packages.
Andrea Dell'Amico

02:45 PM D4Science Infrastructure Incident #5046 (Feedback): Blocked ports between the Dataminers and the Workspace

Done. Andrea Dell'Amico

02:37 PM D4Science Infrastructure Incident #5046 (In Progress): Blocked ports between the Dataminers and the Workspace

Andrea Dell'Amico

Sep 14, 2016

06:00 PM D4Science Infrastructure Task #5022 (Closed): Clustering Liferay’s Documents and Media Library in Production gateways

Andrea Dell'Amico

05:49 PM D4Science Infrastructure Task #5022 (Feedback): Clustering Liferay’s Documents and Media Library in Production gateways

NFS, for now. Steps:
* on dlibsan10.san.research-infrastructures.eu:
> * Installed `nfs-kernel-server`
> * Creat... Andrea Dell'Amico

03:49 PM D4Science Infrastructure Task #4227 (Closed): Activate a VPN service to grant complete access to the servers network from outside

Andrea Dell'Amico

Sep 13, 2016

12:48 PM D4Science Infrastructure Task #4865: Installing data analysis machine to develop prototypes

Andrea Dell'Amico wrote:
> ~~~
> Connecting...
> Updating IS on scope /d4science.research-infrastructures.eu
> ec... Andrea Dell'Amico

11:56 AM D4Science Infrastructure Task #5008: Enable Infrastructure Gateway cluster on Production

Yes, that's correct. The firewall rules are already active.
Andrea Dell'Amico

Sep 12, 2016

04:37 PM D4Science Infrastructure Task #4379: Update Tomcat7 servers (server.xml) to add cluster configuration

The nodes need to communicate via RMI too. Now that traffic is permitted. I changed the firewall rules both on prepro... Andrea Dell'Amico

12:07 PM D4Science Infrastructure Task #4984: Create new VM to host new Resource Registry

Luca Frosini wrote:
> Same resources of the actual IC VM in dev.
What's the IC's hostname?
Which software need... Andrea Dell'Amico