D4Science Infrastructure

Aug 13, 2015

04:02 PM Task #457: A new backup server

redmine.d4science.org moved to the new backup server Tommaso Piccioli

03:32 PM Task #457 (In Progress): A new backup server

Tommaso Piccioli

03:31 PM Task #457: A new backup server

To date these host's backups have been moved to the new backuppc server:
auth1.research-infrastructures.eu
auth2.... Tommaso Piccioli

03:45 PM Incident #482 (Closed): GARR-CERT-16H1208 Unrestricted elasticsearch server access on node13.p.d4science.research-infrastructures.eu

############################################################
Incident Number: GARR-CERT-16H1208 CLOSED
##########... Tommaso Piccioli

03:43 PM Task #470: Install the new hypervisor server

dlib28x installed with debian8 and xen 4.4.1 (xl toolstack)
We lost the xenmap funtionalities because the python x... Tommaso Piccioli

03:25 PM Task #459 (Closed): Install and configure backuppc

debian 8 backuppc 3.3 installed and configured on the new backup server.
I prefere to leave StrictHostKeyChecking ... Tommaso Piccioli

03:18 PM Task #458 (Closed): Reinstall dlibsan1 as the new backup server

Ex dlibsan1 reinstalled as new backup server:
dlib2backup.isti.cnr.it
It's using 6 disk with mirror, resulting ... Tommaso Piccioli

03:13 PM Task #462 (Closed): X.509 certificates for the two backup servers

Due to the nature of these servers, at the moment we are using self signed certificate.
Tommaso Piccioli

Aug 12, 2015

06:26 PM Task #487 (Closed): Nagios monitoring of the ganeti services

We need to monitor the ganeti cluster services, and the DRBD replica state.
Some links:
> http://docs.ganeti.or... Andrea Dell'Amico

06:22 PM Task #484 (Closed): Add new hypervisors to the ganeti cluster

Andrea Dell'Amico

06:22 PM Task #484 (In Progress): Add new hypervisors to the ganeti cluster

All the tasks are complete. Andrea Dell'Amico

06:18 PM Task #484 (Closed): Add new hypervisors to the ganeti cluster

dlib12x and dlib13x can be added to the ganeti cluster already
Andrea Dell'Amico

06:22 PM Task #486 (Closed): Provision the new machines and add them to the cluster

The two hosts are now part of the ganeti cluster Andrea Dell'Amico

06:21 PM Task #486 (In Progress): Provision the new machines and add them to the cluster

Andrea Dell'Amico

06:20 PM Task #486 (Closed): Provision the new machines and add them to the cluster

Modify the xen playbook accordingly.
Andrea Dell'Amico

06:21 PM Task #485 (Closed): Reinstall dlib12x and dlib13x

Andrea Dell'Amico

06:21 PM Task #485 (In Progress): Reinstall dlib12x and dlib13x

@tommaso.piccioli installed both of them.
Andrea Dell'Amico

06:19 PM Task #485 (Closed): Reinstall dlib12x and dlib13x

debian 7, the same version of the other cluster nodes. Andrea Dell'Amico

06:12 PM Task #483 (Rejected): Add iptables rules to the backup server

Install firewall rules on both servers.
Andrea Dell'Amico

04:58 PM Support #478 (Closed): Sprint Creation on Parthenos Issue Tracker

Andrea Dell'Amico

11:37 AM Incident #482 (In Progress): GARR-CERT-16H1208 Unrestricted elasticsearch server access on node13.p.d4science.research-infrastructures.eu

I see that it's an index service that runs on a tomcat instance listening on port 8080. The webapp includes the ela... Andrea Dell'Amico

11:32 AM Incident #482 (Closed): GARR-CERT-16H1208 Unrestricted elasticsearch server access on node13.p.d4science.research-infrastructures.eu

GARR-CERT reports that node13.p.d4science.research-infrastructures.eu has an elasticsearch instance main port open to... Andrea Dell'Amico

Aug 07, 2015

06:52 PM Task #470 (In Progress): Install the new hypervisor server

Andrea Dell'Amico

Aug 06, 2015

06:10 PM Support #478 (Feedback): Sprint Creation on Parthenos Issue Tracker

Done Andrea Dell'Amico

04:06 PM Support #478: Sprint Creation on Parthenos Issue Tracker

Yes please assign Matteo Lorenzini the manager role for Parthenos Project, thanks Massimiliano Assante

03:34 PM Support #478 (In Progress): Sprint Creation on Parthenos Issue Tracker

New sprints can be added by users that have a `manager` status or by the administrators.
Let me know if Matteo Loren... Andrea Dell'Amico

02:45 PM Support #478 (Closed): Sprint Creation on Parthenos Issue Tracker

The user "matteolorenzini" cannot create new Sprints on Parthenos Redmine as the "plus" icon next to sprint is not pr... Massimiliano Assante

04:14 PM Support #477 (Closed): Downloading a file from a folder

Valentina Marioli

03:24 PM Support #477: Downloading a file from a folder

Yes it is!
Thank you
Carlo Carlo Meghini

02:06 PM Support #477 (Feedback): Downloading a file from a folder

Could you please check if the file is now available? Valentina Marioli

01:04 PM Support #477: Downloading a file from a folder

The file is located in this folder:
https://goo.gl/eBfUmN
(hope the link works) and is named
Parthenos WP5&... Carlo Meghini

12:20 PM Support #477 (In Progress): Downloading a file from a folder

What file are we talking about? Where is it located? Valentina Marioli

12:04 PM Support #477 (Closed): Downloading a file from a folder

I tried to download a file from a D4S VRE Parthenos folder and I got the following message:
The requested resource... Carlo Meghini

02:01 PM Task #85: Deploy wikimedia on wiki.gcube-system.org and wiki.d4science.org

Authentication is now working
Andrea Dell'Amico

Aug 05, 2015

07:09 PM Task #85: Deploy wikimedia on wiki.gcube-system.org and wiki.d4science.org

wiki.gcube-system.org is up and, updated to the latest mediawiki distribution.
The authentication doesn't work yet... Andrea Dell'Amico

12:55 PM Task #85: Deploy wikimedia on wiki.gcube-system.org and wiki.d4science.org

I've mostly managed the configuration for the gcube wiki. I'm now going to import the latest backup.
Andrea Dell'Amico

12:55 PM Task #87 (Closed): Make new gCube and D4Science wiki available only on https

https is working correctly. The http accesses are redirected over https. Andrea Dell'Amico

Aug 04, 2015

06:52 PM Task #472 (Closed): Move the VMs from the 'OpenStack servers' to the new hypervisor

Move all the VMs hosted on the servers that will run OpenStack on the new hypervisor Andrea Dell'Amico

06:51 PM Task #471 (Closed): Locate the hypervisors to dedicate to OpenStack

There are some candidates in the mid range group of servers.
Andrea Dell'Amico

06:29 PM Task #470 (Closed): Install the new hypervisor server

dlib28-dom0.d4science.org?
We can stay with debian 7, it's tested and when we will convert to OpenStack another di... Andrea Dell'Amico

06:24 PM Task #469 (Closed): Move some VMs to the new hypervisor to set some servers free and usable to experiment with OpenStack

We need some servers to start working with OpenStack. Some middle sized ones can be used.
Andrea Dell'Amico

05:21 PM Task #462 (Closed): X.509 certificates for the two backup servers

New hostnames?
backup1.d4science.org
backup2.d4science.org
? Andrea Dell'Amico

05:19 PM Task #461 (Closed): Nagios and ganglia monitoring for the backup servers

Monitor both the servers with nagios and ganglia.
Andrea Dell'Amico

05:18 PM Task #460 (Closed): Upgrade the old backup server

Upgrade the OS to be in line with the one on the new server Andrea Dell'Amico

05:15 PM Task #459: Install and configure backuppc

This can be partially done by an ansible playbook.
Let's remember to use the same private ssh key that is used by ... Andrea Dell'Amico

05:15 PM Task #459 (Closed): Install and configure backuppc

Configure backuppc on the backup server so that the load is balanced between the two nodes.
Andrea Dell'Amico

05:13 PM Task #458 (Closed): Reinstall dlibsan1 as the new backup server

debian 8 (the actual backup server is running debian) or Ubuntu?
Use 4 (6?) discs from the new batch Andrea Dell'Amico

05:02 PM Task #457 (Closed): A new backup server

We need a new backup server that will run in parallel to the old one to share the load Andrea Dell'Amico

04:32 PM Task #272 (Closed): Enabling Secure Connections to node11.d.d4science.research-infrastructures.eu

Andrea Dell'Amico

04:26 PM Task #169 (Closed): Verification of the smartgears nodes list

Andrea Dell'Amico

Aug 03, 2015

06:04 PM Task #85: Deploy wikimedia on wiki.gcube-system.org and wiki.d4science.org

I managed to import the gcube-system wiki database and let the wiki configuration load the main Gcube wiki only. The ... Andrea Dell'Amico

06:01 PM Task #85: Deploy wikimedia on wiki.gcube-system.org and wiki.d4science.org

A recap from the mail thread.
The wiki.gcube-system.org wiki will be this one: [[https://gcube.wiki.gcube-system.o... Andrea Dell'Amico

04:15 PM Support #396 (Closed): D4Science Portals should be powered by D4Science and not by gCube

Massimiliano Assante

03:53 PM Support #396: D4Science Portals should be powered by D4Science and not by gCube

iMarine portal is now powered by D4Science.org Massimiliano Assante

11:49 AM Support #396 (In Progress): D4Science Portals should be powered by D4Science and not by gCube

Massimiliano Assante

02:17 PM Incident #448 (Closed): Recently Files Portlet not working on descramble portal

The problem was due to a bug in Home Library: copying a folder, the files into the folder have been copied, but the r... Valentina Marioli

12:43 PM Incident #448 (In Progress): Recently Files Portlet not working on descramble portal

Valentina Marioli

11:17 AM Incident #448 (Closed): Recently Files Portlet not working on descramble portal

This is the exception in the Server's log
2015-08-03 09:15:32,530 INFO backend.DefaultMongoClient [TP-Processor5,... Massimiliano Assante

12:21 PM Incident #401: Tabular Data Manager Portlet allows to Share Tabular Data Resources with the whole set of portal users

Added code to retrieve (only) the users belonging to the organization read from (asl) session group
The fix has been... Francesco Mangiacrapa

11:56 AM Incident #401 (In Progress): Tabular Data Manager Portlet allows to Share Tabular Data Resources with the whole set of portal users

Francesco Mangiacrapa

11:47 AM Incident #401: Tabular Data Manager Portlet allows to Share Tabular Data Resources with the whole set of portal users

any update on this activity? This is an urgent matter Massimiliano Assante

11:48 AM Support #372 (Closed): Quality/Testing a.k.a. pre production Infrastructure request for creation

A new Sprint was created to track the activity https://support.d4science.org/versions/90
the ticket can be closed Massimiliano Assante

11:40 AM Task #451 (Rejected): New VO creation for preproduction

A brand new VO should be created under /d4science.org. The resources previously assigned to the Ecosystem VO should b... Massimiliano Assante

11:33 AM Task #450 (Closed): Dismiss Ecosystem VO and related services

The Ecosystem VO should be dismissed, the related VMs and services should be allocated for a new VO under the pre pro... Massimiliano Assante

11:31 AM Task #449 (Closed): New root VO creation for pre production

As a follow up of #372, a new root VO should be created with name "d4s" Massimiliano Assante

Jul 31, 2015

04:53 PM Support #430 (Closed): Handle special characters in Home Library

The bug has been fixed, using the correct Character Encoding and escaping the illegal JCR chars. While the node name ... Valentina Marioli

Jul 30, 2015

01:12 PM Task #169: Verification of the smartgears nodes list

tabulardata.d4science.org should appear in the right ganglia cluster soon.
I've removed ganglia from the other nod... Andrea Dell'Amico

12:51 PM Task #169: Verification of the smartgears nodes list

Roberto Cirillo wrote:
> The list of new workers defined in "host.smartgears" file is right
> But the list of old w... Andrea Dell'Amico

12:24 PM Task #169 (In Progress): Verification of the smartgears nodes list

The list of new workers defined in "host.smartgears" file is right
But the list of old workers defined in "host.prod... Roberto Cirillo

Jul 28, 2015

03:38 PM Support #430 (In Progress): Handle special characters in Home Library

Valentina Marioli

03:37 PM Support #430 (Closed): Handle special characters in Home Library

Home Library does not handle special characters in filenames. Valentina Marioli

02:30 PM Task #411 (Closed): New server for the new instance of PUMA

Andrea Dell'Amico

Jul 27, 2015

06:00 PM Task #422: Report libraries and configuration components for DataMiner

I forgot to indicate that there is required software to be installed on the machine to run all the algorithms.
This... Gianpaolo Coro

03:27 PM Task #422: Report libraries and configuration components for DataMiner

The installation instructions with a "related links" section is available at this address (linked by the Admin guide ... Gianpaolo Coro

02:36 PM Task #422: Report libraries and configuration components for DataMiner

Can you add those instructions also on the gCube Admin guide? Pasquale Pagano

02:22 PM Task #422 (In Progress): Report libraries and configuration components for DataMiner

Here I report the passages required to build a fully working development-environment DataMiner installation from scra... Gianpaolo Coro

02:38 PM Support #372: Quality/Testing a.k.a. pre production Infrastructure request for creation

Yes, I think you can plan this activity with Roberto. I suggest to look at the development servers no longer used als... Pasquale Pagano

02:31 PM Task #293: Make any Liferay user to access Redmine (through LDAP Credentials)

Yes, I think so. Pasquale Pagano

01:46 PM Task #293: Make any Liferay user to access Redmine (through LDAP Credentials)

May I remove those four users from redmine?
Andrea Dell'Amico

Jul 24, 2015

04:12 PM Incident #425 (Closed): Species Discovery Portlet loop infinitely when an error occurs in the service

The patched portlet seems work fine on i-marine and services.d4science Francesco Mangiacrapa

02:58 PM Incident #425 (Feedback): Species Discovery Portlet loop infinitely when an error occurs in the service

the patched portlet was hot deployed on production on bot i-marine and services portals, please test it and if everyt... Massimiliano Assante

02:54 PM Incident #425 (In Progress): Species Discovery Portlet loop infinitely when an error occurs in the service

The problem is due to Result Set disposed. The exception is generated by ResultsetStream in case of reading timeout o... Francesco Mangiacrapa

12:48 PM Incident #425: Species Discovery Portlet loop infinitely when an error occurs in the service

this issue must be resolved asap Massimiliano Assante

03:35 PM Task #184: Ganglia monitoring, gCore based category: upgrade the VM running unsupported distributions

Roberto Cirillo wrote:
> In this list there is a set of VMs with an OS (ubuntu 8.04 or 121.04) that are not supporte... Andrea Dell'Amico

03:30 PM Task #374 (Closed): Clone of node76.p.d4science.research-infrastructures.eu

Andrea Dell'Amico

12:26 PM Task #374: Clone of node76.p.d4science.research-infrastructures.eu

is this activity complete? Massimiliano Assante

03:23 PM Incident #414 (Closed): services.d4science cannot connect to pop3 isti sometimes

Andrea Dell'Amico

03:22 PM Task #293: Make any Liferay user to access Redmine (through LDAP Credentials)

If they are present in one of the portals, maybe they were imported in one of the early ldap tests: the redmine ldap ... Andrea Dell'Amico

02:12 PM Task #293: Make any Liferay user to access Redmine (through LDAP Credentials)

sorry Andrea, if None of the four users is present in any of the LDAP servers how can they be in Redmine? Massimiliano Assante

01:10 PM Task #293 (Feedback): Make any Liferay user to access Redmine (through LDAP Credentials)

I've checked the four users that are currently locked. None of them is present in any of the ldap servers.
`statis... Andrea Dell'Amico

01:43 PM Task #404 (Closed): Configure JackRabbit with a reverse proxy over ssl

The portals are still working correctly. This ticket can be closed. Valentina Marioli

01:00 PM Task #404: Configure JackRabbit with a reverse proxy over ssl

Valentina che you please provide feedback con this? Massimiliano Assante

01:38 PM Task #85: Deploy wikimedia on wiki.gcube-system.org and wiki.d4science.org

I see 4 different wiki database dumps:
~~~
d4s2-gcube-wiki.sql
d4s2-infrastructure-wiki.sql
d4s2-networking-wik... Andrea Dell'Amico

01:26 PM Incident #258: TabMan - the files associated to the resources are downloaded without extension

The images now work, but I see problems in other kinds of files:
String results are reported with a generic STRING n... Gianpaolo Coro

12:58 PM Incident #258 (Feedback): TabMan - the files associated to the resources are downloaded without extension

Gianpaolo can you please verify that this incident was fixed in production after the rollout of 3.8.0?
Massimiliano Assante

12:55 PM Support #372: Quality/Testing a.k.a. pre production Infrastructure request for creation

Lino I think we can we start the planning of this activity, should we proceed to create tickets and involve the neces... Massimiliano Assante

12:50 PM Task #150: Add nagios check for sp.d4science.org tomcat

do we have the check? Massimiliano Assante

12:49 PM Task #290 (Closed): Update D4Science Org Website Empowering Section with new projects served by the Infrastructure

it is ok Massimiliano Assante

12:48 PM Task #413 (Closed): increase session timeout to 6 hours for Redmine D4Science

it works Massimiliano Assante

12:34 PM Task #149: Add nagios check for www.d4science.org and www.gcube-system.org websites

Not yet. I plan to complete all the tasks regarding nagios checks before going on vacation (the last two weeks of aug... Andrea Dell'Amico

12:28 PM Task #149: Add nagios check for www.d4science.org and www.gcube-system.org websites

do we have these checks? Massimiliano Assante

12:27 PM Task #390 (Closed): Deploy VRE-Modeler service on Ecosystem VO

Massimiliano Assante