D4science

Aug 12, 2015

06:26 PM D4Science Infrastructure Task #487 (Closed): Nagios monitoring of the ganeti services

We need to monitor the ganeti cluster services, and the DRBD replica state.
Some links:
> http://docs.ganeti.or... Andrea Dell'Amico

06:22 PM D4Science Infrastructure Task #484 (Closed): Add new hypervisors to the ganeti cluster

Andrea Dell'Amico

06:22 PM D4Science Infrastructure Task #484 (In Progress): Add new hypervisors to the ganeti cluster

All the tasks are complete. Andrea Dell'Amico

06:18 PM D4Science Infrastructure Task #484 (Closed): Add new hypervisors to the ganeti cluster

dlib12x and dlib13x can be added to the ganeti cluster already
Andrea Dell'Amico

06:22 PM D4Science Infrastructure Task #486 (Closed): Provision the new machines and add them to the cluster

The two hosts are now part of the ganeti cluster Andrea Dell'Amico

06:21 PM D4Science Infrastructure Task #486 (In Progress): Provision the new machines and add them to the cluster

Andrea Dell'Amico

06:20 PM D4Science Infrastructure Task #486 (Closed): Provision the new machines and add them to the cluster

Modify the xen playbook accordingly.
Andrea Dell'Amico

06:21 PM D4Science Infrastructure Task #485 (Closed): Reinstall dlib12x and dlib13x

Andrea Dell'Amico

06:21 PM D4Science Infrastructure Task #485 (In Progress): Reinstall dlib12x and dlib13x

@tommaso.piccioli installed both of them.
Andrea Dell'Amico

06:19 PM D4Science Infrastructure Task #485 (Closed): Reinstall dlib12x and dlib13x

debian 7, the same version of the other cluster nodes. Andrea Dell'Amico

06:12 PM D4Science Infrastructure Task #483 (Rejected): Add iptables rules to the backup server

Install firewall rules on both servers.
Andrea Dell'Amico

04:58 PM D4Science Infrastructure Support #478 (Closed): Sprint Creation on Parthenos Issue Tracker

Andrea Dell'Amico

11:37 AM D4Science Infrastructure Incident #482 (In Progress): GARR-CERT-16H1208 Unrestricted elasticsearch server access on node13.p.d4science.research-infrastructures.eu

I see that it's an index service that runs on a tomcat instance listening on port 8080. The webapp includes the ela... Andrea Dell'Amico

11:32 AM D4Science Infrastructure Incident #482 (Closed): GARR-CERT-16H1208 Unrestricted elasticsearch server access on node13.p.d4science.research-infrastructures.eu

GARR-CERT reports that node13.p.d4science.research-infrastructures.eu has an elasticsearch instance main port open to... Andrea Dell'Amico

Aug 07, 2015

06:52 PM D4Science Infrastructure Task #470 (In Progress): Install the new hypervisor server

Andrea Dell'Amico

Aug 06, 2015

06:10 PM D4Science Infrastructure Support #478 (Feedback): Sprint Creation on Parthenos Issue Tracker

Done Andrea Dell'Amico

03:34 PM D4Science Infrastructure Support #478 (In Progress): Sprint Creation on Parthenos Issue Tracker

New sprints can be added by users that have a `manager` status or by the administrators.
Let me know if Matteo Loren... Andrea Dell'Amico

02:01 PM D4Science Infrastructure Task #85: Deploy wikimedia on wiki.gcube-system.org and wiki.d4science.org

Authentication is now working
Andrea Dell'Amico

Aug 05, 2015

07:09 PM D4Science Infrastructure Task #85: Deploy wikimedia on wiki.gcube-system.org and wiki.d4science.org

wiki.gcube-system.org is up and, updated to the latest mediawiki distribution.
The authentication doesn't work yet... Andrea Dell'Amico

12:55 PM D4Science Infrastructure Task #85: Deploy wikimedia on wiki.gcube-system.org and wiki.d4science.org

I've mostly managed the configuration for the gcube wiki. I'm now going to import the latest backup.
Andrea Dell'Amico

12:55 PM D4Science Infrastructure Task #87 (Closed): Make new gCube and D4Science wiki available only on https

https is working correctly. The http accesses are redirected over https. Andrea Dell'Amico

Aug 04, 2015

06:52 PM D4Science Infrastructure Task #472 (Closed): Move the VMs from the 'OpenStack servers' to the new hypervisor

Move all the VMs hosted on the servers that will run OpenStack on the new hypervisor Andrea Dell'Amico

06:51 PM D4Science Infrastructure Task #471 (Closed): Locate the hypervisors to dedicate to OpenStack

There are some candidates in the mid range group of servers.
Andrea Dell'Amico

06:29 PM D4Science Infrastructure Task #470 (Closed): Install the new hypervisor server

dlib28-dom0.d4science.org?
We can stay with debian 7, it's tested and when we will convert to OpenStack another di... Andrea Dell'Amico

06:24 PM D4Science Infrastructure Task #469 (Closed): Move some VMs to the new hypervisor to set some servers free and usable to experiment with OpenStack

We need some servers to start working with OpenStack. Some middle sized ones can be used.
Andrea Dell'Amico

05:21 PM D4Science Infrastructure Task #462 (Closed): X.509 certificates for the two backup servers

New hostnames?
backup1.d4science.org
backup2.d4science.org
? Andrea Dell'Amico

05:19 PM D4Science Infrastructure Task #461 (Closed): Nagios and ganglia monitoring for the backup servers

Monitor both the servers with nagios and ganglia.
Andrea Dell'Amico

05:18 PM D4Science Infrastructure Task #460 (Closed): Upgrade the old backup server

Upgrade the OS to be in line with the one on the new server Andrea Dell'Amico

05:15 PM D4Science Infrastructure Task #459: Install and configure backuppc

This can be partially done by an ansible playbook.
Let's remember to use the same private ssh key that is used by ... Andrea Dell'Amico

05:15 PM D4Science Infrastructure Task #459 (Closed): Install and configure backuppc

Configure backuppc on the backup server so that the load is balanced between the two nodes.
Andrea Dell'Amico

05:13 PM D4Science Infrastructure Task #458 (Closed): Reinstall dlibsan1 as the new backup server

debian 8 (the actual backup server is running debian) or Ubuntu?
Use 4 (6?) discs from the new batch Andrea Dell'Amico

05:02 PM D4Science Infrastructure Task #457 (Closed): A new backup server

We need a new backup server that will run in parallel to the old one to share the load Andrea Dell'Amico

04:32 PM D4Science Infrastructure Task #272 (Closed): Enabling Secure Connections to node11.d.d4science.research-infrastructures.eu

Andrea Dell'Amico

04:26 PM D4Science Infrastructure Task #169 (Closed): Verification of the smartgears nodes list

Andrea Dell'Amico

Aug 03, 2015

06:04 PM D4Science Infrastructure Task #85: Deploy wikimedia on wiki.gcube-system.org and wiki.d4science.org

I managed to import the gcube-system wiki database and let the wiki configuration load the main Gcube wiki only. The ... Andrea Dell'Amico

06:01 PM D4Science Infrastructure Task #85: Deploy wikimedia on wiki.gcube-system.org and wiki.d4science.org

A recap from the mail thread.
The wiki.gcube-system.org wiki will be this one: [[https://gcube.wiki.gcube-system.o... Andrea Dell'Amico

Jul 30, 2015

01:12 PM D4Science Infrastructure Task #169: Verification of the smartgears nodes list

tabulardata.d4science.org should appear in the right ganglia cluster soon.
I've removed ganglia from the other nod... Andrea Dell'Amico

12:51 PM D4Science Infrastructure Task #169: Verification of the smartgears nodes list

Roberto Cirillo wrote:
> The list of new workers defined in "host.smartgears" file is right
> But the list of old w... Andrea Dell'Amico

Jul 28, 2015

02:30 PM D4Science Infrastructure Task #411 (Closed): New server for the new instance of PUMA

Andrea Dell'Amico

Jul 27, 2015

01:46 PM D4Science Infrastructure Task #293: Make any Liferay user to access Redmine (through LDAP Credentials)

May I remove those four users from redmine?
Andrea Dell'Amico

Jul 24, 2015

03:35 PM D4Science Infrastructure Task #184: Ganglia monitoring, gCore based category: upgrade the VM running unsupported distributions

Roberto Cirillo wrote:
> In this list there is a set of VMs with an OS (ubuntu 8.04 or 121.04) that are not supporte... Andrea Dell'Amico

03:30 PM D4Science Infrastructure Task #374 (Closed): Clone of node76.p.d4science.research-infrastructures.eu

Andrea Dell'Amico

03:23 PM D4Science Infrastructure Incident #414 (Closed): services.d4science cannot connect to pop3 isti sometimes

Andrea Dell'Amico

03:22 PM D4Science Infrastructure Task #293: Make any Liferay user to access Redmine (through LDAP Credentials)

If they are present in one of the portals, maybe they were imported in one of the early ldap tests: the redmine ldap ... Andrea Dell'Amico

01:10 PM D4Science Infrastructure Task #293 (Feedback): Make any Liferay user to access Redmine (through LDAP Credentials)

I've checked the four users that are currently locked. None of them is present in any of the ldap servers.
`statis... Andrea Dell'Amico

01:38 PM D4Science Infrastructure Task #85: Deploy wikimedia on wiki.gcube-system.org and wiki.d4science.org

I see 4 different wiki database dumps:
~~~
d4s2-gcube-wiki.sql
d4s2-infrastructure-wiki.sql
d4s2-networking-wik... Andrea Dell'Amico

12:34 PM D4Science Infrastructure Task #149: Add nagios check for www.d4science.org and www.gcube-system.org websites

Not yet. I plan to complete all the tasks regarding nagios checks before going on vacation (the last two weeks of aug... Andrea Dell'Amico

Jul 23, 2015

07:31 PM D4Science Infrastructure Task #411 (Feedback): New server for the new instance of PUMA

The machine is running.
There are two tomcat instances, one listening on 8080 and the solr one listening on port 898... Andrea Dell'Amico

11:15 AM D4Science Infrastructure Task #411: New server for the new instance of PUMA

The machine is not ready yet.
Ok 'is' for the dnet instance. Can I use '/solr' as the /solr context?
Andrea Dell'Amico

06:45 PM D4Science Infrastructure Task #293: Make any Liferay user to access Redmine (through LDAP Credentials)

Pasquale Pagano wrote:
> are the emails actual emails?
Their syntax is valid.
Andrea Dell'Amico

11:14 AM D4Science Infrastructure Task #293: Make any Liferay user to access Redmine (through LDAP Credentials)

They are the same 4 users that I unlocked myself yesterday evening. Y'll try to understand what's wrong with them.
Andrea Dell'Amico

05:13 PM D4Science Infrastructure Task #413 (Feedback): increase session timeout to 6 hours for Redmine D4Science

Andrea Dell'Amico

05:13 PM D4Science Infrastructure Task #413 (In Progress): increase session timeout to 6 hours for Redmine D4Science

I changed the inactivity timeout to 8 hours and the maximum session timeout to 7 days Andrea Dell'Amico

05:09 PM D4Science Infrastructure Support #306 (Closed): Install additional R packages on the Worker nodes to support IRD - IFREMER computations

Andrea Dell'Amico

05:05 PM D4Science Infrastructure Incident #414 (Feedback): services.d4science cannot connect to pop3 isti sometimes

Andrea Dell'Amico

05:05 PM D4Science Infrastructure Incident #414: services.d4science cannot connect to pop3 isti sometimes

I put the file on every machine you listed. The java options to add to the tomcat startup are:
~~~
-Djavax.net.ss... Andrea Dell'Amico

04:46 PM D4Science Infrastructure Incident #414: services.d4science cannot connect to pop3 isti sometimes

I've added the modified cacerts file. The password is still the default one. Andrea Dell'Amico

03:18 PM D4Science Infrastructure Incident #414 (In Progress): services.d4science cannot connect to pop3 isti sometimes

Give me a couple of hours and then you'll have your keyring.
Andrea Dell'Amico

02:42 PM D4Science Infrastructure Incident #414: services.d4science cannot connect to pop3 isti sometimes

One consideration, first: you should use a different keytool file, otherwise if (when) the jdk is upgraded you loose ... Andrea Dell'Amico

12:21 PM D4Science Infrastructure Incident #414: services.d4science cannot connect to pop3 isti sometimes

Massimiliano Assante wrote:
> I'm using pop.isti.cnr.it as hostname, if I understand changing the hostname to mx.ist... Andrea Dell'Amico

12:01 PM D4Science Infrastructure Incident #414: services.d4science cannot connect to pop3 isti sometimes

What hostname are you using to connect to the service? I see that pop.isti.cnr.it is the same host as mx.isti.cnr.it ... Andrea Dell'Amico

Jul 22, 2015

07:43 PM D4Science Infrastructure Task #411: New server for the new instance of PUMA

Do we know the application contexts yet? So that I can configure the reverse proxy?
Andrea Dell'Amico

07:27 PM D4Science Infrastructure Task #411 (In Progress): New server for the new instance of PUMA

We are going to dismiss the research-infrastructures.eu domain and we are not using subzones anymore if they are not ... Andrea Dell'Amico

07:24 PM D4Science Infrastructure Task #293: Make any Liferay user to access Redmine (through LDAP Credentials)

I see that all the users but four where already been unlocked.
From what I'm reading on the ldap sync plugin sources... Andrea Dell'Amico

05:38 PM D4Science Infrastructure Task #293: Make any Liferay user to access Redmine (through LDAP Credentials)

Massimiliano Assante wrote:
> Thanks Andrea, as a Redmine admin now I can unlock the users. however since they are 3... Andrea Dell'Amico

05:06 PM D4Science Infrastructure Task #293: Make any Liferay user to access Redmine (through LDAP Credentials)

Users that are present in the ldap server but did not try to access to redmine yet are in 'locked' state. They are vi... Andrea Dell'Amico

06:11 PM D4Science Infrastructure Task #413: increase session timeout to 6 hours for Redmine D4Science

Session lifetime and session idle timeout are both disabled: https://support.d4science.org/settings?tab=authenticatio... Andrea Dell'Amico

05:54 PM D4Science Infrastructure Task #404 (Feedback): Configure JackRabbit with a reverse proxy over ssl

The iptables rules are now active. Let me know if the portals still work correctly.
Andrea Dell'Amico

05:24 PM D4Science Infrastructure Support #353 (Feedback): Uri resolver: URL_REWRITE for data.d4science.org

The new rewrite rules are:
RewriteEngine on
#RewriteLog ${APACHE_LOG_DIR}/rewrite.log
#RewriteLogLevel... Andrea Dell'Amico

Jul 21, 2015

08:58 PM D4Science Infrastructure Task #405 (Closed): Replace workspace-repository-dev.research-infrastructures.eu with ws-repo-test.d4science.org?

The old dev VM is very different to the production one.
So it could be replaced with the newer machine created to te... Andrea Dell'Amico

08:55 PM D4Science Infrastructure Task #404 (In Progress): Configure JackRabbit with a reverse proxy over ssl

The web proxy is active.
It was not possible to close the tomcat http port because the portal servers need to talk w... Andrea Dell'Amico

08:53 PM D4Science Infrastructure Task #404 (Closed): Configure JackRabbit with a reverse proxy over ssl

* An apache webserver configured as reverse proxy needs to be configured
* A valid x509 certificate for workspace-re... Andrea Dell'Amico

08:19 PM D4Science Infrastructure Task #293: Make any Liferay user to access Redmine (through LDAP Credentials)

Massimiliano Assante wrote:
> Just found out the LDAP instance syncs with Redmine every 30 minutes, if this can't be... Andrea Dell'Amico

08:12 PM D4Science Infrastructure Task #293 (Feedback): Make any Liferay user to access Redmine (through LDAP Credentials)

The authentication against the second ldap server is now working. There was a problem with the ACLs that is now fixed.
Andrea Dell'Amico

08:10 PM D4Science Infrastructure Support #397 (In Progress): Export Liferay Portal users to LDAP

One small quirk:
the main ldap server uses 'givenName' for the First name, 'cn:' for "first name last name', 'sn' fo... Andrea Dell'Amico

04:02 PM D4Science Infrastructure Support #353 (In Progress): Uri resolver: URL_REWRITE for data.d4science.org

Andrea Dell'Amico

02:20 PM D4Science Infrastructure Task #100: Increase ram Memory on IS-Collector services in production

News: dlib18.isti.cnr.it is monitor.d4science.research-infrastructures.eu. It cannot be dismissed, so I moved it to... Andrea Dell'Amico

11:44 AM D4Science Infrastructure Task #100 (Closed): Increase ram Memory on IS-Collector services in production

dlib18.isti.cnr.it has been shut down. The disks are still there and the VM definition is under /etc/xen/disabled (on... Andrea Dell'Amico

Jul 20, 2015

08:17 PM D4Science Infrastructure Task #297 (Closed): New ldap instance

Andrea Dell'Amico

08:17 PM D4Science Infrastructure Task #100: Increase ram Memory on IS-Collector services in production

* Shutdown dlib18.isti.cnr.it so that there's no need to move node1.p.d4science.research-infrastructures.eu to anothe... Andrea Dell'Amico