D4science

May 03, 2018

06:19 PM D4Science Infrastructure Support #11560: Remove old CDH 5.9 Cluster

Also the Hortonworks cluster should be dismissed. @michele.debonis@isti.cnr.it would you comment here when we are rea... Andrea Dell'Amico

03:39 PM D4Science Infrastructure Task #11728: Ubuntu 16.04 needs some fixes on the nagios checks and the ntp configuration

The ntp configuration has been fixed too. Andrea Dell'Amico

12:28 PM D4Science Infrastructure Task #11728: Ubuntu 16.04 needs some fixes on the nagios checks and the ntp configuration

The check_memory now is handled. On Ubuntu 16.04 a fixed version is installed and used by nrpe.
Andrea Dell'Amico

12:14 PM D4Science Infrastructure Task #11728 (In Progress): Ubuntu 16.04 needs some fixes on the nagios checks and the ntp configuration

Andrea Dell'Amico

11:46 AM D4Science Infrastructure Task #11728 (Closed): Ubuntu 16.04 needs some fixes on the nagios checks and the ntp configuration

* The NTP configuration is more restrictive than in the previous distribution versions, so an explicit configuratio... Andrea Dell'Amico

May 02, 2018

08:57 PM D4Science Infrastructure Task #11396: Move the VM hosted on the Ganeti cluster to the oVirt cluster

gw1.d4science.org has been created on the ovirt cluster. Andrea Dell'Amico

06:50 PM D4Science Infrastructure Task #11396 (In Progress): Move the VM hosted on the Ganeti cluster to the oVirt cluster

Andrea Dell'Amico

06:49 PM D4Science Infrastructure Task #11396: Move the VM hosted on the Ganeti cluster to the oVirt cluster

The transition of gw2.d4science.org went well. I've found a couple of parameters that needed a refinement, I've commi... Andrea Dell'Amico

07:08 PM D4Science Infrastructure Task #11709: Post configuration of the oVirt manager

I've temporary created the host template.d4science.org with IP 146.48.123.174 to setup a VM that will be used to crea... Andrea Dell'Amico

05:21 PM D4Science Infrastructure Task #11709: Post configuration of the oVirt manager

The already available templates for the virtual machines need some refinement. I'm going to create a new template for... Andrea Dell'Amico

05:21 PM D4Science Infrastructure Task #11709: Post configuration of the oVirt manager

The firewalld related ansible tasks must be the equivalent of the following commands:
~~~
firewall-cmd --zone=pub... Andrea Dell'Amico

05:20 PM D4Science Infrastructure Task #10988 (Closed): Install oVirt on dlib14x-19x

This can be closed, the remaining tasks pertain to #11709 Andrea Dell'Amico

05:16 PM D4Science Infrastructure Task #10988: Install oVirt on dlib14x-19x

The already available templates for the virtual machines need some refinement. I'm going to create a new template for... Andrea Dell'Amico

12:15 PM D4Science Infrastructure Task #11717: please enable context "well-being" to exploratories.d4science.org

You have to create it under `/usr/share/nginx/html/`
I could move that directory under `/home/gcube` but I think th... Andrea Dell'Amico

11:59 AM D4Science Infrastructure Task #11717 (Feedback): please enable context "well-being" to exploratories.d4science.org

Andrea Dell'Amico

11:58 AM D4Science Infrastructure Task #11717 (In Progress): please enable context "well-being" to exploratories.d4science.org

The `/usr/share/nginx/html/` is now writeable by the gcube user. It's the web server document root, so you must creat... Andrea Dell'Amico

11:45 AM D4Science Infrastructure Task #11717: please enable context "well-being" to exploratories.d4science.org

We are talking about static content, right?
Andrea Dell'Amico

11:59 AM D4Science Infrastructure Task #11718 (Feedback): please enable context "sports-analytics" to exploratories.d4science.org

Andrea Dell'Amico

11:59 AM D4Science Infrastructure Task #11718 (In Progress): please enable context "sports-analytics" to exploratories.d4science.org

The `/usr/share/nginx/html/` is now writeable by the gcube user. It's the web server document root, so you must creat... Andrea Dell'Amico

11:17 AM D4Science Infrastructure Support #11706: Bulk addition of users to VRE

From here: https://services.d4science.org/group/dnet/add-existing-users Andrea Dell'Amico

Apr 30, 2018

04:58 PM D4Science Infrastructure Task #11709 (Closed): Post configuration of the oVirt manager

* Install the ansible tasks that customise the hypervisor firewall
* Customise the ovirtmanager firewall in the same... Andrea Dell'Amico

Apr 24, 2018

07:24 PM D4Science Infrastructure Task #11700 (Closed): DataMiner - check svn status on Production

I forced a `chown -R gcube:gcube /home/gcube/wps_algorithms/algorithms` on all the production dataminers. Andrea Dell'Amico

07:18 PM D4Science Infrastructure Task #11700: DataMiner - check svn status on Production

The provisioning of that part always happens as `gcube` user. The relevant tasks are:
~~~
- block:
- name: Ins... Andrea Dell'Amico

06:11 PM D4Science Infrastructure Task #11700 (Closed): DataMiner - check svn status on Production

Someone operated the svn repository as root - again - on that dataminer:
~~~
ls -la /home/gcube/wps_algorithms/al... Andrea Dell'Amico

Apr 23, 2018

12:51 PM D4Science Infrastructure Task #11676 (Closed): Destroy the old generic workers dataminer instances and 5 dataminers in the CT GARR region.

The old genericworkers have been destroyed. Andrea Dell'Amico

12:49 PM D4Science Infrastructure VM Creation #11673 (Closed): Create 15 dataminer instances in the PA GARR region

As I received no feedback, I assume that the instances are working correctly. Andrea Dell'Amico

Apr 20, 2018

05:33 PM D4Science Infrastructure VM Creation #11673 (Feedback): Create 15 dataminer instances in the PA GARR region

Andrea Dell'Amico

05:32 PM D4Science Infrastructure VM Creation #11673: Create 15 dataminer instances in the PA GARR region

Done. Andrea Dell'Amico

04:09 PM D4Science Infrastructure VM Creation #11673: Create 15 dataminer instances in the PA GARR region

I'm recycling 5 current dataminer at garr-ct1:
~~~
ip-90-147-166-24.ct1.garrservices.it hostname=ip-90-147-166-24... Andrea Dell'Amico

03:02 PM D4Science Infrastructure VM Creation #11673: Create 15 dataminer instances in the PA GARR region

Done. The active genericworkers are now the newly created 10 dataminers on garr-pa1. If there are no objections I'm g... Andrea Dell'Amico

02:55 PM D4Science Infrastructure VM Creation #11673: Create 15 dataminer instances in the PA GARR region

As the tests on the proto generic workers passed, I'm going to replace the current generic workers with those new one... Andrea Dell'Amico

04:00 PM D4Science Infrastructure Task #11676: Destroy the old generic workers dataminer instances and 5 dataminers in the CT GARR region.

Instead of destroying the 5 garr-ct1 instances to create another 5 ones, I'm going to install the jar file that sets ... Andrea Dell'Amico

03:53 PM D4Science Infrastructure Task #11676: Destroy the old generic workers dataminer instances and 5 dataminers in the CT GARR region.

I shut down the old GARR genericworkers. The instances will be definitely removed when I'll have the confirmation tha... Andrea Dell'Amico

03:26 PM D4Science Infrastructure Task #11676 (In Progress): Destroy the old generic workers dataminer instances and 5 dataminers in the CT GARR region.

dataminer3-genericworkers.d4science.org can be dismissed.
Andrea Dell'Amico

02:54 PM D4Science Infrastructure VM Creation #11671: Create 6 dataminer instances that will behave as generic workers

Thanks. Would you open a task that has the goal of automating these tests? I hope to be able to create regular images... Andrea Dell'Amico

Apr 19, 2018

11:10 PM D4Science Infrastructure VM Creation #11673: Create 15 dataminer instances in the PA GARR region

The 10 dataminer are ready. When we have the confirm that the proto ones are good, I'll add to the load balancer and ... Andrea Dell'Amico

05:13 PM D4Science Infrastructure VM Creation #11673: Create 15 dataminer instances in the PA GARR region

I'm having some dns-related failures on the GARR nodes, some hosts aren't completely deployed yet.
Andrea Dell'Amico

01:35 PM D4Science Infrastructure VM Creation #11673: Create 15 dataminer instances in the PA GARR region

The provisioning is running. Andrea Dell'Amico

04:37 PM D4Science Infrastructure VM Creation #11671: Create 6 dataminer instances that will behave as generic workers

Done. Andrea Dell'Amico

04:29 PM D4Science Infrastructure VM Creation #11671: Create 6 dataminer instances that will behave as generic workers

Gianpaolo Coro wrote:
> OK, great! I will do user tests just after automatic tests are passed.
>
> @lucio.lelii@... Andrea Dell'Amico

04:20 PM D4Science Infrastructure VM Creation #11671 (Feedback): Create 6 dataminer instances that will behave as generic workers

OK. I changed the jar files, the VM are restarting. Does some test exist, or I'm supposed to put them into the haprox... Andrea Dell'Amico

02:06 PM D4Science Infrastructure VM Creation #11671: Create 6 dataminer instances that will behave as generic workers

I just opened the `dataminer-1.5.3-4.12.0-164695.jar` file and `templates/setup.cfg` has `maxcomputations=4`. @lucio.... Andrea Dell'Amico

Apr 18, 2018

07:20 PM D4Science Infrastructure VM Creation #11673: Create 15 dataminer instances in the PA GARR region

We do not have enough resources in the PA region for 15 instances. I'm activating 10 instances, 5 more can be activat... Andrea Dell'Amico

07:05 PM D4Science Infrastructure VM Creation #11673 (In Progress): Create 15 dataminer instances in the PA GARR region

Andrea Dell'Amico

02:21 PM D4Science Infrastructure VM Creation #11673 (Closed): Create 15 dataminer instances in the PA GARR region

To be used as generic workers Andrea Dell'Amico

06:51 PM D4Science Infrastructure VM Creation #11671: Create 6 dataminer instances that will behave as generic workers

I was ready to change the dataminer jar, but the dataminer war that was just installed report a different jar file. T... Andrea Dell'Amico

03:41 PM D4Science Infrastructure VM Creation #11671: Create 6 dataminer instances that will behave as generic workers

The VMs have been created, provisioning is running.
Andrea Dell'Amico

02:59 PM D4Science Infrastructure VM Creation #11671: Create 6 dataminer instances that will behave as generic workers

dataminer0-gw-proto.d4science.org 146.48.123.167
dataminer1-gw-proto.d4science.org 146.48.123.168
dataminer2-gw-pro... Andrea Dell'Amico

02:51 PM D4Science Infrastructure VM Creation #11671 (In Progress): Create 6 dataminer instances that will behave as generic workers

Andrea Dell'Amico

12:59 PM D4Science Infrastructure VM Creation #11671 (Closed): Create 6 dataminer instances that will behave as generic workers

They have to run on the GARR hypervisors because of the memory requirements. Andrea Dell'Amico

03:10 PM D4Science Infrastructure Task #11639: Add to the DM Proto cluster at least three new DM instances

Pasquale Pagano wrote:
> people more informed than me can explain better.
>
> What I understood is that we need ... Andrea Dell'Amico

02:42 PM D4Science Infrastructure Task #11639: Add to the DM Proto cluster at least three new DM instances

Pasquale Pagano wrote:
> what do you mean?
> The proxies will provide access to a static set of servers.
I did ... Andrea Dell'Amico

12:50 PM D4Science Infrastructure Task #11639 (In Progress): Add to the DM Proto cluster at least three new DM instances

Gianpaolo Coro wrote:
> In a meeting today we have agreed to have the following configurations:
>
> 2 - there wil... Andrea Dell'Amico

02:34 PM D4Science Infrastructure Task #11676 (Closed): Destroy the old generic workers dataminer instances and 5 dataminers in the CT GARR region.

To be dismissed:
* The old proto generic worker, dataminer3-genericworkers.d4science.org
* The GARR genericworker... Andrea Dell'Amico

02:17 PM D4Science Infrastructure Task #10988: Install oVirt on dlib14x-19x

due to changes in a related task Andrea Dell'Amico

02:17 PM D4Science Infrastructure Task #10240: Install a modern virtualisation framework to host the 'corporate' services

due to changes in a related task Andrea Dell'Amico

01:00 PM D4Science Infrastructure Task #10240: Install a modern virtualisation framework to host the 'corporate' services

due to changes in a related task Andrea Dell'Amico

11:55 AM D4Science Infrastructure Task #11664 (Closed): Add ALIAS to nlp-d.dev.d4science.org and nlp-hub-d.dev.d4science.org

After I confirm the change in the DNS management interface there's nothing I can do. You have to wait for the DNS zon... Andrea Dell'Amico

Apr 17, 2018

07:41 PM D4Science Infrastructure Task #11664 (Closed): Add ALIAS to nlp-d.dev.d4science.org and nlp-hub-d.dev.d4science.org

The CNAMEs have been created.
Andrea Dell'Amico

07:38 PM D4Science Infrastructure Task #11664 (In Progress): Add ALIAS to nlp-d.dev.d4science.org and nlp-hub-d.dev.d4science.org

That's ugly. They were requested as dev VMs.
@roberto.cirillo@isti.cnr.it Please move them in the ansible invent... Andrea Dell'Amico

03:46 PM D4Science Infrastructure Support #11666 (Closed): nlp-d.dev.d4science.org: the tomcat doesn't start correctly

The interface went up correctly after a reboot. Andrea Dell'Amico

03:44 PM D4Science Infrastructure Support #11666: nlp-d.dev.d4science.org: the tomcat doesn't start correctly

The loopback interface was down, I don't know why.
I'm trying a reboot to verify that it starts correctly.
Andrea Dell'Amico

03:30 PM D4Science Infrastructure Support #11666 (In Progress): nlp-d.dev.d4science.org: the tomcat doesn't start correctly

Andrea Dell'Amico

Apr 16, 2018

07:55 PM D4Science Infrastructure VM Creation #11662: New development machine for NLP Hub

The VM is up, @roberto.cirillo@isti.cnr.it has root access. Andrea Dell'Amico

07:43 PM D4Science Infrastructure VM Creation #11662 (In Progress): New development machine for NLP Hub

hostname and IP address: nlp-d.dev.d4science.org. IN A 146.48.122.108
Andrea Dell'Amico

07:40 PM D4Science Infrastructure VM Creation #11662: New development machine for NLP Hub

What's a **proto** smartgears installation, anyway? Andrea Dell'Amico

07:52 PM ISTI Open Access Feature #11601: Migrate the OpenPortal services to production machines

@tommaso.piccioli@isti.cnr.it can answer. He knows better than me the hypervisors that could host the service (the sa... Andrea Dell'Amico

07:34 PM D4Science Infrastructure Task #10988: Install oVirt on dlib14x-19x

We have completed the storage setup, i guess we are ready to deploy virtual machines there.
Andrea Dell'Amico

04:19 PM D4Science Infrastructure Task #11659 (Closed): Please add nodes of workspace-repository on System Monitoring

Just added workspace-repository-prod1.d4science.org and workspace-repository-pg.d4science.org.
workspace-repository... Andrea Dell'Amico

04:17 PM D4Science Infrastructure Task #11659 (In Progress): Please add nodes of workspace-repository on System Monitoring

Andrea Dell'Amico

Apr 14, 2018

07:08 PM D4Science Infrastructure Task #11600 (Closed): Increase memory on ckan-solr-d4s.d4science.org (Solr indexes)

Done. The solr VM is now running with 6GB of RAM.
Andrea Dell'Amico

Apr 13, 2018

05:38 PM D4Science Infrastructure Task #11639: Add to the DM Proto cluster at least three new DM instances

Gianpaolo Coro wrote:
> 4 - the old GenericWorker will be replaced by multi-core DMs having internal jobs queue = 1
... Andrea Dell'Amico

01:05 PM D4Science Infrastructure Incident #11632 (Closed): orientdb01-d4s receives a huge number of connection

Done.
Can you share what the problem was?
Andrea Dell'Amico

Apr 12, 2018

08:50 PM D4Science Infrastructure Incident #11632: orientdb01-d4s receives a huge number of connection

I stopped the nagios check. The nagios check did not use any token btw, that URL should be public.
Andrea Dell'Amico

07:30 PM D4Science Infrastructure Incident #11632: orientdb01-d4s receives a huge number of connection

The check is currently failing with `connection reset by peer`, it's behaving this way since a couple of days.
Andrea Dell'Amico

07:27 PM D4Science Infrastructure Incident #11632: orientdb01-d4s receives a huge number of connection

It's the nagios check. I don't know how the connectios aren't closed, it's the same http call since months: orientdb... Andrea Dell'Amico

05:30 PM D4Science Infrastructure Support #11605: Set DataMiner queue length to 1

Gianpaolo Coro wrote:
> Thank you. Given the way people are going to use the services, I think we will need to have ... Andrea Dell'Amico

04:42 PM D4Science Infrastructure Support #11605: Set DataMiner queue length to 1

(rollback completed)
Andrea Dell'Amico

04:41 PM D4Science Infrastructure Support #11605: Set DataMiner queue length to 1

The rollback is running.
Gianpaolo Coro wrote:
> As I have discussed with Andrea, this patch should be rolled-bac... Andrea Dell'Amico

02:30 PM D4Science Infrastructure Support #11605 (Feedback): Set DataMiner queue length to 1

Done. Andrea Dell'Amico

02:19 PM D4Science Infrastructure Support #11605: Set DataMiner queue length to 1

The services in dev restarted correctly, I'm starting rolling out in production. Andrea Dell'Amico

01:01 PM D4Science Infrastructure Support #11605: Set DataMiner queue length to 1

Can anybody check dataminer1-d-d4s.d4science.org? If I do not hear anything back in an hour, I'll start updating the ... Andrea Dell'Amico

12:39 PM D4Science Infrastructure Support #11605 (In Progress): Set DataMiner queue length to 1

We have the artifact. I'm going to install it on the dev dataminers first.
Andrea Dell'Amico

02:38 PM D4Science Infrastructure Task #11368 (Closed): Recolecta VM

Andrea Dell'Amico

02:38 PM D4Science Infrastructure Task #11442 (Closed): Copy data_dir to new instances

Andrea Dell'Amico

02:38 PM D4Science Infrastructure Task #11522 (Closed): Provide a cronjob for removing old access.log files

Andrea Dell'Amico

02:37 PM D4Science Infrastructure Task #11446 (Closed): Update Development Geoserver to 2.10.5

Andrea Dell'Amico

02:35 PM D4Science Infrastructure VM Creation #11482 (Closed): Create a new ckan instance for BB catalogue: ckan-bb1.d4science.org

Andrea Dell'Amico

02:34 PM D4Science Infrastructure Task #6307: Migrate preproduction infrastructure nodes to Java 8

@roberto.cirillo@isti.cnr.it what't the preproduction status? Can we mark this task as done?
Andrea Dell'Amico

02:33 PM D4Science Infrastructure Task #6308 (Closed): Migrate production infrastructure nodes to Java 8

The migration is complete (since a while).
Andrea Dell'Amico

12:16 PM D4Science Infrastructure Task #11604 (Feedback): Please allow pc-frosini.isti.cnr.it to comunicate with ckan-d-d4s.d4science.org

Done. Andrea Dell'Amico

12:15 PM D4Science Infrastructure Task #11604 (In Progress): Please allow pc-frosini.isti.cnr.it to comunicate with ckan-d-d4s.d4science.org

Andrea Dell'Amico

Apr 11, 2018

06:17 PM ISTI Open Access Feature #11601: Migrate the OpenPortal services to production machines

There is also a solr instance.
Andrea Dell'Amico

04:20 PM D4Science Infrastructure Support #11605: Set DataMiner queue length to 1

Please let me know when it's ready and post the maven coordinates, so that I can put in place an ad hoc playbook. Andrea Dell'Amico

Apr 10, 2018

08:10 PM ISTI Open Access Feature #11601: Migrate the OpenPortal services to production machines

There's no difference between dev and production machines, but I agree that the hostname is misleading and it should ... Andrea Dell'Amico

08:06 PM D4Science Infrastructure Task #11586 (Closed): Please remove orientdb from startup services on orientdb02-d4s.d4science.org and orientdb03-d4s.d4science.org

Andrea Dell'Amico

08:06 PM D4Science Infrastructure Task #11586: Please remove orientdb from startup services on orientdb02-d4s.d4science.org and orientdb03-d4s.d4science.org

I changed the playbook and the inventory for the production orientdb servers so that the service on the the 02 and 03... Andrea Dell'Amico

07:40 PM D4Science Infrastructure Support #11605: Set DataMiner queue length to 1

Where is it?
~~~
root@dataminer1-d-d4s:/home/gcube/tomcat/webapps/wps# find . -name setup.cfg
root@dataminer1-d-... Andrea Dell'Amico

06:51 PM D4Science Infrastructure Task #10988: Install oVirt on dlib14x-19x

We abandoned the bond configuration on the dlib1[5:7]x servers and after that the setup went well.
And about the f... Andrea Dell'Amico

12:46 PM D4Science Infrastructure Task #11600: Increase memory on ckan-solr-d4s.d4science.org (Solr indexes)

I just freed some RAM on the hypervisor. @francesco.mangiacrapa@isti.cnr.it Let me know when I can restart the solr ... Andrea Dell'Amico

12:18 PM D4Science Infrastructure Task #11600 (In Progress): Increase memory on ckan-solr-d4s.d4science.org (Solr indexes)

I'm going to add 1GB anyway, but I first need to reclaim some space on the hypervisor. I can do it in the evening.
Andrea Dell'Amico

11:51 AM D4Science Infrastructure Task #11600: Increase memory on ckan-solr-d4s.d4science.org (Solr indexes)

The VM is using almost all the available RAM but barely any swap space, why are you asking for more memory? Andrea Dell'Amico

11:49 AM D4Science Infrastructure Task #11600: Increase memory on ckan-solr-d4s.d4science.org (Solr indexes)

You are talking about RAM, correct?
Andrea Dell'Amico

12:24 PM D4Science Infrastructure VM Creation #11492: Please create new VM for hosting Natural Language Processing (NLP) web applications: nlp.d4science.org

Massimiliano Assante wrote:
> Thanks, it works now. When is the SSL certificate (non self signed i mean) going to be... Andrea Dell'Amico

12:15 PM D4Science Infrastructure Support #11596 (Closed): CKAN BB1 Harvesting of GN iMarine failed: due to (DatabaseError) SSL SYSCALL error: EOF detect

The shared memory has been increased to 3GB.
Andrea Dell'Amico

12:07 PM D4Science Infrastructure Support #11596: CKAN BB1 Harvesting of GN iMarine failed: due to (DatabaseError) SSL SYSCALL error: EOF detect

postgres now is running with 8 GB of ram. For a better job we should also increase the shared memory, now.
Andrea Dell'Amico

11:39 AM D4Science Infrastructure Support #11596 (In Progress): CKAN BB1 Harvesting of GN iMarine failed: due to (DatabaseError) SSL SYSCALL error: EOF detect

The database is working, but last night it exhausted all the memory so some processes were killed by the OOM. We shou... Andrea Dell'Amico

11:45 AM D4Science Infrastructure Task #11595 (Feedback): Duplicated tokens on SmartGears/container.xml

Andrea Dell'Amico

11:45 AM D4Science Infrastructure Task #11595 (In Progress): Duplicated tokens on SmartGears/container.xml

It's a known effect of the changes on the script that manages the scopes. Until I find the time to completely rewrite... Andrea Dell'Amico

Apr 09, 2018

04:25 PM D4Science Infrastructure VM Creation #11492: Please create new VM for hosting Natural Language Processing (NLP) web applications: nlp.d4science.org

Done.
Andrea Dell'Amico

04:05 PM D4Science Infrastructure VM Creation #11492: Please create new VM for hosting Natural Language Processing (NLP) web applications: nlp.d4science.org

Yes, the DNS servers have problems updating zones to the outside since some weeks. Andrea Dell'Amico

03:56 PM D4Science Infrastructure VM Creation #11492 (Feedback): Please create new VM for hosting Natural Language Processing (NLP) web applications: nlp.d4science.org

The app has been deployed.
Andrea Dell'Amico

03:50 PM D4Science Infrastructure VM Creation #11492: Please create new VM for hosting Natural Language Processing (NLP) web applications: nlp.d4science.org

Ops. Yes. Andrea Dell'Amico

03:42 PM D4Science Infrastructure VM Creation #11492: Please create new VM for hosting Natural Language Processing (NLP) web applications: nlp.d4science.org

The answer when I run the playbook was:
~~~
*********************************************************************... Andrea Dell'Amico

03:03 PM D4Science Infrastructure VM Creation #11492: Please create new VM for hosting Natural Language Processing (NLP) web applications: nlp.d4science.org

@massimiliano.assante@isti.cnr.it let me know when it appears, all the other components have been installed.
Andrea Dell'Amico

02:58 PM D4Science Infrastructure VM Creation #11492: Please create new VM for hosting Natural Language Processing (NLP) web applications: nlp.d4science.org

There is no artifact:
~~~
root@ftp:/data/ftp/d4science/www# ls -la nlp
total 4
drwxr-xr-x 2 d4science d4scienc... Andrea Dell'Amico

02:26 PM D4Science Infrastructure VM Creation #11492 (In Progress): Please create new VM for hosting Natural Language Processing (NLP) web applications: nlp.d4science.org

hostname and IP address are going to be nlp.d4science.org 146.48.122.59 Andrea Dell'Amico

01:21 PM D4Science Infrastructure Task #11591 (Closed): Increase the disk space on ckan-pg-d4s.d4science.org

Also changed the backup script. Now the db list is generated ad each run.
Andrea Dell'Amico

12:01 PM D4Science Infrastructure Task #11591 (In Progress): Increase the disk space on ckan-pg-d4s.d4science.org

Added 50GB. Andrea Dell'Amico

11:59 AM D4Science Infrastructure Task #11591 (Closed): Increase the disk space on ckan-pg-d4s.d4science.org

And reconfigure the backup script to automatically scan the available databases. Andrea Dell'Amico

Apr 06, 2018

05:11 PM D4Science Infrastructure Task #10988: Install oVirt on dlib14x-19x

Another round: we've found a reliable way to configure the network interfaces on dlib1[4:7]x disabling the bonding on... Andrea Dell'Amico

04:02 PM D4Science Infrastructure Task #11574: Strange Error on parthenos resource-registry instance

Manually installed, or any wrong dependency?
Andrea Dell'Amico

03:36 PM D4Science Infrastructure VM Creation #11492: Please create new VM for hosting Natural Language Processing (NLP) web applications: nlp.d4science.org

I still need the application contexts and the scopes.
If you still want to install the applications manually, this o... Andrea Dell'Amico

Apr 05, 2018

05:24 PM D4Science Infrastructure Task #11579 (Closed): Split the dataminer playbook from the global smartgears one

Done.
I also removed the smartgears-node-upgrade.yml playbook, it's not needed anymore. Andrea Dell'Amico

04:42 PM D4Science Infrastructure Task #11579 (In Progress): Split the dataminer playbook from the global smartgears one

Andrea Dell'Amico

04:41 PM D4Science Infrastructure Task #11579 (Closed): Split the dataminer playbook from the global smartgears one

dataminer uses a lot of roles that slow down tha provisioning of the other smartgears services.
Andrea Dell'Amico

04:23 PM D4Science Infrastructure Incident #11570 (Closed): Algorithms installed in the last weeks are not working

Andrea Dell'Amico

03:09 PM D4Science Infrastructure Incident #11570: Algorithms installed in the last weeks are not working

I'm going to open a new ticket to list all the problems with the current implementation.
Andrea Dell'Amico

03:08 PM D4Science Infrastructure Incident #11570: Algorithms installed in the last weeks are not working

You missed the 15:00 cron job run by a minute, so I triggered a run of the script.
Andrea Dell'Amico

02:34 PM D4Science Infrastructure Incident #11570: Algorithms installed in the last weeks are not working

I confirm that svn must be updated to trigger the script execution. If it can't be done, I'm going to change the scri... Andrea Dell'Amico

02:26 PM D4Science Infrastructure Incident #11570 (Feedback): Algorithms installed in the last weeks are not working

I just talked with Lucio, FYI.
It's the file that lists the already installed algorithms, as the name suggests. Re... Andrea Dell'Amico

02:22 PM D4Science Infrastructure Incident #11570 (Feedback): Algorithms installed in the last weeks are not working

Andrea Dell'Amico

02:22 PM D4Science Infrastructure Incident #11570: Algorithms installed in the last weeks are not working

Removed the file and forced a run of `/usr/local/bin/algorithms-updater` on all the dev and preprod dataminers. The j... Andrea Dell'Amico

02:13 PM D4Science Infrastructure Incident #11570: Algorithms installed in the last weeks are not working

OK, I'm forcing the removal of `/home/gcube/wps_algorithms_install_log/already_installed_algorithms.txt`
Andrea Dell'Amico

01:54 PM D4Science Infrastructure Incident #11570: Algorithms installed in the last weeks are not working

Gianpaolo Coro wrote:
> These are the FACTS we should consider (I have done specific verification on dataminer3-prot... Andrea Dell'Amico

01:48 PM D4Science Infrastructure Incident #11570: Algorithms installed in the last weeks are not working

Giancarlo Panichi wrote:
> @lucio.lelii@isti.cnr.it , it may be necessary to move these files externally, and to eva... Andrea Dell'Amico

01:41 PM D4Science Infrastructure Incident #11570: Algorithms installed in the last weeks are not working

Giancarlo Panichi wrote:
> @andrea.dellamico@isti.cnr.it , when you update the DMs, you also install the algorithms ... Andrea Dell'Amico

12:24 PM D4Science Infrastructure Incident #11570: Algorithms installed in the last weeks are not working

Giancarlo Panichi wrote:
> @gianpaolo.coro@isti.cnr.it ,however there is something true in what you say given that n... Andrea Dell'Amico

11:59 AM D4Science Infrastructure Incident #11570: Algorithms installed in the last weeks are not working

Gianpaolo Coro wrote:
> If a new DM installation was done, the algorithms are erased and installed from scratch. Is... Andrea Dell'Amico

04:21 PM D4Science Infrastructure Task #11578 (Closed): Change the dataminer playbook and the algorithms-updater script to reinstall all the algorithms after an update

Done.
The playbook now removes the `/home/gcube/wps_algorithms_install_log/already_installed_algorithms.txt` file a... Andrea Dell'Amico

03:59 PM D4Science Infrastructure Task #11578 (In Progress): Change the dataminer playbook and the algorithms-updater script to reinstall all the algorithms after an update

Andrea Dell'Amico

03:44 PM D4Science Infrastructure Task #11578 (Closed): Change the dataminer playbook and the algorithms-updater script to reinstall all the algorithms after an update

Otherwise we loose the configuration of the already installed algorithms.
Andrea Dell'Amico

03:52 PM D4Science Infrastructure Task #11573 (Closed): Dismiss old spd VMs

The VMs are switched off, and I removed the hostnames from the DNS.
Andrea Dell'Amico

Apr 04, 2018

02:21 PM D4Science Infrastructure Task #11563 (Closed): Please provide support for algorithms package on ShareLatext

I just installed it.
If the need to install additional packages arises, please add them here: https://support.d4sc... Andrea Dell'Amico