Activity

From Nov 12, 2017 to Dec 11, 2017

Dec 11, 2017

07:41 PM Incident #10651 (Closed): dataminer3-p-d4s.d4science.org filled the disk: Under Smartgears/state there are 17GB worth of files:
~~~
-rw-r--r-- 1 gcube gcube 0 Dec 11 19:34 _d4science.... Andrea Dell'Amico
07:32 PM Task #10187: Enhance SAI: SAI without Create Software button is available now on dev portal. Giancarlo Panichi
07:26 PM Task #10460: Upgrade resources for worker[1-3]-hadoop-test.d4science.org: The cluster is up and running. worker8-hadoop.d4science.org has been removed for the time being. Andrea Dell'Amico
07:12 PM Task #10460: Upgrade resources for worker[1-3]-hadoop-test.d4science.org: worker8-hadoop.d4science.org still creates problems. Maybe it should be installed on a better hypervisor.
Andrea Dell'Amico
02:44 PM Task #10460: Upgrade resources for worker[1-3]-hadoop-test.d4science.org: Reinstallation started. The up to date node mapping:
~~~
ambari-hadoop.d4science.org (dlib34x)
rm1-hadoop.d4scie... Andrea Dell'Amico
06:55 PM Task #9328 (Rejected): SAI should run SAVE+CREATE when pressing the Publish Button: This is a duplicate of #10187. Giancarlo Panichi
05:59 PM 3rdPartyApplication Support #10643 (In Progress): Regional Data Collection Application Registration: Hello Konstantinos,
i'm not sure I get your question. The purpose of creating a 3rd Party application is for letting... Massimiliano Assante
01:15 PM 3rdPartyApplication Support #10643 (Authorised): Regional Data Collection Application Registration: We would like to register the Regional Data Collection Application as a 3rd party application.
Application Name: R... Konstantinos Apostolopoulos
04:44 PM Task #10478 (Feedback): Dismiss old message-broker: I disabled the nagios check for activemq and shut down all the involved VMs. Andrea Dell'Amico
04:37 PM Task #10478: Dismiss old message-broker: Yes you can dismiss the services. Roberto Cirillo
02:51 PM Upgrade #10588: D4Science Preprod Gateway upgrade to gCube 4.9.0: To support the new Manage Invite portlet a new page must be added to every Gateway Site's Public pages named Manage-I... Massimiliano Assante
02:49 PM Upgrade #10588 (In Progress): D4Science Preprod Gateway upgrade to gCube 4.9.0: Massimiliano Assante
02:49 PM VRE #9403 (Released): Create a VRE for EOSC Service Portfolio: Massimiliano Assante
01:05 PM Task #9826: issue sharelatex (can't compile a whole report): Any news about changing the compilation approach, @taha.imzilen@ird.fr ? In its current status, I think we cannot man... Gianpaolo Coro
10:41 AM Upgrade #10637 (In Progress): /gcube/preprod upgrade to gCube 4.9.0: Roberto Cirillo
10:24 AM Upgrade #10637 (Planned): /gcube/preprod upgrade to gCube 4.9.0: Roberto Cirillo
10:23 AM Upgrade #10637: /gcube/preprod upgrade to gCube 4.9.0: **Hosting Nodes**
*WHN to upgrade*
* **(CNR) DONE** dataminer1-pre.d4science.org
* **(CNR) DONE** dataminer-gh... Roberto Cirillo
10:21 AM Upgrade #10637 (Completed): /gcube/preprod upgrade to gCube 4.9.0: Roberto Cirillo

Dec 07, 2017

07:25 PM Task #10460: Upgrade resources for worker[1-3]-hadoop-test.d4science.org: Erasing the nodes without reinstalling them wasn't a good choice. We will reinstall them from scratch, and then recon... Andrea Dell'Amico
04:59 PM Task #10460: Upgrade resources for worker[1-3]-hadoop-test.d4science.org: All the cluster have been reconfigured, HDP 2.6.3 has been installed.
There's a problem on worker8-hadoop.d4science... Andrea Dell'Amico
07:08 PM Task #10478 (In Progress): Dismiss old message-broker: Can we switch off activemq and dismiss all the 5 nodes now? Tommaso Piccioli
06:24 PM Support #10607 (Closed): access to geonetwork-sdi.dev.d4science.org: You can access now as user `gcube` Andrea Dell'Amico
12:47 PM Support #10607 (Closed): access to geonetwork-sdi.dev.d4science.org: The SSH Public Key is now available. I'm waiting for the access. Vincenzo Terrano
03:27 PM Task #9971 (Closed): On Share updates portlet and "notification" drop down menu vs radio button: The dropdown menu has been removed and replaced by a checkbox. See screenshot attached. Massimiliano Assante
12:45 PM Task #10606 (Closed): Disable nagios check on old services: Done. Andrea Dell'Amico
11:46 AM Task #10606 (Closed): Disable nagios check on old services: In order to dismiss the message-broker and the services related to it, I've stopped the container running on the foll... Roberto Cirillo

Dec 06, 2017

07:31 PM Task #9857 (Closed): Evacuate the hypervisors from dlib14x to dlib19x: The nodes are empty. Andrea Dell'Amico
06:54 PM Task #10270: Configure the xen hypervisor to let the guests talk to the storage network: The test made on dlib18x went bad, so a full reboot of every hypervisor is needed to permit the VMs to talk to the pr... Andrea Dell'Amico
06:16 PM Task #10504 (In Progress): SAI - Remove SAI portlets from environments that are not development VRE: Done. Pasquale Pagano
06:15 PM Support #10602 (Closed): access to geonetwork-sdi.dev.d4science.org: Pasquale Pagano
05:40 PM Support #10602: access to geonetwork-sdi.dev.d4science.org: ? You can add your public ssh key to your profile on the portal, under `My Account -> Custom fields`.
Andrea Dell'Amico
05:34 PM Support #10602 (Closed): access to geonetwork-sdi.dev.d4science.org: Please, can you contact me in order to provide SSH public key? Vincenzo Terrano
06:06 PM Task #10597 (Closed): Give the ability to enable and configure the tomcat manager when we use the tomcat-multiple-instances role: It's working, just tested on thredds-d-d4s.d4science.org.
Andrea Dell'Amico
05:04 PM Task #10597: Give the ability to enable and configure the tomcat manager when we use the tomcat-multiple-instances role: The smartgears side is also ready to be tested. The template part is:
~~~
{% if tomcat_m_manager_install or t... Andrea Dell'Amico
04:30 PM Task #10597: Give the ability to enable and configure the tomcat manager when we use the tomcat-multiple-instances role: The tomcat part should be complete. Andrea Dell'Amico
03:59 PM Task #10597: Give the ability to enable and configure the tomcat manager when we use the tomcat-multiple-instances role: The configuration will be global. It will affect all the tomcat instances installed on a node.
Andrea Dell'Amico
02:30 PM Task #10597 (In Progress): Give the ability to enable and configure the tomcat manager when we use the tomcat-multiple-instances role: Andrea Dell'Amico
02:02 PM Task #10597 (Closed): Give the ability to enable and configure the tomcat manager when we use the tomcat-multiple-instances role: Also, arbitrary additional users and roles must be accepted and managed.
Also, the nginx template used by smartgears... Andrea Dell'Amico
05:27 PM Task #9971 (In Progress): On Share updates portlet and "notification" drop down menu vs radio button: Massimiliano Assante
03:54 PM Task #9900 (Closed): Please provide the list of token for all production environments where to run the is-exporter: Luca Frosini
03:54 PM Task #9900 (In Progress): Please provide the list of token for all production environments where to run the is-exporter: Luca Frosini
03:16 PM Task #10121 (Closed): Deploy DataMiner service on PARTHENOS/PARTHENOS_LAB VRE: Me and Roberto deployed all the required algorithm inside the DataMiner, which is now in place and should work correc... Paolo Scarponi
02:40 PM Task #10563 (Closed): Dismiss old VMs: Done. Tommaso Piccioli
11:30 AM Task #10563 (In Progress): Dismiss old VMs: Tommaso Piccioli
01:33 PM Support #10595 (Closed): access to geofence-d-d4s.d4science.org: Done. Andrea Dell'Amico
12:36 PM Support #10595 (Closed): access to geofence-d-d4s.d4science.org: Please, may you give me access to geofence-d-d4s.d4science.org on dev infra? Ciro Formisano
01:31 PM Support #10594 (Closed): access to geoserver1-spatial-dev.d4science.org: You had access already. Andrea Dell'Amico
12:36 PM Support #10594 (Closed): access to geoserver1-spatial-dev.d4science.org: Please, may you give me access to geoserver1-spatial-dev.d4science.org on dev infra? Ciro Formisano
01:29 PM Support #10592 (Closed): access to geonetwork-sdi.dev.d4science.org: Done. Andrea Dell'Amico
12:20 PM Support #10592 (Closed): access to geonetwork-sdi.dev.d4science.org: Please, may you give me access to geonetwork-sdi.dev.d4science.org on dev infra? Ciro Formisano
12:56 PM Task #6501 (Closed): migrate old dev (ubuntu 9) to new hosts: Done. Tommaso Piccioli
12:46 PM Task #6501: migrate old dev (ubuntu 9) to new hosts: The following VMs have been successfully moved and the related wiki has been updated: https://wiki.d4science.org/inde... Roberto Cirillo
12:49 PM Task #10460: Upgrade resources for worker[1-3]-hadoop-test.d4science.org: The DB server has been configured. Andrea Dell'Amico
11:21 AM Upgrade #10588 (Planned): D4Science Preprod Gateway upgrade to gCube 4.9.0: Massimiliano Assante
11:21 AM Upgrade #10588 (Completed): D4Science Preprod Gateway upgrade to gCube 4.9.0: Massimiliano Assante
11:19 AM Upgrade #10587 (Completed): D4Science Gateways upgrade to gCube 4.9.0: **DONE** To support the new Manage Invite portlet a new page must be added to every Gateway Site's Public pages named... Massimiliano Assante
11:00 AM Upgrade #10585 (Completed): D4Science Infrastructure Upgrade to gCube 4.9.0: Massimiliano Assante

Dec 05, 2017

07:29 PM Task #10460: Upgrade resources for worker[1-3]-hadoop-test.d4science.org: The VMs have been renamed, moved and reinstalled when needed. All the data disk volumes renamed to match the VM host... Andrea Dell'Amico
12:03 PM Task #10460 (In Progress): Upgrade resources for worker[1-3]-hadoop-test.d4science.org: The involved VMs are:
ambari-hadoop-test.d4science.org (dlib34x) ambari-hadoop.d4science.org
rm1-hadoop-test.d4sc... Andrea Dell'Amico
06:02 PM Task #9857: Evacuate the hypervisors from dlib14x to dlib19x: Tommaso Piccioli wrote:

> Host node1-d-d4s.d4science.org has been already migrated but the ghn was down since mar... Roberto Cirillo
05:10 PM Task #10563 (Closed): Dismiss old VMs: The following VMs should be dismissed:
~~~
node11.d.d4science.research-infrastructures.eu
node15.d.d4science.res... Roberto Cirillo
04:38 PM Task #10368 (Feedback): DM Pool Manager not working (improvement on the notification mechanism): The fixed version is going to be released with gCube 4.9 Ciro Formisano
03:23 PM Task #6501: migrate old dev (ubuntu 9) to new hosts: * node15.d.d4science.research-infrastructures.eu ha been migrated to node13-d-d4s.d4science.org
* node14-d-d4s... Roberto Cirillo
02:22 PM Upgrade #10456 (Completed): ParthenosVO VO upgrade to 4.8.0: Roberto Cirillo
10:11 AM Task #8555: Please provide more resource to Redmine: ok Luca Frosini

Dec 04, 2017

06:51 PM Task #10521 (Closed): D4Research: Add cronjob on VREModeler service: Done. Andrea Dell'Amico
09:58 AM Task #10521 (Closed): D4Research: Add cronjob on VREModeler service: It's needed to have a restart of the ghn running on the following host:
~~~
vremodeler-d4research.d4science.org
... Roberto Cirillo
06:42 PM Task #8555 (Closed): Please provide more resource to Redmine: Closing. Open another one if you want to try to disable the two configuration settings listed in https://support.d4sc... Andrea Dell'Amico
02:46 PM Task #9857: Evacuate the hypervisors from dlib14x to dlib19x: mongo2-d-d4s.d4science.org moved. Tommaso Piccioli
02:27 PM Task #10121: Deploy DataMiner service on PARTHENOS/PARTHENOS_LAB VRE: The dataminer cluster is in place. I've assigned the cloud1 cluster with the only Bionym algorithm. Please, @scarponi... Roberto Cirillo
11:42 AM Task #10121 (In Progress): Deploy DataMiner service on PARTHENOS/PARTHENOS_LAB VRE: Roberto Cirillo
02:16 PM Task #10518 (Closed): Add the CMSY_LEGACY algorithm to the StockAssessment VRE: Paolo Scarponi
02:15 PM Task #10519 (Closed): Add the CMSY_VECTORIZED algorithm to the StockAssessment VRE: Paolo Scarponi
12:31 AM Task #10519 (Closed): Add the CMSY_VECTORIZED algorithm to the StockAssessment VRE: The new CMSY_VECTORIZED algorithm should be added to the StockAssessment VRE ASAP. Gianpaolo Coro
12:59 PM Task #10351 (Closed): 404 error of Apache tomcat: I am closing this issue since it is opened for 19 days without any feedback. Pasquale Pagano
11:10 AM Task #10522 (Rejected): DataMiner Algorithms - BlackBox: add two collaborative recommendation algorithms and one for evaluation: Costantino Perciante
10:31 AM Task #10366 (Closed): Add ParthenosVO scope to all the dataminer instances: Roberto Cirillo

Dec 03, 2017

08:25 PM Task #10518 (Closed): Add the CMSY_LEGACY algorithm to the StockAssessment VRE: The new CMSY_LEGACY algorithm should be added to the StockAssessment VRE ASAP. Gianpaolo Coro
08:23 PM Task #10479: Cloud Provisioning Requests: OK that explains everything. Is it possible perhaps to use the -genericworkers prefix for the generic workers machine... Gianpaolo Coro
08:08 PM Task #10479: Cloud Provisioning Requests: The script is running. But I just realized that the hosts you reported in your first comment but http://ip-90-147-167... Andrea Dell'Amico
07:59 PM Task #10479: Cloud Provisioning Requests: No problem doing it. But the haproxy statistics don't lie
Andrea Dell'Amico
07:39 PM Task #10479: Cloud Provisioning Requests: I simply repeatedly invoked the HTTP Get request above, but eventually the calls did not go on all the machines. This... Gianpaolo Coro
07:21 PM Task #10479: Cloud Provisioning Requests: I don't know what you did, but the requests are always perfectly balanced between all servers. You can see by yoursel... Andrea Dell'Amico
07:11 PM Task #10479: Cloud Provisioning Requests: Friday I run 200 executions towards Cloud1 by repeatedly invoking this HTTP Get request:
~~~
http://dataminer-clo... Gianpaolo Coro
07:01 PM Task #10479: Cloud Provisioning Requests: Are you sure that those instances received any job request after Nov 29th? Because the logs configuration were update... Andrea Dell'Amico
06:36 PM Task #10479: Cloud Provisioning Requests: What about point 3 and https://support.d4science.org/issues/10479#note-1 ?
Logs are still empty. Gianpaolo Coro
05:42 PM Task #10479 (Closed): Cloud Provisioning Requests: Andrea Dell'Amico
05:41 PM Task #10479: Cloud Provisioning Requests: The new configuration is operational. I removed the `cloud1` cluster configuration from the CNR haproxy instance. Andrea Dell'Amico
02:08 PM Task #10479: Cloud Provisioning Requests: The haproxy stats on dataminer-lb.garr.d4science.org:8880 are accessible with the same credentials that are valid for... Andrea Dell'Amico
01:47 PM Task #10479: Cloud Provisioning Requests: I just reconfigured the dataminer haproxy and moved the host dataminer-cloud1.d4science.org. It is now a CNAME of dat... Andrea Dell'Amico

Dec 01, 2017

08:04 PM Task #9857: Evacuate the hypervisors from dlib14x to dlib19x: Still to be moved:
~~~
mongo2-d-d4s.d4science.org (waiting Roberto to switch the PRIMARY node)
slave1.ci.rese... Tommaso Piccioli
07:51 PM Task #10479: Cloud Provisioning Requests: I just adopted a configuration on both the CNR haproxy instance and the dataminer.garr loadbalancer that makes all th... Andrea Dell'Amico
06:28 PM Task #8555: Please provide more resource to Redmine: I think we can close this one. There's space for more optimisations but we should disable some features we rely on. A... Andrea Dell'Amico
11:20 AM Task #8555: Please provide more resource to Redmine: I confirm it is better now, I think we reduced the waiting time of 50% in average Massimiliano Assante
01:23 AM Task #8555: Please provide more resource to Redmine: I added again the global_roles plugin too, btw. Andrea Dell'Amico
01:20 AM Task #8555: Please provide more resource to Redmine: I also see that we are using both the problematic configurations reported in the ticket:
* Allow issue assignment... Andrea Dell'Amico
01:16 AM Task #8555 (Feedback): Please provide more resource to Redmine: Things seem slightly better now. I would not say that's fast now, but better. Andrea Dell'Amico
01:14 AM Task #8555: Please provide more resource to Redmine: I just applied the fix suggested here: http://www.redmine.org/issues/17700 Andrea Dell'Amico
01:10 AM Task #8555: Please provide more resource to Redmine: But I think I've found the culprit: http://www.redmine.org/issues/14906
I think we can live without that. Andrea Dell'Amico
01:07 AM Task #8555: Please provide more resource to Redmine: I added again `Redmine Code Review plugin`. While the other one was already installed.
Andrea Dell'Amico
06:17 PM Task #10504 (Feedback): SAI - Remove SAI portlets from environments that are not development VRE: Roberto Cirillo
05:34 PM Task #10504 (In Progress): SAI - Remove SAI portlets from environments that are not development VRE: I pass now the ticket to Roberto to add the right resources. Massimiliano Assante
03:21 PM Task #10504: SAI - Remove SAI portlets from environments that are not development VRE: It is also good to assign the proto cluster, but then we need to add all the DMPoolManager and SAI resources on the I... Giancarlo Panichi
03:10 PM Task #10504: SAI - Remove SAI portlets from environments that are not development VRE: we should not remove SAI from the VREs that are using it. Rather, we should assign the proper resources to these VREs... Pasquale Pagano
12:56 PM Task #10504 (Closed): SAI - Remove SAI portlets from environments that are not development VRE: Remove SAI portlets from VRE that are not development VRE.
For example:
Taras Günther use SAI in /d4science.resea... Giancarlo Panichi
03:49 PM Task #10487 (Closed): Give access to UOA machines to contact SimulFishGrowth_prod: Yes, we now have access. Dimitris Katris
03:17 PM Task #10487 (Feedback): Give access to UOA machines to contact SimulFishGrowth_prod: Done. Can you check?
Andrea Dell'Amico
03:17 PM Task #10487 (In Progress): Give access to UOA machines to contact SimulFishGrowth_prod: Andrea Dell'Amico
03:04 PM Task #10487: Give access to UOA machines to contact SimulFishGrowth_prod: I think that we need access to all. Thank you! Dimitris Katris
02:32 PM Task #10487: Give access to UOA machines to contact SimulFishGrowth_prod: What databases do you need to access? All the SimulFishGrowth ones?
~~~
SimulFishGrowth | sfguser
SimulFi... Andrea Dell'Amico
03:12 PM Task #10505: R processes out of control on dataminer0-proto.d4science.org: Since the incident has been solved, please either change the tracker or close this issue. Pasquale Pagano
01:05 PM Task #10505: R processes out of control on dataminer0-proto.d4science.org: I just killed them to be able to start the dataminer again, but as it's not the first time that it happens it should ... Andrea Dell'Amico
01:04 PM Task #10505 (Closed): R processes out of control on dataminer0-proto.d4science.org: There are a lot of them, and dataminer cannot start because they are using too much RAM:
~~~
gcube 4623 0.0 ... Andrea Dell'Amico
02:41 PM Task #9213: enable calDAV authentication on D4Science Gateways: I don't think so: from the haproxy point of view they are all remote targets, it never points to 'localhost' or somet... Andrea Dell'Amico
10:44 AM Task #9213: enable calDAV authentication on D4Science Gateways: The difference between liferay/tomcat preproduction cluster and the production one is that in case of preproduction t... Massimiliano Assante
12:59 AM Task #9213: enable calDAV authentication on D4Science Gateways: I also tried to start a http frontend on port 8443 and use it to backend a single tomcat instance. It does not work (... Andrea Dell'Amico
12:51 AM Task #9213: enable calDAV authentication on D4Science Gateways: I just made another test, to add confusion. On both the pre and production load balancers I activated a frontend that... Andrea Dell'Amico
12:30 AM Task #9213: enable calDAV authentication on D4Science Gateways: It does not work, really. I can add a calendar only when a single tomcat instance is running, and this explains why i... Andrea Dell'Amico
01:06 PM Task #10279: Large file upload limit on the workspace: Marek Horst wrote:
> As a last yesterday's resort I have used the old command I'd been using to upload packages befo... Costantino Perciante
11:59 AM Task #10279: Large file upload limit on the workspace: As a last yesterday's resort I have used the old command I'd been using to upload packages before (but which at some ... Marek Horst
12:40 PM Task #10187 (In Progress): Enhance SAI: The following points have been resolved in the release gCube 4.8:
* avoid users to put special characters in the d... Giancarlo Panichi
12:08 AM Task #7356 (Feedback): Please check HA Load Balancer on preprod: Andrea Dell'Amico
12:07 AM Task #7356 (In Progress): Please check HA Load Balancer on preprod: I tried all the possible combinations, alternatively restarting nginx on the two nodes, and the requests are always b... Andrea Dell'Amico
12:05 AM Task #6232 (In Progress): Enable Infrastructure Gateway cluster communication behind firewall: I'm going to test on preproduction Andrea Dell'Amico

Nov 30, 2017

11:46 PM Task #6232 (Feedback): Enable Infrastructure Gateway cluster communication behind firewall: Andrea Dell'Amico
11:45 PM Task #6232 (In Progress): Enable Infrastructure Gateway cluster communication behind firewall: (sorry, the comment was meant to another ticket) Andrea Dell'Amico
06:42 PM Task #8555: Please provide more resource to Redmine: Luca Frosini wrote:
> Repository tab in gcube project seems not working properly anymore. The revision and the comme... Andrea Dell'Amico
06:16 PM Task #8555: Please provide more resource to Redmine: @andrea.dellamico@isti.cnr.it Repository tab in gcube project seems not working properly anymore. The revision and th... Luca Frosini
06:15 PM Task #9213: enable calDAV authentication on D4Science Gateways: It's now working on preproduction. It seems that it could depend by some configuration that I just moved from global ... Andrea Dell'Amico
06:10 PM Task #10279: Large file upload limit on the workspace: Marek Horst wrote:
> Marek Horst wrote:
> > Costantino Perciante wrote:
> > >
> > > Marek, we incremented some n... Costantino Perciante
05:14 PM Task #10279: Large file upload limit on the workspace: Marek Horst wrote:
> Costantino Perciante wrote:
> >
> > Marek, we incremented some nginx parameters to avoid tim... Marek Horst
04:31 PM Task #10279: Large file upload limit on the workspace: Costantino Perciante wrote:
>
> Marek, we incremented some nginx parameters to avoid timeouts. Could you retry onc... Marek Horst
04:26 PM Task #10279: Large file upload limit on the workspace: Marek Horst wrote:
> Another attempt of `epmc-text-20171017.gz` upload has just finished with the same result.
>
... Costantino Perciante
03:12 PM Task #10495 (Closed): Update nginx configuration on preprod homelibrary webapp: requests with file too big are rejected: Done. The limit is now 50GB as in the production environment. Andrea Dell'Amico
03:05 PM Task #10495: Update nginx configuration on preprod homelibrary webapp: requests with file too big are rejected: from nginx logs I see the following error:
~~~
2017/11/30 14:51:01 [error] 630#0: *216751 client intended to send... Roberto Cirillo
03:02 PM Task #10495 (Closed): Update nginx configuration on preprod homelibrary webapp: requests with file too big are rejected: I'm not able to upload a file of 9GB on the home-library-webapp in preprod.
Could you increment the size of the al... Costantino Perciante
02:52 PM VM Creation #10482 (Closed): New Joomla Portal: Andrea Dell'Amico
09:10 AM Task #10487 (Closed): Give access to UOA machines to contact SimulFishGrowth_prod: Some firewall rules are probably blocking some servers in University of Athens to contact a database located at a CNR... Dimitris Katris

Nov 29, 2017

08:37 PM Task #9857: Evacuate the hypervisors from dlib14x to dlib19x: Only some dev VMs on dlib18x remains (thanks to Tom, he is doing all the work). Andrea Dell'Amico
12:36 PM Task #9857: Evacuate the hypervisors from dlib14x to dlib19x: Host node26.d.d4science.research-infrastructures.eu deleted
Host node1-d-d4s.d4science.org has been already migrat... Tommaso Piccioli
08:20 PM Task #10279: Large file upload limit on the workspace: Another attempt of `epmc-text-20171017.gz` upload has just finished with the same result.
Time taken suggest whol... Marek Horst
06:50 PM Task #10279: Large file upload limit on the workspace: Costantino Perciante wrote:
> Everything should work now, so if something fails we must check the reason why it did.... Marek Horst
06:21 PM Task #10279: Large file upload limit on the workspace: Marek Horst wrote:
> Costantino Perciante wrote:
> > There is a scheduled maintainance downtime of the infrastructu... Costantino Perciante
05:50 PM Task #10279: Large file upload limit on the workspace: Costantino Perciante wrote:
> There is a scheduled maintainance downtime of the infrastructure today. Some of the er... Marek Horst
01:39 PM Task #10279: Large file upload limit on the workspace: There is a scheduled maintainance downtime of the infrastructure today. Some of the errors may be related to this. It... Costantino Perciante
01:16 PM Task #10279 (In Progress): Large file upload limit on the workspace: I need to reopen this ticket because we have to reupload packages.
Currently the problem is I am unable to delete ... Marek Horst
07:58 PM VM Creation #10482 (Feedback): New Joomla Portal: Andrea Dell'Amico
05:24 PM VM Creation #10482 (In Progress): New Joomla Portal: demo.openportal.d4science.org 146.48.123.161
Andrea Dell'Amico
03:57 PM VM Creation #10482 (Closed): New Joomla Portal: I need a new Joomla Installation (similar to #2106).
It is necessary for the deployment of a DEMO portal (it must ... Michele Artini
06:46 PM Upgrade #10073 (Completed): D4Science Infrastructure Upgrade to gCube 4.8.0: Roberto Cirillo
06:45 PM Upgrade #10073 (In Progress): D4Science Infrastructure Upgrade to gCube 4.8.0: Roberto Cirillo
06:44 PM Upgrade #10073 (Planned): D4Science Infrastructure Upgrade to gCube 4.8.0: Roberto Cirillo
05:06 PM Upgrade #10454 (Completed): FARM VO upgrade to gCube 4.8.0: Roberto Cirillo
03:45 PM Upgrade #10454 (In Progress): FARM VO upgrade to gCube 4.8.0: Roberto Cirillo
05:04 PM Upgrade #10453 (Completed): gCubeApps VO upgrade to gCube 4.8.0: Roberto Cirillo
02:53 PM Upgrade #10453 (In Progress): gCubeApps VO upgrade to gCube 4.8.0: Roberto Cirillo
04:57 PM Upgrade #10458 (Completed): D4Science Root VO upgrade to gCube 4.8: Roberto Cirillo
02:06 PM Upgrade #10458 (In Progress): D4Science Root VO upgrade to gCube 4.8: Roberto Cirillo
04:56 PM Upgrade #10456 (In Progress): ParthenosVO VO upgrade to 4.8.0: Roberto Cirillo
04:14 PM Upgrade #10468 (Completed): SoBigData VO upgrade to 4.8.0: Roberto Cirillo
04:07 PM Upgrade #10468 (In Progress): SoBigData VO upgrade to 4.8.0: Roberto Cirillo
04:08 PM Upgrade #10455 (Completed): D4Research VO upgrade to 4.8.0: Roberto Cirillo
03:58 PM Upgrade #10455 (In Progress): D4Research VO upgrade to 4.8.0: Roberto Cirillo
04:04 PM Task #8555: Please provide more resource to Redmine: Removed. It's still very slow, but I'll need some quiet hours to examine the postgresql queries again. Andrea Dell'Amico
12:04 PM Task #8555: Please provide more resource to Redmine: OK, I'll do it at the start of the downtime window. Andrea Dell'Amico
09:51 AM Task #8555: Please provide more resource to Redmine: So I think we cam manage the rest of the people manually. Luca Frosini
03:51 PM Task #10479 (In Progress): Cloud Provisioning Requests: Gianpaolo Coro wrote:
> 3 - save the DM logs up to 3 months earlier
I'm running the log reconfiguration right now... Andrea Dell'Amico
01:15 PM Task #10479: Cloud Provisioning Requests: There are Garr machines that need to have logging double checked:
Machines that are not logging at all:
http://... Gianpaolo Coro
12:37 PM Task #10479 (Closed): Cloud Provisioning Requests: A number of requests for the Cloud computing provisioning service:
1 - access the dataminer.d4science.org:8880 pag... Gianpaolo Coro
03:12 PM Incident #10262: Cannot see who liked posts on VREs of Parthenos: The issue has been fixed in production with the rollout of gCube 4.8.0 Massimiliano Assante
03:08 PM Upgrade #10277 (Completed): D4Science Preprod Gateway upgrade to gCube 4.8.0: Massimiliano Assante
02:40 PM Upgrade #10278 (Completed): D4Science Gateways upgrade to gCube 4.8.0: Massimiliano Assante
02:09 PM Upgrade #10278 (In Progress): D4Science Gateways upgrade to gCube 4.8.0: Massimiliano Assante
12:33 PM Task #10358 (Closed): Dataminer-cluster: Integrate the dm-192-168-100-104.garr.d4science.org instance into the garr cluster: We will destroy this one, and a couple of the ones from the ones requested for the FAO course. See #10223 Andrea Dell'Amico
12:31 PM Task #10223: Provide machines for FAO course: After talking with GP we decided to finally add those VMs to the `cloud1` cluster. We also destroy some of them: two ... Andrea Dell'Amico

Nov 28, 2017

06:01 PM Task #10478 (Closed): Dismiss old message-broker: In order to dismiss the message-broker VM
~~~
message-broker.d4science.research-infrastructures.eu
~~~
it's ... Roberto Cirillo
04:35 PM Task #10223: Provide machines for FAO course: As those VMs were requested to face the FAO course, can we destroy some of them?
Andrea Dell'Amico
04:19 PM Task #10467 (In Progress): I need a way to communicate with the IS from a script: A link to the REST API was provided: https://dev.d4science.org/swagger/registry/ Andrea Dell'Amico
04:03 PM Task #10317: Increase the resources of dataminer[1:5]-p-d4s.d4science.org: dataminer1-p-d4s.d4science.org: move from dlib23x.dom0.research-infrastructures.eu to dlib34x.dom0.research-infrastru... Andrea Dell'Amico
03:56 PM VM Creation #10382 (Closed): Extend Resources to D-Net Index: Andrea Dell'Amico
03:31 PM Upgrade #10455 (Planned): D4Research VO upgrade to 4.8.0: Roberto Cirillo
03:30 PM Upgrade #10468 (Planned): SoBigData VO upgrade to 4.8.0: Roberto Cirillo
10:14 AM Upgrade #10468: SoBigData VO upgrade to 4.8.0: **HostingNode**
*WHN to upgrade*
* **(CNR) DONE** twittermon1.d4science.org
**Smartgears services**
* *... Roberto Cirillo
10:11 AM Upgrade #10468 (Completed): SoBigData VO upgrade to 4.8.0: Roberto Cirillo
03:30 PM Upgrade #10456 (Planned): ParthenosVO VO upgrade to 4.8.0: Roberto Cirillo
10:16 AM Upgrade #10456: ParthenosVO VO upgrade to 4.8.0: **Configuration**
* add ParthenosVO scope to all the WHNs under the following clusters:
* **(CNR) DONE** data... Roberto Cirillo
03:30 PM Upgrade #10454 (Planned): FARM VO upgrade to gCube 4.8.0: Roberto Cirillo
03:28 PM Upgrade #10453 (Planned): gCubeApps VO upgrade to gCube 4.8.0: Roberto Cirillo
02:02 PM Task #10358: Dataminer-cluster: Integrate the dm-192-168-100-104.garr.d4science.org instance into the garr cluster: I talked with Roberto. The dataminer will be moved into the production pool.
Andrea Dell'Amico
11:50 AM Task #10358: Dataminer-cluster: Integrate the dm-192-168-100-104.garr.d4science.org instance into the garr cluster: I read the description, but @gianpaolo.coro@isti.cnr.it told me repeatedly that he's sure it's still needed for TextC... Andrea Dell'Amico
10:24 AM Task #10358: Dataminer-cluster: Integrate the dm-192-168-100-104.garr.d4science.org instance into the garr cluster: As explained in the description, TextCrowd is served by "dataminer-prototypes" cluster so this instance should be add... Roberto Cirillo
01:28 PM Task #8555: Please provide more resource to Redmine: Luca Frosini wrote:
> Instead the following the has to be admin
> Pasquale Pagano
> Luca Frosini
> Andrea Dell'... Andrea Dell'Amico
11:25 AM Task #8555: Please provide more resource to Redmine: I just remember that we installed such a plugin to avoid to grant them admin role to people which has to be manager i... Luca Frosini
12:56 PM Support #10470 (Closed): Create new user Vincenzo Terrano: I sent a welcome email to the user to complete the registration on https://manage.research-infrastructures.eu (to acc... Tommaso Piccioli
12:26 PM Support #10470 (In Progress): Create new user Vincenzo Terrano: Tommaso Piccioli
12:22 PM Support #10470 (Closed): Create new user Vincenzo Terrano: For WP7 a new developer will support ENG activities: Vincenzo Terrano (vincenzo.terrano@eng.it). May you create an u... Ciro Formisano
11:47 AM Task #10237: Please raise the timeout-limit of virtuoso.parthenos.d4science.org: @matej.durco@oeaw.ac.at please verify that he SPARQL query runs now and close the ticket if ok. Massimiliano Assante
11:37 AM Task #10440: Please add a smart-executor instance with accounting-insert-rstudio-se-plugin on each RStudio nodes: I think this task should be reconsidered. In addition, what happens if an user has more than one home (not duplicated... Roberto Cirillo
11:16 AM Task #8526 (Closed): Upgrade smart-executor service in production environment: All the instances were upgraded. Roberto Cirillo

Nov 27, 2017

07:40 PM Task #10358: Dataminer-cluster: Integrate the dm-192-168-100-104.garr.d4science.org instance into the garr cluster: @roberto.cirillo@isti.cnr.it @g.panichi@isti.cnr.it @gianpaolo.coro@isti.cnr.it can I have an answer please?
Can we ... Andrea Dell'Amico
07:32 PM Task #9551: Some jobs wrote big chunks of data into the persistence jackrabbit table: Some days ago, the DB size increased by almost 10GB in 48 hours. It's been stable again since than, but those increme... Andrea Dell'Amico
07:28 PM Task #10287 (Closed): Schedule downtime for GN DB: The DB was moved to another hypervisor on Nov 22 as scheduled. Now the clients are working correctly. Andrea Dell'Amico
07:24 PM Task #10467 (Closed): I need a way to communicate with the IS from a script: A REST API would be perfect. Otherwise we will need something specific to pass the haproxy configuration data.
Andrea Dell'Amico
06:43 PM Task #8555: Please provide more resource to Redmine: I just removed the plugin on the redmine dev instance, https://redmine-d.d4science.org without any apparent loss of f... Andrea Dell'Amico
11:50 AM Task #8555: Please provide more resource to Redmine: I cannot find a related ticket. There was a spreadsheet with a list of potential plugins at some point, but I cannot ... Andrea Dell'Amico
09:19 AM Task #8555: Please provide more resource to Redmine: Do you remember why we installed the Global Roles plugin. Luca Frosini
04:19 PM Task #10460 (Closed): Upgrade resources for worker[1-3]-hadoop-test.d4science.org: We need to have the same hw resource of the other workers of the cluster Sandro La Bruzzo
03:38 PM Upgrade #10455: D4Research VO upgrade to 4.8.0: **Hosting Nodes**
*WHN to upgrade*
* **(CNR) DONE** tabulardata2.d4science.org
* **(CNR) DONE** dm-pool-mana... Roberto Cirillo
12:38 PM Upgrade #10455 (Completed): D4Research VO upgrade to 4.8.0: Roberto Cirillo
03:25 PM Upgrade #10454: FARM VO upgrade to gCube 4.8.0: **Hosting Nodes**
*WHN to upgrade*
* **(CNR) DONE** tabulardata2.d4science.org
* **(NKUA) DONE** dewn05.madg... Roberto Cirillo
12:37 PM Upgrade #10454 (Completed): FARM VO upgrade to gCube 4.8.0: Roberto Cirillo
03:04 PM Upgrade #10458 (Planned): D4Science Root VO upgrade to gCube 4.8: Roberto Cirillo
03:00 PM Upgrade #10458: D4Science Root VO upgrade to gCube 4.8: **HostingNode**
* **(CNR) DONE** data.d4science.org
* **(CNR) DONE** data2-d4s.d4science.org
*WHN to upgrade... Roberto Cirillo
02:50 PM Upgrade #10458 (Completed): D4Science Root VO upgrade to gCube 4.8: Roberto Cirillo
02:44 PM Upgrade #10453: gCubeApps VO upgrade to gCube 4.8.0: **Hosting Nodes**
*WHN to upgrade*
* **(CNR) DONE** dm-pool-manager-proto.d4science.org
* **(CNR) DONE** ... Roberto Cirillo
12:34 PM Upgrade #10453 (Completed): gCubeApps VO upgrade to gCube 4.8.0: Roberto Cirillo
12:39 PM Upgrade #10456 (Completed): ParthenosVO VO upgrade to 4.8.0: Roberto Cirillo

Nov 25, 2017

04:57 PM Task #8555: Please provide more resource to Redmine: I just removed the following plugins:
* Advanced roadmap & milestones plugin
* Recurring Tasks (Issues)
* Redmin... Andrea Dell'Amico
03:40 PM Task #9857 (In Progress): Evacuate the hypervisors from dlib14x to dlib19x: Some VMs have been migrated. Andrea Dell'Amico
12:25 PM Task #10223: Provide machines for FAO course: A working version of the command:
~~~
for i in `ls -l /proc/*/fd/* 2>/dev/null | grep delete | grep tomcat | awk ... Andrea Dell'Amico

Nov 20, 2017

08:36 PM Task #10223: Provide machines for FAO course: I do not know if this is important however I noticed that there are different directories in ecocfg:
dm-192-168-10... Giancarlo Panichi
07:58 PM Task #10223: Provide machines for FAO course: I just checked the version of the Dataminer core libraries in both the installation, and they are the same.
I cannot... Lucio Lelii
07:08 PM Task #10223: Provide machines for FAO course: @lucio.lelii@isti.cnr.it that log is from the DataMiner not from the script (see the class name).
The R script wri... Gianpaolo Coro
06:47 PM Task #10223: Provide machines for FAO course: @gianpaolo.coro@isti.cnr.it if you are talking about CMSY_2_FAST, I thing there is an error in the RScript.
It is tr... Lucio Lelii
01:00 PM Task #10223: Provide machines for FAO course: As the playbook didn't change and from what I can see the algorithms installer is working, I guess it's better that @... Andrea Dell'Amico
07:20 PM VM Creation #10348 (Feedback): Installation of Virtuoso Triplestore in the infrastructure: https://virtuoso-grsf.d4science.org is online. There's no valid X.509 certificate yet, it will be emitted in the next... Andrea Dell'Amico
06:33 PM VM Creation #10348: Installation of Virtuoso Triplestore in the infrastructure: Provisioning in progress. Andrea Dell'Amico
05:41 PM VM Creation #10348: Installation of Virtuoso Triplestore in the infrastructure: hostname and IP address are going to be virtuoso-grsf.d4science.org 146.48.123.160 Andrea Dell'Amico
04:24 PM VM Creation #10348 (In Progress): Installation of Virtuoso Triplestore in the infrastructure: Andrea Dell'Amico
05:57 PM Task #9368 (Closed): JackRabbit Repo cluster over Postgres for development infra: Andrea Dell'Amico
04:04 PM Task #9368: JackRabbit Repo cluster over Postgres for development infra: The infrastructure is in place since months. The cluster features aren't used yet but it's not a matter of configurat... Andrea Dell'Amico
04:44 PM Task #10316: Install the new physical hosts: This task is quite urgent. Is it possible to have the new hardware in place by Wednesday?
Thanks Pasquale Pagano
03:50 PM VM Creation #8567 (Closed): New VM to host the EFG D-Net service: Andrea Dell'Amico
03:48 PM VM Creation #10361 (Closed): Install a new shinyproxy server: Andrea Dell'Amico
03:48 PM Incident #10372 (Closed): Authorization service: pgpool problem: Andrea Dell'Amico
03:25 PM Incident #10372: Authorization service: pgpool problem: I'm closing the incident. A permanent solution will be provided in #10377 Andrea Dell'Amico
11:54 AM Incident #10372 (Feedback): Authorization service: pgpool problem: The auth service is connected to the pgpool service now. I still need to investigate what's happened. I've found that... Andrea Dell'Amico
11:23 AM Incident #10372 (In Progress): Authorization service: pgpool problem: Andrea Dell'Amico
10:52 AM Incident #10372: Authorization service: pgpool problem: I've tried to restart postgres and pgpool but nothing change. After that, I've tried to perform the procedure to fa... Roberto Cirillo
10:22 AM Incident #10372: Authorization service: pgpool problem: the error from the authorization service is
~~~
Internal Exception: org.postgresql.util.PSQLException: ERROR: ... Lucio Lelii
10:18 AM Incident #10372 (Closed): Authorization service: pgpool problem: The pgpool cluster seems to be blocked. I've tried the restore procedure without success. Please, could you take a lo... Roberto Cirillo
02:58 PM Task #10377 (Closed): Disable SSL from the pgpool-clustered postgresql instances: It seems that every problem we've had so far involves the certificate renewals (postgres wants a restart, a reload is... Andrea Dell'Amico
11:46 AM Incident #10373 (Closed): Authorisation service dev and preprod is broken: Massimiliano Assante
10:40 AM Incident #10373 (Closed): Authorisation service dev and preprod is broken: according to @roberto.cirillo@isti.cnr.it and @lucio.lelii@isti.cnr.it the issue is in pgpool Massimiliano Assante
11:30 AM Task #10368: DM Pool Manager not working (improvement on the notification mechanism): Following an offline discussion with @g.panichi@isti.cnr.it and @nunzioandrea.galante@eng.it, it seems that the DMPM... Ciro Formisano

Nov 19, 2017

10:06 PM Task #10223: Provide machines for FAO course: I have just run more than 1000 executions of the CMSY algorithm on dataminer7-p-d4s.d4science.org and I cannot run ev... Gianpaolo Coro
09:38 PM Task #10223: Provide machines for FAO course: Apart from the public/private IP address, there is no other difference between those dataminer and the other GARR one... Andrea Dell'Amico
09:07 PM Task #10223: Provide machines for FAO course: The issue is the following and the logs are plenty of them:
~~~
15:04:46.339 [pool-9-thread-4] DEBUG GenericRScri... Gianpaolo Coro
07:33 PM Task #10223: Provide machines for FAO course: I checked some of them and I didn't find any tomcat/smartgears related exceptions into the log files.
The dataminer... Andrea Dell'Amico
04:58 PM VM Creation #10361: Install a new shinyproxy server: We also have a valid certificate now. Andrea Dell'Amico

Nov 18, 2017

02:20 PM Task #10223: Provide machines for FAO course: All the functional tests will be run by Lucio @lucio.lelii@isti.cnr.it on Monday. Meanwhile, for another task I'm run... Gianpaolo Coro

Nov 17, 2017

08:17 PM Task #9857: Evacuate the hypervisors from dlib14x to dlib19x: Anytime is fine with me, but I can speak only for the following VMs
~~~
node5.t.openaire.research-infrastructures... Claudio Atzori
07:52 PM Task #9857: Evacuate the hypervisors from dlib14x to dlib19x: I see that the document was partially compiled.
We need to know *when* we can restart the production VMs, possibly... Andrea Dell'Amico
07:24 PM Task #9703 (Closed): wrong software and data distribution on node75.d4science.org: Tommaso Piccioli
07:22 PM Incident #10306 (Closed): mongo3-p-d4s.d4science.org went out of memory more than once: no more connections from portal-si to mongo3.
mongo2-p-d4s and mongo4-p-d4s restarted with 4 GB of ram. Tommaso Piccioli
05:00 PM Incident #10306: mongo3-p-d4s.d4science.org went out of memory more than once: Tommaso Piccioli wrote:
> Tommaso Piccioli wrote:
> > portal-si.isti.cnr.it shows established connection on port 27... Roberto Cirillo
03:42 PM Incident #10306: mongo3-p-d4s.d4science.org went out of memory more than once: Tommaso Piccioli wrote:
> portal-si.isti.cnr.it shows established connection on port 27017 to all social-isti mongod... Tommaso Piccioli
06:57 PM Task #10358: Dataminer-cluster: Integrate the dm-192-168-100-104.garr.d4science.org instance into the garr cluster: @gianpaolo.coro@isti.cnr.it says it must remain?
Andrea Dell'Amico
06:56 PM Incident #10310 (Closed): Rebuild two GARR dataminer VMs: Andrea Dell'Amico
06:43 PM Incident #10345 (Rejected): Gis Viewer does not produce images correctly: Ok, @fabio.sinibaldi@isti.cnr.it, thanks for you reply. I will consider your suggestions in order to reinforce the Ge... Francesco Mangiacrapa
11:59 AM Incident #10345: Gis Viewer does not produce images correctly: Ok, now I understand.
By inspecting the metadata, it seems it is a bit old layer : all publication and creation date... Fabio Sinibaldi
11:15 AM Incident #10345: Gis Viewer does not produce images correctly: Yes, @fabio.sinibaldi@isti.cnr.it you're right, I presented the problem incorrectly saying 'Thredds side'.
Precisely... Francesco Mangiacrapa
10:25 AM Incident #10345: Gis Viewer does not produce images correctly: Sorry, but I didn't understand the request :
if the issue is in the ISO metadata we should edit that, which resides... Fabio Sinibaldi
06:08 PM Task #9576 (Closed): provision the smartgear logback configuration starting from a template: Andrea Dell'Amico
04:01 PM Task #10368: DM Pool Manager not working (improvement on the notification mechanism): The email is sent correctly and contains the issue but the message sent to SAI doesn't. @g.panichi@isti.cnr.it says t... Gianpaolo Coro
03:51 PM Task #10368: DM Pool Manager not working (improvement on the notification mechanism): Thank you for the help Gianpaolo, it has been very important to identify the root cause.
Unluckily I have not so de... Ciro Formisano
03:16 PM Task #10368: DM Pool Manager not working (improvement on the notification mechanism): My colleague @g.panichi@isti.cnr.it discovered the issue. The "foreach" package was declared as a required package bu... Gianpaolo Coro
03:09 PM Task #10368: DM Pool Manager not working (improvement on the notification mechanism): Ciro Formisano wrote:
> Please, may you grant me the access to the machine hosting DMPM instance? I need to have a l... Roberto Cirillo
02:41 PM Task #10368 (In Progress): DM Pool Manager not working (improvement on the notification mechanism): Please, may you grant me the access to the machine hosting DMPM instance? I need to have a look at the logs and at th... Ciro Formisano
02:32 PM Task #10368 (Feedback): DM Pool Manager not working (improvement on the notification mechanism): I think this is not a tomcat problem.
I've checked the logs: the file 446642b0-7def-4c4a-b9e9-a1a241088bee is not pr... Roberto Cirillo
02:30 PM Task #10368 (In Progress): DM Pool Manager not working (improvement on the notification mechanism): Roberto Cirillo
01:06 PM Task #10368 (Closed): DM Pool Manager not working (improvement on the notification mechanism): I'm trying to deploy the CMSY_2 algorithm in the RPrototypingLab VRE, but I get this 500 error from the pool manager ... Gianpaolo Coro
03:29 PM Task #10367 (Closed): Distribute a new letsencrypt configuration on all the hosts: Done. I created a small task under library/generic-tasks that only runs the letsencrypt role. I run it on every playb... Andrea Dell'Amico
12:59 PM Task #10367 (In Progress): Distribute a new letsencrypt configuration on all the hosts: Andrea Dell'Amico
12:51 PM Task #10367 (Closed): Distribute a new letsencrypt configuration on all the hosts: letsencrypt changed the TOS, so the client configuration must be changed to obtain new certificates or certificates r... Andrea Dell'Amico
12:31 PM Task #10279 (Closed): Large file upload limit on the workspace: Guys, thank you for your help. I really appreciate it :) Marek Horst
12:29 PM Task #10279: Large file upload limit on the workspace: Marek Horst wrote:
> All done.
>
> There is only one file left we need to fix its size: `epmc-meta-20171017.gz`. ... Costantino Perciante
10:05 AM Task #10279: Large file upload limit on the workspace: All done.
There is only one file left we need to fix its size: `epmc-meta-20171017.gz`. All the other were already... Marek Horst
11:44 AM VM Creation #10361 (Feedback): Install a new shinyproxy server: You now have both http and https. Still a self signed certificate, right now.
Andrea Dell'Amico
10:21 AM VM Creation #10361 (In Progress): Install a new shinyproxy server: Massimiliano Assante
10:17 AM Task #10366 (Closed): Add ParthenosVO scope to all the dataminer instances: It's needed to add the following scope and the related key in the ansible playbook on every dataminer instances:
~... Roberto Cirillo
09:50 AM Task #9203 (Closed): Enable access for production EDISON Portal instance: Massimiliano Assante

Nov 16, 2017

09:43 PM Task #10279: Large file upload limit on the workspace: Costantino Perciante wrote:
> I guess nginx closes the connection after a while. @andrea.dellamico@isti.cnr.it cou... Andrea Dell'Amico
07:00 PM Task #10279: Large file upload limit on the workspace: Marek Horst wrote:
> This time I got:
>
> ~~~
> <!DOCTYPE html>
> <html>
> <head>
> <title>Error</title>
> <... Roberto Cirillo
05:39 PM Task #10279: Large file upload limit on the workspace: Marek Horst wrote:
> This time I got:
>
> ~~~
> <!DOCTYPE html>
> <html>
> <head>
> <title>Error</title>
> <... Costantino Perciante
04:55 PM Task #10279: Large file upload limit on the workspace: This time I got:
~~~
<!DOCTYPE html>
<html>
<head>
<title>Error</title>
<style>
body {
width: 3... Marek Horst
01:48 PM Task #10279: Large file upload limit on the workspace: Marek Horst wrote:
> Costantino Perciante wrote:
> > It would be also better to perform a multipart-like post reque... Costantino Perciante
12:39 PM Task #10279: Large file upload limit on the workspace: Roberto Cirillo wrote:
> Marek Horst wrote:
> > Roberto Cirillo wrote:
> > > Before retry could you try to do a do... Marek Horst
12:22 PM Task #10279: Large file upload limit on the workspace: Marek Horst wrote:
> Roberto Cirillo wrote:
> > Before retry could you try to do a double compression of the file l... Roberto Cirillo
11:48 AM Task #10279: Large file upload limit on the workspace: Costantino Perciante wrote:
> It would be also better to perform a multipart-like post request. Like this:
>
> cu... Marek Horst
11:44 AM Task #10279: Large file upload limit on the workspace: Roberto Cirillo wrote:
> Before retry could you try to do a double compression of the file like "tar.gz"?
Unfortu... Marek Horst
09:45 AM Task #10279: Large file upload limit on the workspace: It would be also better to perform a multipart-like post request. Like this:
curl --header "gcube-token:**********... Costantino Perciante
09:40 AM Task #10279: Large file upload limit on the workspace: Before retry could you try to do a double compression of the file like "tar.gz"? Roberto Cirillo
09:28 AM Task #10279: Large file upload limit on the workspace: I tried to reupload `other-text-20171017.gz` file, this time I got:
~~~
<!DOCTYPE html>
<html>
<head>
<title>E... Marek Horst
09:33 PM VM Creation #10361 (Closed): Install a new shinyproxy server: Done. We do not have a valid ssh certificate though.
@massimiliano.assante@isti.cnr.it this is the instance to be ... Andrea Dell'Amico
08:51 PM VM Creation #10361 (In Progress): Install a new shinyproxy server: Andrea Dell'Amico
08:02 PM VM Creation #10361: Install a new shinyproxy server: shinyproxy-nauth1.d4science.org. IN A 146.48.123.122 Andrea Dell'Amico
07:58 PM VM Creation #10361 (Closed): Install a new shinyproxy server: We need a different kind of authentication.
Andrea Dell'Amico
07:51 PM Incident #10345: Gis Viewer does not produce images correctly: Checking with Gianpaolo on this issue We have discovered that the problem is the WMS request stored in the metadata o... Francesco Mangiacrapa
06:15 PM Incident #10345 (In Progress): Gis Viewer does not produce images correctly: Hi Gianpaolo,
analyzing the above link I believe that there is a problem with the field **width** (It is too high)... Francesco Mangiacrapa
07:10 PM Task #10223: Provide machines for FAO course: @gianpaolo.coro@isti.cnr.it , I did a fast test on some machines and these are the first results. Giancarlo Panichi
06:26 PM Task #10223: Provide machines for FAO course: @lucio.lelii@isti.cnr.it could you run the tests please? The machines are required by tomorrow. Gianpaolo Coro
06:52 PM Task #9703: wrong software and data distribution on node75.d4science.org: Could you please tell me what is doing this node?
If there will be no answer I will shutdown it in 24 hours.
Tommaso Piccioli
05:26 PM VM Creation #10356: Provide new VM for hosting a smart-executor service instance with the "accounting-insert-storage-se-plugin" plugin: The plugin is up and running. The related service endpoint is correctly registered to the infrastructure. Please @luc... Roberto Cirillo
01:16 PM VM Creation #10356 (In Progress): Provide new VM for hosting a smart-executor service instance with the "accounting-insert-storage-se-plugin" plugin: New VM name is quota-plugin.d4science.org Tommaso Piccioli
11:37 AM VM Creation #10356: Provide new VM for hosting a smart-executor service instance with the "accounting-insert-storage-se-plugin" plugin: As far as I understood smart-executor should not be modified. The issue is related to the plugin which has to be pack... Luca Frosini
11:12 AM VM Creation #10356: Provide new VM for hosting a smart-executor service instance with the "accounting-insert-storage-se-plugin" plugin: @luca.frosini@isti.cnr.it is the smart-executor ready to handle the new plugins installation method? Andrea Dell'Amico
04:46 PM Support #10357 (Closed): Support Vector Machines not working: We have switched to the SVMs of Rapid Miner which are equal to the one we were using but it is the "Svm" class instea... Gianpaolo Coro
02:43 PM Support #10357: Support Vector Machines not working: So one way could be to make SVMs use the same lib version of RapidMiner? Gianpaolo Coro
02:10 PM Support #10357: Support Vector Machines not working: It worked in the past only because the svn library integrated in the algortithm was the same version of the one in ra... Lucio Lelii
01:54 PM Support #10357: Support Vector Machines not working: I add that RapidMiner is one of the most important frameworks integrated by the DataMiner (together with Weka), thus ... Gianpaolo Coro
01:32 PM Support #10357: Support Vector Machines not working: No one is. RapidMiner is a third party framework. The current integrated version is 5, the last that was Open Source.... Gianpaolo Coro
12:47 PM Support #10357: Support Vector Machines not working: I'm not the developer of the repidminer jar. I really don't know who is using it in the algorithms and if it can be c... Lucio Lelii
12:40 PM Support #10357 (Closed): Support Vector Machines not working: SVMs are not working on the DataMiner. If this depends on the conflict is in the libsmv inside RapidMiner, this can b... Gianpaolo Coro
04:43 PM Incident #10306: mongo3-p-d4s.d4science.org went out of memory more than once: last hour news: there are connections to mongod on mongo3-p-d4s.d4science.org from the social-isti portal.
portal-... Tommaso Piccioli
02:24 PM Incident #10306: mongo3-p-d4s.d4science.org went out of memory more than once: I think the problem is on mongo3 node. This node has the same configuration and the same workload of mongo2 but the l... Roberto Cirillo
03:36 PM Task #10358 (Closed): Dataminer-cluster: Integrate the dm-192-168-100-104.garr.d4science.org instance into the garr cluster: The instance above has been removed from TextCrowd VRE and now it should be integrated into the dataminer-garr cluste... Roberto Cirillo

Nov 15, 2017

07:13 PM VM Creation #10356 (Closed): Provide new VM for hosting a smart-executor service instance with the "accounting-insert-storage-se-plugin" plugin: The playbook for accounting-insert-storage-se-plugin is available on ansible but it should be modified because previo... Roberto Cirillo
06:46 PM Task #10279: Large file upload limit on the workspace: I've tried to check the integrity with gzip -t and I confirm, the file is not complete. @andrea.dellamico@isti.cnr.it... Roberto Cirillo
06:43 PM Task #10279: Large file upload limit on the workspace: Unfortunately the file named other-text-20171017.gz in the storage layer is 28635607040 so I think it is not complete. Roberto Cirillo
03:55 PM Task #10279: Large file upload limit on the workspace: Marek Horst wrote:
> Costantino Perciante wrote:
>
> > Please let us know as soon as you finish with them
>
> ... Marek Horst
12:59 PM Task #10279: Large file upload limit on the workspace: Costantino Perciante wrote:
> Please let us know as soon as you finish with them
The last one (and the largest ... Marek Horst
11:59 AM Task #10279 (Feedback): Large file upload limit on the workspace: Roberto Cirillo
04:25 PM Task #10351: 404 error of Apache tomcat: The web browser proxies `/ssk` without exception, the 404 is returned by tomcat. It seems that the app does something... Andrea Dell'Amico
03:58 PM Task #10351: 404 error of Apache tomcat: I reproduced the issued, I suspect it is sth about the nginx configuration, I'm reassign the ticket to the sysadmins Massimiliano Assante
03:53 PM Task #10351 (In Progress): 404 error of Apache tomcat: Massimiliano Assante
03:04 PM Task #10351 (Closed): 404 error of Apache tomcat: Hi Massimiliano,
I have an issue on the actual running environment of SSK (http://ssk-application.parthenos.d4scie... Lionel Tadonfouet
04:25 PM Incident #10306 (In Progress): mongo3-p-d4s.d4science.org went out of memory more than once: I'm reopening it. Let's increase the RAM amount on all the other nodes so that they are identical.
Andrea Dell'Amico
04:08 PM Incident #10306 (Closed): mongo3-p-d4s.d4science.org went out of memory more than once: Thank you @tommaso.piccioli@isti.cnr.it I'm going to close this ticket. Roberto Cirillo
03:04 PM Incident #10306 (In Progress): mongo3-p-d4s.d4science.org went out of memory more than once: Done for mongo3-p-d4s Tommaso Piccioli
02:51 PM Incident #10306: mongo3-p-d4s.d4science.org went out of memory more than once: I'm going to restart mongo3 with 4GB of ram just now Tommaso Piccioli
02:38 PM Incident #10306: mongo3-p-d4s.d4science.org went out of memory more than once: Roberto Cirillo wrote:
> it's ok for me. If it's needed only a VM restart you can do it at any time, if it's neede... Andrea Dell'Amico
02:32 PM Incident #10306: mongo3-p-d4s.d4science.org went out of memory more than once: Andrea Dell'Amico wrote:
> Roberto Cirillo wrote:
> > It cannot be the cause of the issue #10279 since it is a Seco... Roberto Cirillo
01:11 PM VM Creation #10348 (Closed): Installation of Virtuoso Triplestore in the infrastructure: So far we have a running triplestore in the infrastructure (http://virtuoso.i-marine.d4science.org:8890).
It is bas... Yannis Marketakis
09:26 AM Task #10328 (Closed): OpenAIRE datathon schema files: Thanks Andrea! Claudio Atzori
01:04 AM Task #10328 (Feedback): OpenAIRE datathon schema files: If you need to modify/add/whatever file, you can access the directory with the static content using sftp:
~~~
sft... Andrea Dell'Amico
01:02 AM Task #10328 (In Progress): OpenAIRE datathon schema files: Done. You can access the files at these URLs:
http://datathon.openaire.eu/datathon-schema/oaf-common-1.1.xsd
http... Andrea Dell'Amico

Nov 14, 2017

06:37 PM Task #10328: OpenAIRE datathon schema files: Let's host the schema files from a static website. Something like the url below will do the job.
~~~
http://datat... Claudio Atzori
06:12 PM Task #10328: OpenAIRE datathon schema files: Hm. I need to pollute the haproxy configuration to setup explicit URL for each one of those. If they must be hidden i... Andrea Dell'Amico
04:42 PM Incident #10345 (Rejected): Gis Viewer does not produce images correctly: The Gis Viewer stretches the images and does not manage Thrreds layers properly.
Example of the issue and related ... Gianpaolo Coro
03:04 PM Task #10279: Large file upload limit on the workspace: Marek Horst wrote:
> Done. I am about to upload 3 more files:
>
> * `epmc-text-20171017.gz` (19GB, ongoing)
> * ... Costantino Perciante
12:36 PM Task #10279: Large file upload limit on the workspace: Marek Horst wrote:
> Roberto Cirillo wrote:
> > The file epmc-meta-20171017.gz is present on our storage with the f... Marek Horst
11:45 AM Task #10279: Large file upload limit on the workspace: Roberto Cirillo wrote:
> The file epmc-meta-20171017.gz is present on our storage with the following size: 875305864... Marek Horst
11:35 AM Task #10279: Large file upload limit on the workspace: The file epmc-meta-20171017.gz is present on our storage with the following size: 8753058643 bytes.
However this fi... Roberto Cirillo
10:40 AM Task #10279: Large file upload limit on the workspace: We managed to fix the largest of them (i.e. arxiv-text-20171017.gz); you can now download the entire file.
I kindl... Costantino Perciante
09:58 AM Task #10279: Large file upload limit on the workspace: Marek Horst wrote:
> Roberto Cirillo wrote:
> >
> > I confirm that the file arxiv-text-20171017.gz is present on... Marek Horst
09:27 AM Task #10279 (In Progress): Large file upload limit on the workspace: Roberto Cirillo
11:37 AM Task #9857: Evacuate the hypervisors from dlib14x to dlib19x: Since information is expected to come from different developers, I'm preparing a google sheet here to collect them : ... Fabio Sinibaldi

Nov 13, 2017

06:46 PM Task #10279: Large file upload limit on the workspace: Roberto Cirillo wrote:
>
> I confirm that the file arxiv-text-20171017.gz is present on our storage. The file siz... Marek Horst
06:37 PM Task #10279: Large file upload limit on the workspace: Marek Horst wrote:
> I managed to upload successfully 8GB file. It took 49 mins.
>
> When I tried to upload 12GB ... Roberto Cirillo
06:29 PM Task #10279: Large file upload limit on the workspace: Thank you Pasquale.
Tomorrow I will test curl upload against other server to eliminate client side problem. This i... Marek Horst
06:08 PM Task #10279: Large file upload limit on the workspace: I added few more people from the CNR team to this issue since they are working on the scene to understand the issue. ... Pasquale Pagano
05:22 PM Task #10279: Large file upload limit on the workspace: It seems only the "large enough" files are truncated. Here is the summary of already uploaded files:
|file name|up... Marek Horst
05:27 PM Task #10328 (Closed): OpenAIRE datathon schema files: Currently I hosted the schema files relative to Dataset #3 in the following directory:
https://goo.gl/e5HwxJ
Is... Claudio Atzori
03:22 PM Task #10263 (Closed): Chrome non-passive event listener issue on liked posts of VRE Parthenos: Added fix to the release Massimiliano Assante
12:16 PM Task #10317 (Closed): Increase the resources of dataminer[1:5]-p-d4s.d4science.org: RAM and CPU must be increased to 32GB and 16, respectively. This means that at least three of the VMs have to be mo... Andrea Dell'Amico
12:11 PM Task #10316 (Closed): Install the new physical hosts: We need more resource, so we cannot wait anymore.
They must be installed as the other ones, because to successfully ... Andrea Dell'Amico
11:46 AM Incident #10306: mongo3-p-d4s.d4science.org went out of memory more than once: Roberto Cirillo wrote:
> It cannot be the cause of the issue #10279 since it is a Secondary member and the writing a... Andrea Dell'Amico
11:36 AM Incident #10306 (Feedback): mongo3-p-d4s.d4science.org went out of memory more than once: It cannot be the cause of the issue #10279 since it is a Secondary member and the writing are done on the primary mem... Roberto Cirillo
11:30 AM Incident #10306 (In Progress): mongo3-p-d4s.d4science.org went out of memory more than once: Roberto Cirillo

Nov 12, 2017

03:36 PM Incident #10310 (Feedback): Rebuild two GARR dataminer VMs: ip-90-147-167-180.ct1.garrservices.it has been provisioned too.
Andrea Dell'Amico
03:17 PM Incident #10310: Rebuild two GARR dataminer VMs: ip-90-147-167-230.ct1.garrservices.it has been provisioned.
Andrea Dell'Amico
02:55 PM Incident #10310: Rebuild two GARR dataminer VMs: The VMs have been started, and the original public IP address associated to them. Andrea Dell'Amico
02:54 PM Incident #10310 (In Progress): Rebuild two GARR dataminer VMs: The VMs are:
~~~
ip-90-147-167-230.ct1.garrservices.it
ip-90-147-167-180.ct1.garrservices.it (this one is a gene... Andrea Dell'Amico
02:52 PM Incident #10310 (Closed): Rebuild two GARR dataminer VMs: They fail to restart because of `file system full` on the hypervisor.
Andrea Dell'Amico

Also available in: Atom

Project

General

Profile

D4Science Infrastructure

Activity

Activity

Dec 11, 2017

Dec 07, 2017

Dec 06, 2017

Dec 05, 2017

Dec 04, 2017

Dec 03, 2017

Dec 01, 2017

Nov 30, 2017

Nov 29, 2017

Nov 28, 2017

Nov 27, 2017

Nov 25, 2017

Nov 24, 2017

Nov 23, 2017

Nov 22, 2017

Nov 21, 2017

Nov 20, 2017

Nov 19, 2017

Nov 18, 2017

Nov 17, 2017

Nov 16, 2017

Nov 15, 2017

Nov 14, 2017

Nov 13, 2017

Nov 12, 2017