D4Science Infrastructure

Jan 13, 2018

06:07 PM Incident #10910 (In Progress): The accounting fallback logs are killing a lot of services

The disk on workspace-repository-prod1.d4science.org was full again. cleaned and restarted Andrea Dell'Amico

03:30 PM Incident #10910 (Closed): The accounting fallback logs are killing a lot of services

I stopped/cleaned up/restarted the services on all the above hosts. Things seems back to normal, a `fallback` account... Andrea Dell'Amico

02:55 PM Incident #10910 (In Progress): The accounting fallback logs are killing a lot of services

Andrea Dell'Amico

02:52 PM Incident #10910 (Closed): The accounting fallback logs are killing a lot of services

Here is a probably incomplete list (not all servers are monitored by nagios):
~~~
workspace-repository-prod1.d4sc... Andrea Dell'Amico

03:27 PM Incident #10909 (Feedback): Regular Failure of Dataminer "Garr" (2 out of 3 execution attempts) - Internal Server Error

The situation should be back to normal right now.
Andrea Dell'Amico

12:05 PM Incident #10909 (In Progress): Regular Failure of Dataminer "Garr" (2 out of 3 execution attempts) - Internal Server Error

Emmanuel Blondel wrote:
> If I run successively WPS requests, only an average of 1 out of 3 requests are working...T... Andrea Dell'Amico

11:50 AM Incident #10909 (Closed): Regular Failure of Dataminer "Garr" (2 out of 3 execution attempts) - Internal Server Error

If I run successively WPS requests, only an average of 1 out of 3 requests are working...This occurred in the past an... Emmanuel Blondel

Jan 12, 2018

07:57 PM Task #10829 (Closed): Workspace shared folder error

Thx @costantino.perciante@isti.cnr.it :) Denis Pyriochos

09:45 AM Task #10829: Workspace shared folder error

Denis Pyriochos wrote:
> Now DataMiner has Shared With info:
>
> Administrator: Denis
> Write Owner: Gerasimos
... Costantino Perciante

05:41 PM Task #10884 (Closed): Please deploy grsf-publisher-ws 1.5 in advance [gCube 4.10]

Thanks! Costantino Perciante

03:06 PM Task #10884 (Feedback): Please deploy grsf-publisher-ws 1.5 in advance [gCube 4.10]

The services are ready now. Roberto Cirillo

02:51 PM Task #10884: Please deploy grsf-publisher-ws 1.5 in advance [gCube 4.10]

We agreed with Roberto of updating both the preprod and production envs to keep them aligned.
Please @roberto.ciri... Costantino Perciante

02:35 PM Task #10884 (In Progress): Please deploy grsf-publisher-ws 1.5 in advance [gCube 4.10]

I need to reopen this ticket. I had to perform a fix on the service, thus could it be redeployed? Last version (with ... Costantino Perciante

04:15 PM Support #10867: deployment of stanbol

I beg you pardon - hadn't seen it Wolfgang Sauer

04:09 PM Support #10867 (Closed): deployment of stanbol

I already reported the version of Solr. It will be the latest officially distributed that should be the version 7.2.
... Pasquale Pagano

03:28 PM Support #10867: deployment of stanbol

to sum it up: please tell me your Solr version. Then I can run local tests and tell you exactly how much space we nee... Wolfgang Sauer

03:24 PM Support #10867: deployment of stanbol

@Pasquale as a standalone-application Stanbol requires about 22G (!) on our server. But this application contains an ... Wolfgang Sauer

12:46 PM Support #10867 (Feedback): deployment of stanbol

The new VM will host tomcat enhanced with SmartGears (to enable authorization, authentication, and accounting). The W... Pasquale Pagano

11:31 AM Support #10867: deployment of stanbol

thank you! Just a question for understanding: will the VM host the applicationserver (f.e. tomcat), the war and Solr ... Wolfgang Sauer

10:56 AM Support #10867 (In Progress): deployment of stanbol

Hello Wolfgang,
first thing to do is to ask for a new Virtual Machine to our sysadmin office. To do so please open a... Massimiliano Assante

03:55 PM Incident #10895: accounting bloat on workspace-repository-prod1.d4science.org - AGAIN

In my opinion these kind of problems should be fixed without any delay and not wait for the next release cycle. Andrea Dell'Amico

03:44 PM Incident #10895 (Closed): accounting bloat on workspace-repository-prod1.d4science.org - AGAIN

In order to fix asap this problem, I've deleted all the fallback files and removed the old log files. A fix should be... Roberto Cirillo

03:18 PM Incident #10895 (Closed): accounting bloat on workspace-repository-prod1.d4science.org - AGAIN

The same behaviour described in #10701
Does a fix exist?
Andrea Dell'Amico

Jan 11, 2018

07:22 PM Task #10884 (Closed): Please deploy grsf-publisher-ws 1.5 in advance [gCube 4.10]

Ok, the service is up and running. We can start publishing grsf records Costantino Perciante

06:31 PM Task #10884: Please deploy grsf-publisher-ws 1.5 in advance [gCube 4.10]

Installed, but @costantino.perciante@isti.cnr.it needs to produce a new build. Andrea Dell'Amico

06:23 PM Task #10884 (In Progress): Please deploy grsf-publisher-ws 1.5 in advance [gCube 4.10]

Andrea Dell'Amico

05:40 PM Task #10884 (Closed): Please deploy grsf-publisher-ws 1.5 in advance [gCube 4.10]

I need to prepare the smart-grsf-d4s.d4science.org machine with the newly grsf-publisher-ws (just built on etics) ava... Costantino Perciante

06:11 PM Task #9189: Temporary area via Workspace

Please, @lucio.lelii@isti.cnr.it clarifies the feasibility of this activity. It was requested many months ago and it ... Pasquale Pagano

04:32 PM Task #9189: Temporary area via Workspace

any news on that? Emmanuel Blondel

06:09 PM Task #10883 (Closed): R install.packages leaves lock files around if crashing while an installation is running

Done.
Andrea Dell'Amico

05:53 PM Task #10883: R install.packages leaves lock files around if crashing while an installation is running

Script changed, now it's going to be provisioned on every dataminer and Rstudio server. Andrea Dell'Amico

05:40 PM Task #10883 (In Progress): R install.packages leaves lock files around if crashing while an installation is running

Just changed the upgrade_r_packages script to remove all the lock files that it finds, before starting to install pac... Andrea Dell'Amico

05:39 PM Task #10883 (Closed): R install.packages leaves lock files around if crashing while an installation is running

And it is not able to distinguish between a legit lock to an obsolete one, so a manual removal is the only way to fix... Andrea Dell'Amico

05:18 PM 3rdPartyApplication Support #10643: Regional Data Collection Application Registration

Excellent question, i think the first step should be more clear as you're not the first asking this. It is quite safe... Massimiliano Assante

05:10 PM 3rdPartyApplication Support #10643: Regional Data Collection Application Registration

Dear Massimiliano,
we would like some additional information regarding the authentication workflow.
Based on the ... Konstantinos Apostolopoulos

04:21 PM Support #10867: deployment of stanbol

my college just brought up one important question: which is the version of Solr where you are going to create the ins... Wolfgang Sauer

Jan 10, 2018

07:58 PM Task #10857: CKAN and ansible installation: missing file ckan-d4science-extension/plugins/googleanalytics/plugin.py from repository

And I see why. That role is in the public section and not into the d4science-gcube playbook:
~~~
../library/roles... Andrea Dell'Amico

02:58 PM Task #10857: CKAN and ansible installation: missing file ckan-d4science-extension/plugins/googleanalytics/plugin.py from repository

I'm not sure but It seems not managed by the new system ..
That is a CKAN plugin (googleanalytics) and it is missing... Francesco Mangiacrapa

01:02 PM Task #10857: CKAN and ansible installation: missing file ckan-d4science-extension/plugins/googleanalytics/plugin.py from repository

Francesco should know if that file is now managed by the new scripts system. If so, that task can be removed altogeth... Andrea Dell'Amico

12:17 PM Task #10857 (Closed): CKAN and ansible installation: missing file ckan-d4science-extension/plugins/googleanalytics/plugin.py from repository

Please investigate if this is an issue or something no longer needed, with the help of @francesco.mangiacrapa@isti.cn... Costantino Perciante

05:38 PM Support #10867 (Closed): deployment of stanbol

a while ago we discussed in Pisa the deployment of a Stanbol instance in d4science (currently we're accessing our own... Wolfgang Sauer

05:29 PM Task #10861 (Feedback): Remove VO scopes from all CKanConnector instances

Done. Please, @costantino.perciante@isti.cnr.it could you perform a check? Roberto Cirillo

04:58 PM Task #10861 (In Progress): Remove VO scopes from all CKanConnector instances

I'm going to remove the VO scope from the following instances:
* ckan-sobigdata2.d4science.org (SoBigData scope)
... Roberto Cirillo

04:45 PM Task #10861 (Closed): Remove VO scopes from all CKanConnector instances

In order to avoid to discover a gCoreEndpoint accessible only at VO level from a VRE scope, it's needed to remove the... Roberto Cirillo

01:28 PM Task #10859 (Closed): Different Mono versions on servers?

I have been running both "ArchNER IT String" and "ArchNER IT File" algorithms on TextCrowd's DataMiner and the server... Daniel Williams

11:48 AM Incident #10856 (Closed): RStudio online crash

Roberto Cirillo

11:18 AM Incident #10856: RStudio online crash

It's work now and I have all my files.
Thank you. Chloé Dalleau

11:04 AM Incident #10856 (Feedback): RStudio online crash

I've reset your state. Please could you open a fresh browser window and retry? Roberto Cirillo

10:55 AM Incident #10856 (In Progress): RStudio online crash

Roberto Cirillo

10:26 AM Incident #10856 (Closed): RStudio online crash

Dear Sir or Madam,
I am writing to you about an issue with my "RStudio" online.
I lost all my working files and... Chloé Dalleau

11:37 AM Task #10855: ckan-grsf-admin2.d4science.org should run under GRSF_Admin

It seems the ckan-connector is not listening as service on that machine
I'm not able to access to ghn.log and ther... Costantino Perciante

10:54 AM Task #10855 (Feedback): ckan-grsf-admin2.d4science.org should run under GRSF_Admin

Could you check if it works as expected now? Roberto Cirillo

10:24 AM Task #10855 (In Progress): ckan-grsf-admin2.d4science.org should run under GRSF_Admin

Roberto Cirillo

10:14 AM Task #10855 (Closed): ckan-grsf-admin2.d4science.org should run under GRSF_Admin

The node was created for doing some tests in production. Now we should really use it (it contains smartgears and the ... Costantino Perciante

10:05 AM Task #10838: Alias for ckan-grsf-admin2.d4science.org machine

Tommaso Piccioli wrote:
> Certificate was OK this morning:
>
> Certificate Subject Alt Name:
> DNS Name: ckan-gr... Costantino Perciante

09:35 AM Task #10838 (Closed): Alias for ckan-grsf-admin2.d4science.org machine

Certificate was OK this morning:
Certificate Subject Alt Name:
DNS Name: ckan-grsf-admin.d4science.org
DNS Name:... Tommaso Piccioli

Jan 09, 2018

09:13 PM Task #10829: Workspace shared folder error

Now DataMiner has Shared With info:
Administrator: Denis
Write Owner: Gerasimos Denis Pyriochos

02:25 PM Task #10829: Workspace shared folder error

In the meantime the ACL was set for the "DataMiner" folder (as seen by Denis) and "DataMiner (0)" as seen by Gerasimo... Costantino Perciante

11:47 AM Task #10829: Workspace shared folder error

Denis Pyriochos wrote:
> My DataMiner folder, on the other hand, is "Shared: true" but "Shared with: (empty)" (see S... Costantino Perciante

11:39 AM Task #10829: Workspace shared folder error

My DataMiner folder, on the other hand, is "Shared: true" but "Shared with: (empty)" (see ShareWithNone image). Is th... Denis Pyriochos

10:53 AM Task #10829: Workspace shared folder error

Hi Gerasimos, I think the fact the names of the folders were the same was a mistake of mine while trying to fix them.... Costantino Perciante

05:52 PM Task #10838: Alias for ckan-grsf-admin2.d4science.org machine

renaming is always a bit awkward but it's doable.
I assumed that ckan-grsf-admin2.d4science.org was already in use.
Andrea Dell'Amico

05:49 PM Task #10838: Alias for ckan-grsf-admin2.d4science.org machine

I am wondering the following can be implemented instead
a) shut down ckan-grsf-admin.d4science.org
b) rename ckan... Pasquale Pagano

05:10 PM Task #10838: Alias for ckan-grsf-admin2.d4science.org machine

Usually we have to wait 2/3 days at maximum. The last big batch of updates was run Jan 2nd, so the certificate could ... Andrea Dell'Amico

05:07 PM Task #10838: Alias for ckan-grsf-admin2.d4science.org machine

Tommaso Piccioli wrote:
> we must wait for the new letsencrypt certificate, no way to obtain it immediately due to t... Costantino Perciante

04:26 PM Task #10838 (Feedback): Alias for ckan-grsf-admin2.d4science.org machine

we must wait for the new letsencrypt certificate, no way to obtain it immediately due to the limit to the number of r... Tommaso Piccioli

03:30 PM Task #10838 (In Progress): Alias for ckan-grsf-admin2.d4science.org machine

new letsencrypt certificate requested. Tommaso Piccioli

11:13 AM Task #10838 (Closed): Alias for ckan-grsf-admin2.d4science.org machine

We currently have two machines for the management activities of the GRSF community:
* https://ckan-grsf-admin2.d4s... Costantino Perciante

05:16 PM Task #9826: issue sharelatex (can't compile a whole report)

Hi @gianpaolo.coro@isti.cnr.it ,
I tried to collect all scripts and material in one zip file and do one download b... TAHA IMZILEN

03:23 PM Task #10664 (Closed): DataMiner - Create a list of the names of Python packages installed on the DataMiner machines

I'm closing this one. For the aginfra algorithm we needed a custom solution and we do not have any other requests for... Andrea Dell'Amico

Jan 08, 2018

09:57 PM Task #10829: Workspace shared folder error

Thank you @costantino.perciante@isti.cnr.it, now I can have access to my workspace. Maybe the folder named 'Data Mini... Gerasimos Antzoulatos

09:16 PM Task #10829: Workspace shared folder error

My ws is up and running! Thx @costantino.perciante@isti.cnr.it Denis Pyriochos

05:57 PM Task #10829 (Feedback): Workspace shared folder error

@denispyr@i2s.gr and @gantzoulatos@i2s.gr I think I fixed your workspaces. Please check them out
It seems there is... Costantino Perciante

11:39 AM Task #10829 (Closed): Workspace shared folder error

Costantino Perciante

04:33 PM Task #10813 (Closed): Make the new Support Vector Machines models available to the BiodiversityLab and ScalableDataMining VREs

Paolo Scarponi

04:33 PM Task #10813: Make the new Support Vector Machines models available to the BiodiversityLab and ScalableDataMining VREs

Thank you @roberto.cirillo@isti.cnr.it, now the two algorithms are available on both the requested VREs. Paolo Scarponi

04:28 PM Task #10813: Make the new Support Vector Machines models available to the BiodiversityLab and ScalableDataMining VREs

The resources have been added to the ScalableDataMining VRE as requested Roberto Cirillo

04:08 PM Task #10813 (In Progress): Make the new Support Vector Machines models available to the BiodiversityLab and ScalableDataMining VREs

The models are now available in BiodiversityLab, as for the ScalableDataMining environment I would ask @roberto.ciril... Paolo Scarponi

03:09 PM Task #10777 (Closed): Some files cannot be downloaded from the WS

Pasquale Pagano

03:04 PM Task #10826: CPU vulnerability

This is not an incident. It is a task that we need to perform to deal with an issue of the processors. Pasquale Pagano

02:28 PM Task #8442 (Closed): Authorization Service to update : auth@node7.d.d4science.research-infrastructures.eu

Roberto Cirillo

11:41 AM Incident #10821 (Closed): Cannot access workspace

We are going to investigate on it. Please look the related ticket for fixes Costantino Perciante

11:36 AM 3rdPartyApplication Support #10643 (Authorised): Regional Data Collection Application Registration

Dear Konstantinos,
your application has been authorised, please find the client id and client secret in the workspac... Massimiliano Assante

11:01 AM 3rdPartyApplication Support #10643: Regional Data Collection Application Registration

Hi Konstantinos,
the logo you provided is of the BlueBRIDGE Project, you should provide us with the specific one for... Massimiliano Assante

Jan 05, 2018

04:38 PM Task #10826: CPU vulnerability

These are our server CPU types:
~~~
dlib14x Manufacturer: AMD Version: Quad-Core AMD Opteron(tm) Processor... Tommaso Piccioli

04:36 PM Task #10826 (Closed): CPU vulnerability

See also:
https://googleprojectzero.blogspot.it/2018/01/reading-privileged-memory-with-side.html Tommaso Piccioli

Jan 04, 2018

07:45 PM Incident #10821: Cannot access workspace

Thanks Massimiliano! Gerasimos Antzoulatos

02:11 PM Incident #10821: Cannot access workspace

sure we can Gerasimos, we're working on fixing your problem too. Massimiliano Assante

04:36 PM Task #10825 (Closed): Refactor the ansible roles and playbooks to remove some complexity

What I want to achieve:
* Add roles dependencies to the roles themselves, without relying on booleans to activate ... Andrea Dell'Amico

04:20 PM Task #10685 (Closed): Add new cronjob on accounting-aggregator

Andrea Dell'Amico

04:05 PM Task #7356 (Closed): Please check HA Load Balancer on preprod

Andrea Dell'Amico

02:49 PM Incident #10823 (Closed): social.isti.cnr.it TLS error with latest Firefox version

It works also with Firefox on Mac, Firefox Quantum, 57.0.3 Pasquale Pagano

01:53 PM Incident #10823 (Feedback): social.isti.cnr.it TLS error with latest Firefox version

It should be fixed. I tested with the latest firefox Andrea Dell'Amico

01:32 PM Incident #10823 (In Progress): social.isti.cnr.it TLS error with latest Firefox version

Yes, it's the same problem. A more modern apache is needed, I'm going to install it. Some downtime is expected.
Andrea Dell'Amico

12:39 PM Incident #10823 (Closed): social.isti.cnr.it TLS error with latest Firefox version

Seems the same of the Incident #10006, however here we have an old Liferay and Tomcat 6 version with (afaik) an apach... Massimiliano Assante

01:53 PM Task #10816 (Closed): TLS Error on services.d4science.org when accessed by Firefox

Andrea Dell'Amico

Jan 03, 2018

08:53 PM Incident #10821: Cannot access workspace

Dear all, have a nice new year!!!
I also noticed yesterday evening that I have the same problem with my workspace.... Gerasimos Antzoulatos

05:01 PM Incident #10821: Cannot access workspace

I confirm that there's an issue with your workspace. Costantino will look into it as soon as he gets back to work. Massimiliano Assante

03:26 PM Incident #10821: Cannot access workspace

I don't recall using it since the Functional Testing of gcube 4.8, when I updated the tests in gCube VRE Folder Denis Pyriochos

03:16 PM Incident #10821: Cannot access workspace

The issue seems to be for you user only as the other workspaces work, did you do any operation on the workspace latel... Massimiliano Assante

02:42 PM Incident #10821: Cannot access workspace

Hey Massi. Yes, it is still the same. Denis Pyriochos

01:51 PM Incident #10821 (In Progress): Cannot access workspace

Hello Denys do you still experience the issue? Massimiliano Assante

01:26 PM Incident #10821 (Closed): Cannot access workspace

Trying to access my Workspace (https://bluebridge.d4science.org/group/bluebridge-gateway/workspace) I get the error m... Denis Pyriochos

07:18 PM Task #9213: enable calDAV authentication on D4Science Gateways

Andrea Dell'Amico wrote:
> I've fixed a discrepancy in the web server and haproxy versions between the preprod and t... Andrea Dell'Amico

07:03 PM Task #9213 (Closed): enable calDAV authentication on D4Science Gateways

great! Massimiliano Assante

Jan 02, 2018

03:21 PM Task #10816 (Feedback): TLS Error on services.d4science.org when accessed by Firefox

It seems a openssl bug. Why it started showing now I've yet to understand. I worked around it for the time being and ... Andrea Dell'Amico

02:57 PM Task #10816 (In Progress): TLS Error on services.d4science.org when accessed by Firefox

Luca Frosini

02:56 PM Task #10816 (Closed): TLS Error on services.d4science.org when accessed by Firefox

Luca Frosini

02:19 PM Task #10816 (In Progress): TLS Error on services.d4science.org when accessed by Firefox

I'm investigating the issue. I do not have a clue yet, the same exact configuration is working on the dev and preprod... Andrea Dell'Amico

01:59 PM Task #10816 (Closed): TLS Error on services.d4science.org when accessed by Firefox

Portals hosted in services.d4science.org cannot be accessed with Firefox Browser. Reported error message is :
"An... Fabio Sinibaldi

02:56 PM Support #10817 (Closed): Infrastructure gateways TLS error with Firefox

Luca Frosini

02:54 PM Support #10817 (Closed): Infrastructure gateways TLS error with Firefox

Luca Frosini

Dec 29, 2017

06:19 PM Task #9213 (Feedback): enable calDAV authentication on D4Science Gateways

I've fixed a discrepancy in the web server and haproxy versions between the preprod and the production servers. Now t... Andrea Dell'Amico

12:29 PM 3rdPartyApplication Support #9977: Ariadne integration. OAuth 2.0

Cannot authorize Ariadne now but pc Ponchio is authorized with the url you provided. Puoi sviluppare con quello. Massimiliano Assante

Dec 28, 2017

05:07 PM 3rdPartyApplication Support #9977: Ariadne integration. OAuth 2.0

Ciao, ho un problema col redirect url:
se uso http://ariadne1.isti.cnr.it mi dice che deve essere un https://
>... Federico Ponchio

Dec 22, 2017

04:57 PM Task #10814 (Closed): Please Deploy new document-store-lib-accounting-service (1.2.0-SNAPSHOT) on dev nodes to start to test it

Luca Frosini

04:53 PM Task #10813 (Closed): Make the new Support Vector Machines models available to the BiodiversityLab and ScalableDataMining VREs

The following (completely new) algorithms will substitute the previous SVM processes for which I found several bugs:
... Gianpaolo Coro

02:46 PM Incident #10791 (Closed): php session files on wiki.d4science.org are filling up the disk

I added a cron job that cleanup the empty session files and the ones older than three days.
Some space should be mad... Andrea Dell'Amico

11:57 AM Incident #10791 (Closed): php session files on wiki.d4science.org are filling up the disk

They are never removed, we need a script to cleanup the old files.
Andrea Dell'Amico

01:52 PM Task #10748 (Closed): Reinstall 2 GARR dataminer instances

The two dataminer have been added back to the load balancer.
Andrea Dell'Amico

11:27 AM VM Creation #10790 (Closed): Catalogue-ws: please create a VM for it in preprod

Costantino Perciante

Dec 21, 2017

08:30 PM Task #10666 (Closed): DataMiner - Install Eartrack software for support DataMiner algorithms

I don't see a difference between this ticket and #10653, I'm closing this one. Andrea Dell'Amico

07:17 PM Task #10666 (In Progress): DataMiner - Install Eartrack software for support DataMiner algorithms

On a second look, it should be useful to us in the long run. Andrea Dell'Amico

06:52 PM Task #10666: DataMiner - Install Eartrack software for support DataMiner algorithms

Well, conda is a real mess for us.
It installs its own python environment that's totally incompatible with the alrea... Andrea Dell'Amico

05:46 PM Task #10666: DataMiner - Install Eartrack software for support DataMiner algorithms

Well, if it works I would say to try it Giancarlo Panichi

08:22 PM Task #10664: DataMiner - Create a list of the names of Python packages installed on the DataMiner machines

Another consideration: the above lists are completely useless to the people that is going to use conda. conda is a co... Andrea Dell'Amico

06:08 PM Task #10664: DataMiner - Create a list of the names of Python packages installed on the DataMiner machines

I will not track the packages that are not explicitly required for the dataminers btw, because they can be triggered ... Andrea Dell'Amico

06:06 PM Task #10664 (In Progress): DataMiner - Create a list of the names of Python packages installed on the DataMiner machines

The python environment that's currently installed on all the dataminer servers is based on python 2.7.6 (Ubuntu 14.04... Andrea Dell'Amico

06:45 PM Task #10777: Some files cannot be downloaded from the WS

I am going to close this incident. Please reopen if needed. Pasquale Pagano

04:15 PM Task #10777 (Feedback): Some files cannot be downloaded from the WS

Costantino Perciante

04:15 PM Task #10777: Some files cannot be downloaded from the WS

Gianpaolo Coro wrote:
> Here is another one in that folder: TrainedNeuralNetwork_[FEED_FORWARD_NEURAL_NETWORK_TRAINE... Costantino Perciante

02:43 PM Task #10777 (In Progress): Some files cannot be downloaded from the WS

Here is another one in that folder: TrainedNeuralNetwork_[FEED_FORWARD_NEURAL_NETWORK_TRAINER_ID_25b5bee9-233e-40eb-a... Gianpaolo Coro

12:40 PM Task #10777: Some files cannot be downloaded from the WS

Let me add a comment to this ticket, since the fix I was thinking about requires more time and tests than directly fi... Costantino Perciante

05:53 PM Task #10786 (Closed): WOFOST - this algorithm must be in the scope of AgroClimaticModelling

Done Roberto Cirillo

05:50 PM Task #10786 (In Progress): WOFOST - this algorithm must be in the scope of AgroClimaticModelling

Roberto Cirillo

05:40 PM Task #10786 (Closed): WOFOST - this algorithm must be in the scope of AgroClimaticModelling

Currently there are three resources on the IS for WOFOST algorithm.
Two resources declare only:
* /d4science.re... Giancarlo Panichi

04:31 PM Task #10748: Reinstall 2 GARR dataminer instances

Reconfigured. I'll add them again to the corresponding cluster tomorrow, so that I'll sure that all the R dependencie... Andrea Dell'Amico

03:03 PM Task #10748: Reinstall 2 GARR dataminer instances

The configuration is ongoing.
Andrea Dell'Amico

03:47 PM Task #10783 (Closed): Reinstall worker8-hadoop.d4science.org

The VM is ready to be reconfigured. Andrea Dell'Amico

03:40 PM Task #10783 (In Progress): Reinstall worker8-hadoop.d4science.org

Andrea Dell'Amico

03:25 PM Task #10783 (Closed): Reinstall worker8-hadoop.d4science.org

On a more performant hypervisor.
Andrea Dell'Amico

03:12 PM Task #10758: R Packages Lists for RStudio - Distinguish between Prototyping and Production Environments

I see. If we can wait, there's a chance that the GARR cloud people will enable CephFS for us in some weeks. With it w... Andrea Dell'Amico

02:24 PM Task #10758: R Packages Lists for RStudio - Distinguish between Prototyping and Production Environments

It is not that simple, really. There are several rstudio instances that are shared with both proto and production VRE... Roberto Cirillo

02:17 PM Task #10726 (Closed): scopes of sdmx-datasource-d.dev.d4science.org

Now the service is running only on NextNext scope as requested. Roberto Cirillo

02:09 PM Task #10726 (In Progress): scopes of sdmx-datasource-d.dev.d4science.org

Roberto Cirillo

02:13 PM Task #10769 (Closed): Enable ldap authentication on grafana.d4science.org

Done. I also added the hadoop dashboards to show some data.
Andrea Dell'Amico

12:34 PM Task #10769: Enable ldap authentication on grafana.d4science.org

Now I'll move the configuration to a postgresql database.
Andrea Dell'Amico

12:33 PM Task #10769: Enable ldap authentication on grafana.d4science.org

Done. There's what I guess it's a bug, because if I set the mail field correctly the authentication fails because it ... Andrea Dell'Amico

12:18 PM Upgrade #10585 (Completed): D4Science Infrastructure Upgrade to gCube 4.9.0

Roberto Cirillo

12:18 PM Upgrade #10585 (In Progress): D4Science Infrastructure Upgrade to gCube 4.9.0

Roberto Cirillo

12:16 PM VRE #10751 (Released): Create pre-production VRE to serve PARTHENOS developments of Joint Resource Registry

Massimiliano Assante

12:16 PM VRE #10751 (Available): Create pre-production VRE to serve PARTHENOS developments of Joint Resource Registry

Massimiliano Assante

12:15 PM VRE #10751: Create pre-production VRE to serve PARTHENOS developments of Joint Resource Registry

The VRE has been created https://pre.d4science.org/group/parthenos_pre access to @alessia.bardi@isti.cnr.it has been ... Massimiliano Assante

Dec 20, 2017

09:15 PM Task #10769: Enable ldap authentication on grafana.d4science.org

Yet to find how to match the groups
Andrea Dell'Amico

06:07 PM Task #10769 (In Progress): Enable ldap authentication on grafana.d4science.org

Andrea Dell'Amico

12:43 PM Task #10769 (Closed): Enable ldap authentication on grafana.d4science.org

Natively in the grafana configuration Andrea Dell'Amico

05:29 PM Task #10748 (In Progress): Reinstall 2 GARR dataminer instances

VM creation is failing right now. Andrea Dell'Amico

04:58 PM Task #10777 (Closed): Some files cannot be downloaded from the WS

Costantino Perciante

04:55 PM Task #10777 (In Progress): Some files cannot be downloaded from the WS

It seems the files in the folder do have a wrong identifier (but a correct storage path).
I'm going to implement a... Costantino Perciante

03:18 PM Task #10777 (Closed): Some files cannot be downloaded from the WS

I have noticed that some files in the folder I usually use for testing DataMiner cannot be downloaded anymore:
Wor... Gianpaolo Coro

03:58 PM Task #10664: DataMiner - Create a list of the names of Python packages installed on the DataMiner machines

Any news? Giancarlo Panichi

12:11 PM Task #10317 (Closed): Increase the resources of dataminer[1:5]-p-d4s.d4science.org

Andrea Dell'Amico wrote:
>
> dataminer5-proto.d4science.org is being configured (I missed it).
dataminer5-proto... Andrea Dell'Amico

12:08 PM Task #10758: R Packages Lists for RStudio - Distinguish between Prototyping and Production Environments

It's doable, the R packages management is the same on both the dataminer and rstudio servers.
Renaming a node is a p... Andrea Dell'Amico

11:03 AM Task #10758: R Packages Lists for RStudio - Distinguish between Prototyping and Production Environments

I think it is the right way for avoiding this kind of issue. The proto instances could be named with the "-proto" suf... Roberto Cirillo

10:57 AM Task #10187: Enhance SAI

The previous requests were satisfied with Release 4.9.0 missing only the project copy that passes to Release 4.10.0 Giancarlo Panichi

10:23 AM Task #10726: scopes of sdmx-datasource-d.dev.d4science.org

I would like to do the final test before Christmas vacations, if possible, in order to plan potential modifications a... Ciro Formisano

03:39 AM VM Creation #10686: New VM with Resource Registry instance

As a further evidence, I'm able to contact this Resource Registry instance from the Resource Manager. Thanks.
Manuele Simi

Dec 19, 2017

06:08 PM Task #10317: Increase the resources of dataminer[1:5]-p-d4s.d4science.org

dataminer[1:5]-p-d4s.d4science.org are now running with 32 GB of RAM and 16 CPUs. Added to the dataminer.garr haproxy... Andrea Dell'Amico

05:49 PM Upgrade #10736 (Completed): FARM VO upgrade to gCube 4.9.0

Roberto Cirillo

05:48 PM Upgrade #10736 (In Progress): FARM VO upgrade to gCube 4.9.0

Roberto Cirillo

05:47 PM Upgrade #10734 (Completed): D4Research VO upgrade to 4.9.0

Roberto Cirillo

03:11 PM Upgrade #10734 (In Progress): D4Research VO upgrade to 4.9.0

Roberto Cirillo

05:47 PM Upgrade #10732 (Completed): gCubeApps VO upgrade to gCube 4.9.0

Roberto Cirillo

02:59 PM Upgrade #10732 (In Progress): gCubeApps VO upgrade to gCube 4.9.0

Roberto Cirillo

04:18 PM Upgrade #10587 (Completed): D4Science Gateways upgrade to gCube 4.9.0

Massimiliano Assante

03:00 PM Upgrade #10587 (In Progress): D4Science Gateways upgrade to gCube 4.9.0

Massimiliano Assante

04:07 PM Task #10758 (New): R Packages Lists for RStudio - Distinguish between Prototyping and Production Environments

We currently have to sets of R packages lists, one for the Prototyping Environments (the VREs with SAI) and one for t... Paolo Scarponi

04:06 PM Incident #10716 (Closed): gCube Releases portlet showing Release has been archived and is not accessible anymore

Massimiliano Assante

03:54 PM Upgrade #10731 (Completed): D4Science Root VO upgrade to gCube 4.9

Roberto Cirillo

03:53 PM Upgrade #10731 (In Progress): D4Science Root VO upgrade to gCube 4.9

Roberto Cirillo

02:59 PM Upgrade #10588 (Completed): D4Science Preprod Gateway upgrade to gCube 4.9.0

Massimiliano Assante

11:47 AM Task #9132 (Closed): Dismiss the PC used as a server by the D-Net team

Andrea Dell'Amico

11:46 AM Task #9134 (Closed): Move everything from dlib34.isti.cnr.it to playground-t.dnet.d4science.org

Done weeks ago. Andrea Dell'Amico

11:46 AM Incident #10717 (Closed): Tagme stops responding because is going out of heap space

Andrea Dell'Amico

11:46 AM Incident #10717: Tagme stops responding because is going out of heap space

Closing the ticket. If those accesses were legit, they should rate limit it before removing the firewall rules. Andrea Dell'Amico

Dec 18, 2017

06:59 PM Task #10317: Increase the resources of dataminer[1:5]-p-d4s.d4science.org

dataminer1-p-d4s.d4science.org: 16 vcpus, 32 GB ram
dataminer2-p-d4s.d4science.org: 16 vcpus, 16 GB ram at the momen... Tommaso Piccioli

06:45 PM Task #10317: Increase the resources of dataminer[1:5]-p-d4s.d4science.org

It is not clear to me the performed work.
I was expecting to have
- dataminer[1:5]-p-d4s.d4science.org, 32GB ... Pasquale Pagano

05:37 PM Task #10317 (In Progress): Increase the resources of dataminer[1:5]-p-d4s.d4science.org

dataminer1-p-d4s.d4science.org: moved from dlib23x.dom0.research-infrastructures.eu to dlib34x.dom0.research-infrastr... Tommaso Piccioli

05:47 PM VRE #10751 (In Progress): Create pre-production VRE to serve PARTHENOS developments of Joint Resource Registry

Massimiliano Assante

05:46 PM VRE #10751 (Planned): Create pre-production VRE to serve PARTHENOS developments of Joint Resource Registry

Massimiliano Assante

05:41 PM VRE #10751 (Released): Create pre-production VRE to serve PARTHENOS developments of Joint Resource Registry

A new VRE called "ParthenosPre" must be created under the scope "/gcube/preprod" in order to perform data publishing ... Francesco Mangiacrapa

05:01 PM Task #10748 (Closed): Reinstall 2 GARR dataminer instances

The one with hostname ip-90-147-167-236.ct1.garrservices.it fails executing jobs correctly even if there's apparently... Andrea Dell'Amico

04:22 PM Task #10729 (Closed): Broken disk on dlib33x.dom0.research-infrastructures.eu

Tommaso Piccioli

04:21 PM Task #10729: Broken disk on dlib33x.dom0.research-infrastructures.eu

resync done, the disk sdi seems to be OK (2/3 tested) Tommaso Piccioli

01:37 PM Task #10729: Broken disk on dlib33x.dom0.research-infrastructures.eu

That's worrisome, the omsa tools should have reported them to nagios. Or maybe the problem lasted too little time to ... Andrea Dell'Amico

11:32 AM Task #10729: Broken disk on dlib33x.dom0.research-infrastructures.eu

From the idrac log:
2017-12-18T01:55:05-0600 PDR3
Disk 6 in Backplane 1 of Integrated RAID Controller 1 is ... Tommaso Piccioli

09:40 AM Task #10729 (In Progress): Broken disk on dlib33x.dom0.research-infrastructures.eu

From the dmesg:
[Mon Dec 18 01:57:03 2017] sd 0:0:6:0: [sdg] Device not ready
...
[Mon Dec 18 01:57:03 2017] md/... Tommaso Piccioli

09:29 AM Task #10729 (Closed): Broken disk on dlib33x.dom0.research-infrastructures.eu

From the nagios check:
~~~
CRITICAL: mdstat:[md3(931.39 GiB raid1):F:sdg1:_U, md2(931.39 GiB raid1):UU, md1(931... Andrea Dell'Amico

02:40 PM Upgrade #10585 (Planned): D4Science Infrastructure Upgrade to gCube 4.9.0

Roberto Cirillo

12:22 PM Upgrade #10736 (Planned): FARM VO upgrade to gCube 4.9.0

Roberto Cirillo

10:15 AM Upgrade #10736: FARM VO upgrade to gCube 4.9.0

**Hosting Nodes**
*WHN to upgrade*
* **(CNR) DONE** all the ghn under the following cluster: dataminer-clust... Roberto Cirillo

10:13 AM Upgrade #10736 (Completed): FARM VO upgrade to gCube 4.9.0

Roberto Cirillo

12:21 PM Upgrade #10732 (Planned): gCubeApps VO upgrade to gCube 4.9.0

Roberto Cirillo

10:05 AM Upgrade #10732: gCubeApps VO upgrade to gCube 4.9.0

**Hosting Nodes**
*WHN to upgrade*
* **(CNR) DONE** upgrade all the WHNs under the following clusters:
* *... Roberto Cirillo

10:00 AM Upgrade #10732 (Completed): gCubeApps VO upgrade to gCube 4.9.0

Roberto Cirillo

12:12 PM Incident #10716 (In Progress): gCube Releases portlet showing Release has been archived and is not accessible anymore

The problem is due to failing on setting context (the production SCOPE is missing). In particular is failing the foll... Francesco Mangiacrapa

11:59 AM Upgrade #10637 (Completed): /gcube/preprod upgrade to gCube 4.9.0

Roberto Cirillo

11:51 AM VM Creation #10686: New VM with Resource Registry instance

Seems working now. Thanks a lot. Luca Frosini

10:19 AM VM Creation #10686 (Closed): New VM with Resource Registry instance

There was a double `/` on the nginx configuration. Fixed now. Andrea Dell'Amico

10:16 AM VM Creation #10686 (Feedback): New VM with Resource Registry instance

Luca Frosini

10:15 AM VM Creation #10686 (In Progress): New VM with Resource Registry instance

Luca Frosini

10:13 AM VM Creation #10686: New VM with Resource Registry instance

@andrea.dellamico@isti.cnr.it
Is it this base url correct?
http://manuele-registry.dev.d4science.org/resource-re... Luca Frosini

10:02 AM VM Creation #10686 (Closed): New VM with Resource Registry instance

I successfully created and initialized the database.
@manuele.simi@isti.cnr.it you can start using the registry Luca Frosini

10:11 AM Upgrade #10734 (Planned): D4Research VO upgrade to 4.9.0

**Hosting Nodes**
*WHN to upgrade*
* **(CNR) DONE** dm-pool-manager-proto.d4science.org
* all the WHNs under... Roberto Cirillo

10:07 AM Upgrade #10734 (Completed): D4Research VO upgrade to 4.9.0

Roberto Cirillo

09:59 AM Upgrade #10731 (Planned): D4Science Root VO upgrade to gCube 4.9

Roberto Cirillo

09:59 AM Upgrade #10731: D4Science Root VO upgrade to gCube 4.9

**HostingNode**
*WHN to upgrade*
* **(CNR) DONE** sdi.d4science.org
* **(CNR) DONE** thredds.d4science.org
... Roberto Cirillo

09:54 AM Upgrade #10731 (Completed): D4Science Root VO upgrade to gCube 4.9

Roberto Cirillo

09:55 AM Task #10666: DataMiner - Install Eartrack software for support DataMiner algorithms

I see that there's a conda module for ansible, here: https://github.com/UDST/ansible-conda Andrea Dell'Amico

Dec 17, 2017

05:17 PM VM Creation #10686: New VM with Resource Registry instance

Andrea Dell'Amico wrote:
> Hostname and IP address are going to be: manuele-registry.dev.d4science.org 146.48.122.19... Manuele Simi

04:00 PM VM Creation #10686 (Feedback): New VM with Resource Registry instance

The VM is up. The resource registry configuration should be verified. @luca.frosini@isti.cnr.it can you do that? I ga... Andrea Dell'Amico

02:54 PM VM Creation #10686: New VM with Resource Registry instance

Hostname and IP address are going to be: manuele-registry.dev.d4science.org 146.48.122.19 Andrea Dell'Amico

02:50 PM VM Creation #10686 (In Progress): New VM with Resource Registry instance

Andrea Dell'Amico

Dec 15, 2017

06:32 PM Task #10726 (Closed): scopes of sdmx-datasource-d.dev.d4science.org

The Node sdmx-datasource-d.dev.d4science.org currently runs on two scopes, devNext and devNext/nextNext: please, may ... Ciro Formisano

06:03 PM Task #10662 (Closed): orientdb01-d4s.d4science.org keeps crashing badly

For the moment the solution was adding -Dstorage.diskCache.bufferSize=7200
So we have:
orientdb_java_heap: '-Xms3... Luca Frosini

06:02 PM Task #10662: orientdb01-d4s.d4science.org keeps crashing badly

thank you. I'm testing version 2.2.30 in dev and I hope to add all of them again soon Luca Frosini

05:51 PM Task #10662: orientdb01-d4s.d4science.org keeps crashing badly

@luca.frosini@isti.cnr.it just remove the two nodes from the inventory file. When we will be able to use them we'll a... Andrea Dell'Amico

05:48 PM Task #10662: orientdb01-d4s.d4science.org keeps crashing badly

Launching the playbook startService script is overwritten.
This causes problems because instance 2 and 3 must be dow... Luca Frosini

05:30 PM Task #9942 (Closed): Change the way to generate the logback.xml in smartgears container

Luca Frosini

05:08 PM Task #10723 (Closed): Please upgrade the indicated machine

The following machine still produce TaskUsageRecords which doe not exists anymore:
* social-indexer.d4science.org:80... Luca Frosini

04:30 PM Incident #10717 (Feedback): Tagme stops responding because is going out of heap space

Tommaso Piccioli

04:27 PM Incident #10717 (In Progress): Tagme stops responding because is going out of heap space

We placed a rule to reject network 141.115.102.160/27.
Tomcat restarted, let see what happens.
Tommaso Piccioli

03:18 PM Incident #10717 (Closed): Tagme stops responding because is going out of heap space

It seems that a lot of accesses started today from 141.115.102.180 (many requests per second, often) and the servic... Andrea Dell'Amico

03:05 PM Incident #10716 (Closed): gCube Releases portlet showing Release has been archived and is not accessible anymore

When I go to https://dev.d4science.org/docs it is not possible to access the artifacts anymore.
It shows the notes... Massimiliano Assante

03:00 PM Task #10712 (Closed): Create TextCrowd Support Environment

Massimiliano Assante

02:47 PM Task #10712 (In Progress): Create TextCrowd Support Environment

Luca Frosini

02:45 PM Task #10712 (Closed): Create TextCrowd Support Environment

Luca Frosini

03:00 PM Task #10714 (Closed): Add Redmine Project to VRE

https://services.d4science.org/group/textcrowd/activity-tracker Massimiliano Assante

02:55 PM Task #10714: Add Redmine Project to VRE

The project is available here:
https://support.d4science.org/projects/textcrowd
@massimiliano.assante@isti.cnr.it... Luca Frosini

02:49 PM Task #10714 (Closed): Add Redmine Project to VRE

Luca Frosini

02:59 PM Task #10713 (Closed): Create TextCrowd Redmine Project

The tracker has been integrated in the VRE
https://services.d4science.org/group/textcrowd/activity-tracker Massimiliano Assante

02:54 PM Task #10713 (Feedback): Create TextCrowd Redmine Project

The project is available here:
https://support.d4science.org/projects/textcrowd
I added D4STeam LDAP group as dev... Luca Frosini

02:47 PM Task #10713 (Closed): Create TextCrowd Redmine Project

Trackers indicated from @pasquale.pagano@isti.cnr.it
* feature
* task
* support
* bug Luca Frosini