Project

General

Profile

Actions

VM Creation #12053

closed

Create new CKAN instance for SBD catalogue: ckan.sobigdata.d4science.net

Added by Francesco Mangiacrapa almost 7 years ago. Updated almost 7 years ago.

Status:
Closed
Priority:
Urgent
Assignee:
_InfraScience Systems Engineer
Target version:
Start date:
Jun 27, 2018
Due date:
% Done:

100%

Infrastructure:
Production
RAM:
4
CPU:
2
DiskSpace:
10
Smartgears:
Yes
Smartgears Version:
Application Instructions:
Smartgears scopes:

/d4science.research-infrastructures.eu/SoBigData/ResourceCatalogue

Applications list and version:
Applications context path:
External storage data disk:
Smartgears auth connector:
CKAN connector
data transfer enabled:
No
PostgreSQL database:
No
Number of VMs:
1

Files

Screen Shot 2018-07-07 at 08.22.14.png (378 KB) Screen Shot 2018-07-07 at 08.22.14.png Pasquale Pagano, Jul 07, 2018 08:24 AM
Actions #2

Updated by Francesco Mangiacrapa almost 7 years ago

  • PostgreSQL database changed from Yes to No
Actions #3

Updated by Francesco Mangiacrapa almost 7 years ago

  • Subject changed from Create new CKAN instance for SBD catalogue: ckan-sobigdata.d4science.net to Create new CKAN instance for SBD catalogue: ckan-sobigdata1.d4science.net
Actions #4

Updated by Tommaso Piccioli almost 7 years ago

  • Status changed from New to In Progress
  • % Done changed from 0 to 50

VM ckan.sobigdata.d4science.net running, to be provisioned.

Actions #5

Updated by Andrea Dell'Amico almost 7 years ago

  • % Done changed from 50 to 90

The VM has been provisioned. If the harvesting succeeds, we can switch the hostname and the smartgears scope.

Actions #6

Updated by Andrea Dell'Amico almost 7 years ago

We've found a clash between a file that we overwrite and a newer version of that file. It's /usr/lib/ckan/default/src/ckanext-harvest/ckanext/harvest/harvesters/base.py, that now includes a class definition that was inside a different file in the past.

Actions #7

Updated by Andrea Dell'Amico almost 7 years ago

The problem has been solved.

Actions #8

Updated by Francesco Mangiacrapa almost 7 years ago

  • Subject changed from Create new CKAN instance for SBD catalogue: ckan-sobigdata1.d4science.net to Create new CKAN instance for SBD catalogue: ckan.sobigdata.d4science.net
  • Status changed from In Progress to Closed
  • % Done changed from 90 to 100
Actions #9

Updated by Andrea Dell'Amico almost 7 years ago

  • Status changed from Closed to In Progress

We still need to move the hostname and the smartgears scope registration.

Actions #10

Updated by Andrea Dell'Amico almost 7 years ago

@francesco.mangiacrapa@isti.cnr.it are we ready to switch?

Actions #11

Updated by Francesco Mangiacrapa almost 7 years ago

I noticed that 3 items were added to old catalogue (https://ckan-sobigdata.d4science.org/) so their should be added to the new one (https://ckan.sobigdata.d4science.net/). I can run the script to copy new items from old to new catalogue before switching..

At the moment the switch is scheduled for Monday morning with @roberto.cirillo@isti.cnr.it

Actions #12

Updated by Andrea Dell'Amico almost 7 years ago

  • Status changed from In Progress to Feedback

Hostname has been switched. @roberto.cirillo@isti.cnr.it fixed all the endpoint, the connector configuration has been fixed to reflect the new hostname as well.
Now the service answers to ckan-sobigdata.d4science.org.

If it's all OK, we can destroy the old server and related databases.

Actions #13

Updated by Pasquale Pagano almost 7 years ago

I cannot access the catalogue anymore. I attached an image reporting the error

Actions #14

Updated by Francesco Mangiacrapa almost 7 years ago

The CkanConnector seems undeployed (is missing) in that scope (/d4science.research-infrastructures.eu/SoBigData/ResourceCatalogue)
This issue is very strange because yesterday the connector was ready and running..
@andrea.dellamico@isti.cnr.it or @roberto.cirillo@isti.cnr.it please fix the issue asap, thanks.

Moreover, @Andrea, please check if the redirect performed by CkanConnector is to https://ckan-sobigdata.d4science.org/ (instead of https://ckan.sobigdata.d4science.net), thanks again.

Actions #15

Updated by Andrea Dell'Amico almost 7 years ago

I fixed the redirection yesterday. About the missing scope the only action I know is a restart of the container but I do not have a shell right now

Actions #16

Updated by Tommaso Piccioli almost 7 years ago

I restarted the connnector container in this moment, if you can check it...

Actions #17

Updated by Francesco Mangiacrapa almost 7 years ago

Thanks @tommaso.piccioli@isti.cnr.it and @andrea.dellamico@isti.cnr.it now the catalogue works fine at https://sobigdata.d4science.org/group/sobigdata-gateway/data-catalogue

Just a last fix regarding the scope: /d4science.research-infrastructures.eu/SoBigData/E-Learning_Area

2018-07-09 08:31:17,871 ERROR server.GcoreEndpointReader [http-bio-9090-exec-108,<init>:73] %java.lang.Exception: 
Cannot retrieve the GCoreEndpoint serviceName: CkanConnector, serviceClass: DataAccess, in scope: /d4science.research-infrastructures.eu/SoBigData/E-Learning_Area
    at org.gcube.portlets.gcubeckan.gcubeckandatacatalog.server.GcoreEndpointReader.<init>(GcoreEndpointReader.java:61)

We need to add the CkanConnector in that scope. I can proceed by using the Monitor (copying the CkanConnector from VO "/d4science.research-infrastructures.eu/SoBigData" to VRE "/d4science.research-infrastructures.eu/SoBigData/E-Learning_Area") but if we have an ansible script to perform it then we can proceed via script. Let me know..

Actions #18

Updated by Andrea Dell'Amico almost 7 years ago

I just added the scope to the list in the ansible variables. Let me know when I can reconfigure the connector.

Actions #19

Updated by Andrea Dell'Amico almost 7 years ago

Done. The scopes are now:

/d4science.research-infrastructures.eu/SoBigData
/d4science.research-infrastructures.eu/SoBigData/ResourceCatalogue
/d4science.research-infrastructures.eu/SoBigData/CityOfCitizens
/d4science.research-infrastructures.eu/SoBigData/MigrationStudies
/d4science.research-infrastructures.eu/SoBigData/E-Learning_Area
Actions #20

Updated by Francesco Mangiacrapa almost 7 years ago

  • Status changed from Feedback to Closed

The SBD catalogue seems work in all scopes

Actions

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 8.91 MB)