Project

General

Profile

Actions

VM Creation #11852

closed

Create a VM to deploy the new storage hub application.

Added by Roberto Cirillo almost 7 years ago. Updated almost 7 years ago.

Status:
Closed
Priority:
Urgent
Assignee:
_InfraScience Systems Engineer
Target version:
Start date:
May 29, 2018
Due date:
May 31, 2018
% Done:

100%

Infrastructure:
Production
RAM:
8
CPU:
16
DiskSpace:
30
Smartgears:
Yes
Smartgears Version:
latest
Application Instructions:
Smartgears scopes:

all

Applications list and version:

storagehub latest version

Applications context path:

storagehub

External storage data disk:

120GB under /data
40 GB under /tomcat/temp

Smartgears auth connector:
data transfer enabled:
PostgreSQL database:
Number of VMs:
1

Description

I need to install the storagehub webapp on this VM but it seems to be not reachable:

rcirillo@rcirillo-cnr:~$ ping workspace-repository-prod.d4science.org
PING workspace-repository-prod.d4science.org (146.48.122.106) 56(84) bytes of data.
^C
--- workspace-repository-prod.d4science.org ping statistics ---
11 packets transmitted, 0 received, 100% packet loss, time 10079ms

Could anyone take a look, please?


Related issues

Related to D4Science Infrastructure - Task #10264: Add /data as separate file system on workspace-repository-prod.d4science.orgClosed_InfraScience Systems EngineerNov 08, 2017

Actions
Blocks D4Science Infrastructure - Upgrade #11834: D4Science Root VO upgrade to gCube 4.11.1CompletedRoberto CirilloMay 23, 2018

Actions
Actions #1

Updated by Roberto Cirillo almost 7 years ago

  • Related to Upgrade #11834: D4Science Root VO upgrade to gCube 4.11.1 added
Actions #2

Updated by Andrea Dell'Amico almost 7 years ago

That VM was destroyed because it was unused. If there are plans to finally activate the cluster, the VM must be reinstalled.

Actions #3

Updated by Roberto Cirillo almost 7 years ago

Andrea Dell'Amico wrote:

That VM was destroyed because it was unused. If there are plans to finally activate the cluster, the VM must be reinstalled.

There was a ticket for this activity? I haven't see it. Is it possible to create another VM with the same resources in order to install the new storagehub webapp?

Actions #4

Updated by Andrea Dell'Amico almost 7 years ago

  • Related to Task #10264: Add /data as separate file system on workspace-repository-prod.d4science.org added
Actions #5

Updated by Andrea Dell'Amico almost 7 years ago

Not a dedicated one, but the matter was discussed in #10264 that I just added as related.

Please open a new ticket or change this one in VM creation

Actions #6

Updated by Andrea Dell'Amico almost 7 years ago

Also keep in mind that we will need a new load balancer configuration.
Will the new storage hub able to work in a cluster?

Actions #7

Updated by Roberto Cirillo almost 7 years ago

  • Tracker changed from Support to VM Creation
  • RAM set to 8
  • CPU set to 16
  • DiskSpace set to 30
  • Smartgears set to Yes
  • Smartgears Version set to latest
  • Smartgears scopes updated (diff)
  • Applications list and version updated (diff)
  • Applications context path updated (diff)
  • External storage data disk updated (diff)
  • Number of VMs set to 1

This new VM shouldn't be in the same cluster with the workspace-repository-prod1.d4science.org VM but it should share the same db (workspace-repository-pg) and JR configuration.
Please @lucio.lelii@isti.cnr.it check if the resources in the description are ok for you. I've just set the same resources of the old workspace-repository-prod.d4science.org VM.

The new VM name could be the following if you are agree:

 storagehub.d4science.org
Actions #8

Updated by Andrea Dell'Amico almost 7 years ago

I think it's better if we talk about it.

Actions #9

Updated by Massimiliano Assante almost 7 years ago

I don't think we should rename the VM, let's keep it workspace-repository-prod.d4science.org

@lucio.lelii@isti.cnr.it are we sure that This new VM shouldn't be in the same cluster with the workspace-repository-prod1.d4science.org VM but it should share the same db (workspace-repository-pg) and JCR configuration.

Actions #10

Updated by Lucio Lelii almost 7 years ago

Massimiliano Assante wrote:

@lucio.lelii@isti.cnr.it are we sure that This new VM shouldn't be in the same cluster with the workspace-repository-prod1.d4science.org VM but it should share the same db (workspace-repository-pg) and JCR configuration.

Yes

Actions #11

Updated by Massimiliano Assante almost 7 years ago

Lucio Lelii wrote:

Massimiliano Assante wrote:

@lucio.lelii@isti.cnr.it are we sure that This new VM shouldn't be in the same cluster with the workspace-repository-prod1.d4science.org VM but it should share the same db (workspace-repository-pg) and JCR configuration.

Yes

then the name proposed by Roberto makes sense.

Actions #12

Updated by Roberto Cirillo almost 7 years ago

I would also like to say that for the moment, the storagehub is in ready-only mode on JR repository.

Actions #13

Updated by Andrea Dell'Amico almost 7 years ago

I would keep the workspace-repository.d4science.org hostname on the balancer to overcome the certificates problem. The app context is different, so the load balancer can discriminate on that.

Actions #14

Updated by Roberto Cirillo almost 7 years ago

  • Related to deleted (Upgrade #11834: D4Science Root VO upgrade to gCube 4.11.1)
Actions #15

Updated by Roberto Cirillo almost 7 years ago

  • Blocks Upgrade #11834: D4Science Root VO upgrade to gCube 4.11.1 added
Actions #16

Updated by Massimiliano Assante almost 7 years ago

  • Due date set to May 31, 2018

it would be beneficial if the VM would be up by end of today? The sooner the better

Actions #17

Updated by Massimiliano Assante almost 7 years ago

@andrea.dellamico@isti.cnr.it @tommaso.piccioli@isti.cnr.it could you update the status of this activity please? Thanks!

Actions #18

Updated by Andrea Dell'Amico almost 7 years ago

  • Status changed from New to In Progress

I'm going to name it storagehub1.d4science.org.

Actions #19

Updated by Andrea Dell'Amico almost 7 years ago

  • % Done changed from 0 to 80

The VM is up. I've added the two volumes, they will be mounted by the playbook.

I also cleaned up the playbook and added a specific playbook for the storage hub: storage-hub.yml (in the long run the smartgears-nodes.yml playbook should disappear, it's too bloated).

The storage hub variables now have a common group named storage_hub, and then specific groups for the prod and dev environments. I did not cleaned up the dev variables.

@roberto.cirillo@isti.cnr.it you have root access, you can run the playbook.

I still have to change the load balancer configuration.

Actions #20

Updated by Roberto Cirillo almost 7 years ago

Thank you @andrea.dellamico@isti.cnr.it I'm going to run the playbook right now

Actions #21

Updated by Roberto Cirillo almost 7 years ago

The following task is failing:

TASK [../../library/roles/data_disk : Create a file system on the new disks] **********************************************************************************************************************************************************
fatal: [storagehub1.d4science.org]: FAILED! => {"msg": "'catalina_tmp_directory' is undefined"}

Please, could you check?

Actions #22

Updated by Andrea Dell'Amico almost 7 years ago

Wrong variable, now it should be fixed.

Actions #23

Updated by Andrea Dell'Amico almost 7 years ago

The load balancer has been configured. The main URL is workspace-repository.d4science.org ( /storagehub,/homelibrary-fs-webapp).

Actions #24

Updated by Andrea Dell'Amico almost 7 years ago

  • Subject changed from workspace-repository-prod.d4science.org: is unreachable to Create a VM to deploy the new storage hub application.
  • % Done changed from 80 to 90

The VM has been provisioned. A working check for the load balancer is needed, because /storagehub returns an error even if the application has been deployed. @lucio.lelii@isti.cnr.it can you give me a working URL?

Actions #25

Updated by Lucio Lelii almost 7 years ago

the check to understand if the node is up is {hostname}/storagehub/gcube/resource/

Actions #26

Updated by Andrea Dell'Amico almost 7 years ago

Done. Now the load balancer is happy.

Actions #27

Updated by Lucio Lelii almost 7 years ago

It isn't working, I tried the following URL

http://workspace-repository.d4science.org/storagehub/gcube/resource/

but it returns a 404 error

Actions #28

Updated by Andrea Dell'Amico almost 7 years ago

I forgot to also change the ACL used by the old home library. Your request were intercepted by that rule and redirected to the wrong server. Now it works.

Actions #29

Updated by Roberto Cirillo almost 7 years ago

I've added "workspace-repository.d4science.org" as smartgears_hostname. Now the storagehub service is published as the haproxy address

Actions #30

Updated by Roberto Cirillo almost 7 years ago

  • Status changed from In Progress to Closed
Actions

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 8.91 MB)