Project

General

Profile

Actions

VM Creation #7702

closed

Provide new VM for hosting tabulardata service in devsec VO

Added by Roberto Cirillo over 8 years ago. Updated over 8 years ago.

Status:
Closed
Priority:
High
Assignee:
_InfraScience Systems Engineer
Start date:
Mar 23, 2017
Due date:
% Done:

100%

Infrastructure:
Development
RAM:
2
CPU:
2
DiskSpace:
20
Smartgears:
Yes
Smartgears Version:
Application Instructions:
Smartgears scopes:
Applications list and version:
Applications context path:
External storage data disk:
Smartgears auth connector:
data transfer enabled:
No
PostgreSQL database:
Yes
Number of VMs:

Description

The new VM should have:

  • 2 GB RAM
  • 2 VCPU
  • java8

it's also need to open the postgres hosted on node7.d.d4science.research-infrastructures.eu for talking with this VM.

I suggest to use one of the following hostnames:

* tabulardata-devsec.d4science.org
* tabulardata-d-d4s.d4science.org

Related issues

Blocks D4Science Infrastructure - Task #8434: tabular-data-manager service to test : tabulardata-devsec.orgClosedLucio LeliiMay 09, 2017

Actions
Blocks D4Science Infrastructure - Task #8660: tabular-data-manager service to test : tabulardata-devnext-d.dev.d4science.orgClosedLucio LeliiMay 17, 2017

Actions
Actions #1

Updated by Andrea Dell'Amico over 8 years ago

Can we move the postgresql databases on node7.d.d4science.research-infrastructures.eu to postgresql-srv-dev.d4science.org?

Actions #2

Updated by Lucio Lelii over 8 years ago

yes

Actions #3

Updated by Roberto Cirillo over 8 years ago

  • Priority changed from Normal to High
Actions #4

Updated by Pasquale Pagano over 8 years ago

  • Tracker changed from Task to VM Creation
  • RAM set to 2
  • CPU set to 2
  • DiskSpace set to 20
  • Smartgears set to Yes
  • data transfer enabled set to No
  • PostgreSQL database set to Yes

Please @roberto.cirillo@isti.cnr.it complete the missing information.

Actions #5

Updated by Roberto Cirillo over 8 years ago

This is a 14 days old ticket (before new rules). I think other info aren't needed because the playbook is already done and I'm ready to run it.

Actions #6

Updated by Tommaso Piccioli over 8 years ago

Could you please indicate which are the databases that we have to move or copy
from node7.d.d4science.research-infrastructures.eu to postgresql-srv-dev.d4science.org?

Actions #7

Updated by Tommaso Piccioli over 8 years ago

  • Status changed from New to In Progress
  • % Done changed from 0 to 40

tabulardata-devsec.d4science.org ready, Roberto can check the ansible variables before run the playbook.
Anyway I need the info to copy/move the database.

Actions #8

Updated by Lucio Lelii over 8 years ago

the dbs are Tabulardata and Tabularmetadata

Actions #9

Updated by Roberto Cirillo over 8 years ago

  • Assignee changed from _InfraScience Systems Engineer to Roberto Cirillo
Actions #10

Updated by Roberto Cirillo over 8 years ago

  • Assignee changed from Roberto Cirillo to _InfraScience Systems Engineer
  • % Done changed from 40 to 80

I've a problem with the gcube user. It seems I'm not able to run the stopContainer.sh:

gcube@tabulardata-devsec:~$ ./stopContainer.sh 
[sudo] password for gcube: 

could you check please?

Actions #11

Updated by Andrea Dell'Amico over 8 years ago

How did you run the playbook?

I just run it with the tag d4science to only run the tasks that configure sudo and the security limits, and the following tasks were executed:

TASK [../library/roles/d4s_user_services_perms : Install the sudoers config that permits the tomcat user to restart the service] ***
changed: [tabulardata-devsec.d4science.org]

TASK [../library/roles/d4s_user_services_perms : Install the README file that explains where the options files are placed and how start/stop the service] ***
changed: [tabulardata-devsec.d4science.org] => (item=[{u'jmx_auth_enabled': False, u'java_opts': u'', u'servername': u'tabulardata-devsec.d4science.org', u'jmx_controlpass
': u'__omit_place_holder__64a7dfe99b5445cbb80765b27732334a07abf631', u'jmx_auth_dir': u'/var/lib/tomcat_instances/8000/conf', u'app_contexts': [u'whn-manager', u'tabular-d
ata-manager'], u'restart_timeout': 300, u'other_java_opts': u'', u'http_port': 8000, u'user_home': u'/home/gcube', u'jmx_enabled': False, u'log_rotation_freq': u'daily', u
'instance_path': u'/home/gcube/tomcat', u'shutdown_port': u'-1', u'jmx_use_ssl': False, u'java_home': u'/usr/lib/jvm/java-8-oracle', u'ajp_address': u'127.0.0.1', u'ajp_po
rt': u'8109', u'max_threads': 500, u'log_retain': 30, u'jmx_port': 8186, u'java_gc_opts': u'-XX:+UseConcMarkSweepGC', u'access_log_enabled': True, u'skip_smartgears': Fals
e, u'ajp_enabled': False, u'user_shell': u'/bin/bash', u'remote_debugging_port': u'8100', u'unpack': True, u'remote_debugging': False, u'http_address': u'0.0.0.0', u'defau
lt_conf': True, u'jmx_monitorpass': u'__omit_place_holder__64a7dfe99b5445cbb80765b27732334a07abf631', u'allowed_hosts': [u'0.0.0.0/0'], u'autodeploy': False, u'jmx_disable
_additional_ports': True, u'http_enabled': True, u'user': u'gcube'}, u'README'])

TASK [../library/roles/d4s_user_services_perms : Set the read/write permissions on the tomcat default options files] ***
changed: [tabulardata-devsec.d4science.org] => (item={u'jmx_auth_enabled': False, u'java_opts': u'', u'servername': u'tabulardata-devsec.d4science.org', u'jmx_controlpass'
: u'__omit_place_holder__64a7dfe99b5445cbb80765b27732334a07abf631', u'jmx_auth_dir': u'/var/lib/tomcat_instances/8000/conf', u'app_contexts': [u'whn-manager', u'tabular-da
ta-manager'], u'restart_timeout': 300, u'other_java_opts': u'', u'http_port': 8000, u'user_home': u'/home/gcube', u'jmx_enabled': False, u'log_rotation_freq': u'daily', u'
instance_path': u'/home/gcube/tomcat', u'shutdown_port': u'-1', u'jmx_use_ssl': False, u'java_home': u'/usr/lib/jvm/java-8-oracle', u'ajp_address': u'127.0.0.1', u'ajp_por
t': u'8109', u'max_threads': 500, u'log_retain': 30, u'jmx_port': 8186, u'java_gc_opts': u'-XX:+UseConcMarkSweepGC', u'access_log_enabled': True, u'skip_smartgears': False
, u'ajp_enabled': False, u'user_shell': u'/bin/bash', u'remote_debugging_port': u'8100', u'unpack': True, u'remote_debugging': False, u'http_address': u'0.0.0.0', u'defaul
t_conf': True, u'jmx_monitorpass': u'__omit_place_holder__64a7dfe99b5445cbb80765b27732334a07abf631', u'allowed_hosts': [u'0.0.0.0/0'], u'autodeploy': False, u'jmx_disable_
additional_ports': True, u'http_enabled': True, u'user': u'gcube'})

TASK [../library/roles/d4s_user_services_perms : Change the default security limits] ***
changed: [tabulardata-devsec.d4science.org] => (item={u'l_item': u'nofile', u'domain': u'gcube', u'type': u'soft', u'value': 16000})
changed: [tabulardata-devsec.d4science.org] => (item={u'l_item': u'nofile', u'domain': u'gcube', u'type': u'hard', u'value': 16000})

When a new node is deployed no tags must be listed, otherwise the provisioning will be partial. If this is the case please run it again.

Actions #12

Updated by Andrea Dell'Amico over 8 years ago

(I still do not understand why nginx and ssl have been disabled).

Actions #13

Updated by Roberto Cirillo over 8 years ago

Andrea Dell'Amico wrote:

How did you run the playbook?

I just run it with the tag d4science to only run the tasks that configure sudo and the security limits, and the following tasks were executed:

TASK [../library/roles/d4s_user_services_perms : Install the sudoers config that permits the tomcat user to restart the service] ***
changed: [tabulardata-devsec.d4science.org]

TASK [../library/roles/d4s_user_services_perms : Install the README file that explains where the options files are placed and how start/stop the service] ***
changed: [tabulardata-devsec.d4science.org] => (item=[{u'jmx_auth_enabled': False, u'java_opts': u'', u'servername': u'tabulardata-devsec.d4science.org', u'jmx_controlpass
': u'__omit_place_holder__64a7dfe99b5445cbb80765b27732334a07abf631', u'jmx_auth_dir': u'/var/lib/tomcat_instances/8000/conf', u'app_contexts': [u'whn-manager', u'tabular-d
ata-manager'], u'restart_timeout': 300, u'other_java_opts': u'', u'http_port': 8000, u'user_home': u'/home/gcube', u'jmx_enabled': False, u'log_rotation_freq': u'daily', u
'instance_path': u'/home/gcube/tomcat', u'shutdown_port': u'-1', u'jmx_use_ssl': False, u'java_home': u'/usr/lib/jvm/java-8-oracle', u'ajp_address': u'127.0.0.1', u'ajp_po
rt': u'8109', u'max_threads': 500, u'log_retain': 30, u'jmx_port': 8186, u'java_gc_opts': u'-XX:+UseConcMarkSweepGC', u'access_log_enabled': True, u'skip_smartgears': Fals
e, u'ajp_enabled': False, u'user_shell': u'/bin/bash', u'remote_debugging_port': u'8100', u'unpack': True, u'remote_debugging': False, u'http_address': u'0.0.0.0', u'defau
lt_conf': True, u'jmx_monitorpass': u'__omit_place_holder__64a7dfe99b5445cbb80765b27732334a07abf631', u'allowed_hosts': [u'0.0.0.0/0'], u'autodeploy': False, u'jmx_disable
_additional_ports': True, u'http_enabled': True, u'user': u'gcube'}, u'README'])

TASK [../library/roles/d4s_user_services_perms : Set the read/write permissions on the tomcat default options files] ***
changed: [tabulardata-devsec.d4science.org] => (item={u'jmx_auth_enabled': False, u'java_opts': u'', u'servername': u'tabulardata-devsec.d4science.org', u'jmx_controlpass'
: u'__omit_place_holder__64a7dfe99b5445cbb80765b27732334a07abf631', u'jmx_auth_dir': u'/var/lib/tomcat_instances/8000/conf', u'app_contexts': [u'whn-manager', u'tabular-da
ta-manager'], u'restart_timeout': 300, u'other_java_opts': u'', u'http_port': 8000, u'user_home': u'/home/gcube', u'jmx_enabled': False, u'log_rotation_freq': u'daily', u'
instance_path': u'/home/gcube/tomcat', u'shutdown_port': u'-1', u'jmx_use_ssl': False, u'java_home': u'/usr/lib/jvm/java-8-oracle', u'ajp_address': u'127.0.0.1', u'ajp_por
t': u'8109', u'max_threads': 500, u'log_retain': 30, u'jmx_port': 8186, u'java_gc_opts': u'-XX:+UseConcMarkSweepGC', u'access_log_enabled': True, u'skip_smartgears': False
, u'ajp_enabled': False, u'user_shell': u'/bin/bash', u'remote_debugging_port': u'8100', u'unpack': True, u'remote_debugging': False, u'http_address': u'0.0.0.0', u'defaul
t_conf': True, u'jmx_monitorpass': u'__omit_place_holder__64a7dfe99b5445cbb80765b27732334a07abf631', u'allowed_hosts': [u'0.0.0.0/0'], u'autodeploy': False, u'jmx_disable_
additional_ports': True, u'http_enabled': True, u'user': u'gcube'})

TASK [../library/roles/d4s_user_services_perms : Change the default security limits] ***
changed: [tabulardata-devsec.d4science.org] => (item={u'l_item': u'nofile', u'domain': u'gcube', u'type': u'soft', u'value': 16000})
changed: [tabulardata-devsec.d4science.org] => (item={u'l_item': u'nofile', u'domain': u'gcube', u'type': u'hard', u'value': 16000})

When a new node is deployed no tags must be listed, otherwise the provisioning will be partial. If this is the case please run it again.

I had run it without tag but the first run was fail because there was a problem with snapshot repository. After that I've run it again with the tag "ssh_keys" and not "d4science": this is my mistake. Thanks.

Actions #14

Updated by Roberto Cirillo over 8 years ago

Andrea Dell'Amico wrote:

(I still do not understand why nginx and ssl have been disabled).

nginx should be enabled... it is running on 80 port while the container is running on 8000 port

Actions #15

Updated by Roberto Cirillo over 8 years ago

  • % Done changed from 80 to 100

the container now is enabled to publish in new registry service

Actions #16

Updated by Roberto Cirillo over 8 years ago

  • Status changed from In Progress to Closed
Actions #18

Updated by Lucio Lelii over 8 years ago

  • Status changed from Closed to In Progress
  • % Done changed from 100 to 90

the backup of th eold database is still missing, tabulardata cannot work with it.

Actions #19

Updated by Lucio Lelii over 8 years ago

  • Blocks Task #8434: tabular-data-manager service to test : tabulardata-devsec.org added
Actions #20

Updated by Lucio Lelii over 8 years ago

  • Blocks Task #8660: tabular-data-manager service to test : tabulardata-devnext-d.dev.d4science.org added
Actions #21

Updated by Andrea Dell'Amico over 8 years ago

  • Status changed from In Progress to Closed
  • % Done changed from 90 to 100

Fixed days ago

Actions

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 8.91 MB)