Project

General

Profile

Actions

VM Creation #11671

closed

Task #11639: Add to the DM Proto cluster at least three new DM instances

Create 6 dataminer instances that will behave as generic workers

Added by Andrea Dell'Amico about 7 years ago. Updated about 7 years ago.

Status:
Closed
Priority:
Urgent
Target version:
Start date:
Apr 18, 2018
Due date:
% Done:

100%

Infrastructure:
Production
RAM:
16
CPU:
16
DiskSpace:
40
Smartgears:
Yes
Smartgears Version:
latest
Application Instructions:
Smartgears scopes:
Applications list and version:

dataminer with the custom dataminer jar

Applications context path:

wps

External storage data disk:
Smartgears auth connector:
data transfer enabled:
No
PostgreSQL database:
No
Number of VMs:
6

Description

They have to run on the GARR hypervisors because of the memory requirements.


Related issues

Blocks D4Science Infrastructure - Task #11676: Destroy the old generic workers dataminer instances and 5 dataminers in the CT GARR region.ClosedAndrea Dell'AmicoApr 18, 2018

Actions
Actions #1

Updated by Andrea Dell'Amico about 7 years ago

  • Parent task changed from #10988 to #11639
Actions #2

Updated by Andrea Dell'Amico about 7 years ago

  • Blocks Task #11676: Destroy the old generic workers dataminer instances and 5 dataminers in the CT GARR region. added
Actions #3

Updated by Andrea Dell'Amico about 7 years ago

  • Status changed from New to In Progress
  • Smartgears scopes updated (diff)
  • Applications context path updated (diff)
Actions #4

Updated by Andrea Dell'Amico about 7 years ago

dataminer0-gw-proto.d4science.org 146.48.123.167
dataminer1-gw-proto.d4science.org 146.48.123.168
dataminer2-gw-proto.d4science.org 146.48.123.169
dataminer3-gw-proto.d4science.org 146.48.123.170
dataminer4-gw-proto.d4science.org 146.48.123.171
dataminer5-gw-proto.d4science.org 146.48.123.172

Actions #5

Updated by Andrea Dell'Amico about 7 years ago

  • % Done changed from 0 to 40

The VMs have been created, provisioning is running.

Actions #6

Updated by Andrea Dell'Amico about 7 years ago

  • Priority changed from Normal to Urgent
  • % Done changed from 40 to 80

I was ready to change the dataminer jar, but the dataminer war that was just installed report a different jar file. The old one installed until now was dataminer-1.5.3-4.11.0-164695.jar (with queue=4), now there is dataminer-1.5.3-4.12.0-164695.jar.

Two questions for @lucio.lelii@isti.cnr.it:

  1. How the new jar file was configured? queue=4, or queue=1?
  2. Is it safe, anyway, to use the old builds I have to cover the other case? I have a copy of dataminer-1.5.3-4.11.0-164695.jar (queue=4) and dataminer-1.5.4-4.11.0-165850.jar (queue=1)
Actions #7

Updated by Andrea Dell'Amico about 7 years ago

I just opened the dataminer-1.5.3-4.12.0-164695.jar file and templates/setup.cfg has maxcomputations=4. @lucio.lelii@isti.cnr.it can I substitute it with dataminer-1.5.4-4.11.0-165850.jar or do we need a new build of that artifact?

Actions #8

Updated by Lucio Lelii about 7 years ago

the 1.5.3 version has maxcomputation=4 the 1.5.4 version has the maxcomputation=1 the two jars are compatible, the only change is this property

Actions #9

Updated by Andrea Dell'Amico about 7 years ago

  • Status changed from In Progress to Feedback
  • % Done changed from 80 to 100

OK. I changed the jar files, the VM are restarting. Does some test exist, or I'm supposed to put them into the haproxy backend as soon as they come back? @gianpaolo.coro@isti.cnr.it @g.panichi@isti.cnr.it

Actions #10

Updated by Gianpaolo Coro about 7 years ago

OK, great! I will do user tests just after automatic tests are passed.

@lucio.lelii@isti.cnr.it could you please run your automatic tests towards dataminer-genericworkers-proto.d4science.org?

Actions #11

Updated by Andrea Dell'Amico about 7 years ago

Gianpaolo Coro wrote:

OK, great! I will do user tests just after automatic tests are passed.

@lucio.lelii@isti.cnr.it could you please run your automatic tests towards dataminer-genericworkers-proto.d4science.org?

@gianpaolo.coro@isti.cnr.it I've not added the new hosts to the load balancer. I'm doing it now.

Actions #12

Updated by Andrea Dell'Amico about 7 years ago

Done.

Actions #13

Updated by Gianpaolo Coro about 7 years ago

  • Status changed from Feedback to Closed

All tests passed. I have done detailed inspection of the logs during the computations. It works well.

Actions #14

Updated by Andrea Dell'Amico about 7 years ago

Thanks. Would you open a task that has the goal of automating these tests? I hope to be able to create regular images of the dataminers, as their configuration requires many hours even if there are no problems with the provisioning steps.

Actions

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 8.91 MB)