VM Creation #7927
closed
More DataMiner machines required in the GenericWorker cluster
100%
https://wiki.gcube-system.org/gcube/DataMiner_Installation
Possibly all the production scopes
DataMiner
/wps
Description
10 DataMiner machines are required in the GenericWorker cluster to provision BiOnym as-a-Service for FAO. These machines can be asked to the Garr infrastructure.
Updated by Andrea Dell'Amico about 8 years ago
- Status changed from New to In Progress
- % Done changed from 0 to 30
Provisioning is running. The dataminers will be available on all the scopes.
Updated by Andrea Dell'Amico about 8 years ago
- Status changed from In Progress to Feedback
- % Done changed from 30 to 100
The VMs are active. hostnames are:
ip-90-147-167-173.ct1.garrservices.it ip-90-147-167-175.ct1.garrservices.it ip-90-147-167-176.ct1.garrservices.it ip-90-147-167-177.ct1.garrservices.it ip-90-147-167-178.ct1.garrservices.it ip-90-147-167-179.ct1.garrservices.it ip-90-147-167-180.ct1.garrservices.it ip-90-147-167-181.ct1.garrservices.it ip-90-147-167-182.ct1.garrservices.it ip-90-147-167-183.ct1.garrservices.it
Updated by Tommaso Piccioli about 8 years ago
New nodes added to the iptable rules on workspace-repository.d4science.org
(and the new workspace-repository-prod.d4science.org for the future)
Updated by Gianpaolo Coro about 8 years ago
- Status changed from Feedback to In Progress
The machines should be added to the genericworkers cluster in order to be properly tested.
Updated by Andrea Dell'Amico about 8 years ago
- Status changed from In Progress to Feedback
Gianpaolo Coro wrote:
The machines should be added to the genericworkers cluster in order to be properly tested.
Done.
Updated by Gianpaolo Coro about 8 years ago
The machines work very well and I was able to use them to run 3500 taxonomic searches in a very large repository. I'm just testing the dataminer1-2-genericworker machines that seem to have issues. For sure they are downsized, due also to the scheduled updater of R packages, but it seems they have other issues too with Java libraries. Is it possible to increase their memory configuration and reinstall them?
Updated by Andrea Dell'Amico about 8 years ago
Gianpaolo Coro wrote:
I'm just testing the dataminer1-2-genericworker machines that seem to have issues. For sure they are downsized, due also to the scheduled updater of R packages, but it seems they have other issues too with Java libraries. Is it possible to increase their memory configuration and reinstall them?
I don't see why a reinstall should be useful. Their resources can be increased, but the distribution and the configurations are up to date with all the other dataminer installations. I don't know if there's some outdated algorithm, but it's not something that a reinstall can solve.
For the time being, if the GARR dataminers are sufficient, the local generic workers can be removed from the haproxy pool and maybe dismissed.
Updated by Andrea Dell'Amico about 8 years ago
@gianpaolo.coro@isti.cnr.it any opinion on my proposal?
Updated by Gianpaolo Coro about 8 years ago
Yes, I have run some tests and the Garr resources are sufficient.
Updated by Andrea Dell'Amico about 8 years ago
I just removed dataminer[1:2]-genericworkers.d4science.org from the genericworkers backend. Now we have two free dataminer VMs. We can add them to the genericworkers_proto backend or we could destroy them and add more resources to dataminer3-genericworkers.d4science.org. @gianpaolo.coro@isti.cnr.it, your call.
Updated by Gianpaolo Coro about 8 years ago
Please, add resources to dataminer3-genericworkers.d4science.org
Updated by Andrea Dell'Amico about 8 years ago
Gianpaolo Coro wrote:
Please, add resources to dataminer3-genericworkers.d4science.org
Is it a problem if I increase the dataminer1-genericworkers.d4science.org's resources and put it into the genericworkers_proto backend? It lives in an hypervisor with more free memory than the one that hosts dataminer3-genericworkers.d4science.org
Updated by Andrea Dell'Amico about 8 years ago
- Status changed from Feedback to Closed
Nevermind. dataminer3-genericworkers.d4science.org has now 8 GB of RAM and 4 CPUs.
I'm going to shutdown dataminer{1,2}-genericworkers.d4science.org
