Task #4414
closed
New server for the Broker Service
Added by Michele Artini almost 9 years ago. Updated almost 8 years ago.
100%
Description
Can you prepare a virtual machine for the development of the Broker Service?
We need the following components:
- Java 8
- Tomcat 8
- RabbitMQ (latest version)
- ElasticSearch (latest version)
At the beginning I think that it is sufficient a machine with 4 cores and 8 GB.
Can you also add the administrator rights to me, claudio and alessia?
Updated by Pasquale Pagano almost 9 years ago
- Tracker changed from Support to Task
Updated by Andrea Dell'Amico almost 9 years ago
There is no tomcat 8 package available on our supported distribution. Is it really needed?
Updated by Michele Artini almost 9 years ago
No it's not needed, you can install tomcat 7.
Updated by Andrea Dell'Amico almost 9 years ago
VM name is going to be broker1-dev-dnet.d4science.org, IP 146.48.123.4
Updated by Andrea Dell'Amico almost 9 years ago
- Status changed from New to In Progress
- % Done changed from 0 to 50
You can access the machine and the services are running. rabbitmq needs some love:
- Can you remind me of what plugins are needed?
Do the server needs to be contacted from local only?
does elasticsearch need to be contacted from outside?
In the next days I'll also provide an nginx instance acting as reverse proxy.
Updated by Andrea Dell'Amico almost 9 years ago
- % Done changed from 50 to 90
We only need the reverse proxy.
Updated by Michele Artini almost 9 years ago
Andrea, can you increase the RAM?
At least 16 GBs are required.
Today the server is used for a demo, so
you should perform the update in the next days.
Updated by Tommaso Piccioli almost 9 years ago
VM prepared to be restarted with 8 vcpu and 16 GB ram.
Updated by Andrea Dell'Amico over 8 years ago
Server rebooted with the new resources.
Let me know what parts need to be contacted directly, because we still need a reverse proxy before the applications.
Updated by Michele Artini over 8 years ago
The following services should be accessible only from the ISTI network:
- Tomcat (port 8080)
- ElasticSearch (9200 and 9300)
- RabbitMQ (5672 and 15672)
Updated by Michele Artini over 8 years ago
Paolo says to suspend the ticket for a couple of days, he has to perform a demo.
(Probably it will be necessary to clone this server to realize a specific demo server).
Updated by Michele Artini about 8 years ago
Can you close the access to this server?
The broker will be available in a new server as described in #6748.
Updated by Michele Artini about 8 years ago
We have deployed a new release of the broker service;
it has been developed using spring-boot (so tomcat can be uninstalled);
We have copied the necessary files in the following folders:
- /usr/lib/dnet : contains the executable jar
- /etc/dnet : contains properties files
- /var/lib/dnet : contains the data
It is also necessary to update the firewall configuration for port 8080:
- CLOSED by default
- OPEN for ISTI and NKUA addresses
Updated by Claudio Atzori almost 8 years ago
- Status changed from Closed to In Progress
- Assignee changed from Andrea Dell'Amico to _InfraScience Systems Engineer
broker1-dev-dnet.d4science.org is out of free disk space.
The majority seems to be used by elasticsearch and rabbitmq
root@broker1-dev-dnet:~# df -h Filesystem Size Used Avail Use% Mounted on udev 10M 4.0K 10M 1% /dev tmpfs 3.1G 88K 3.1G 1% /run /dev/xvda2 80G 80G 33M 100% / none 4.0K 0 4.0K 0% /sys/fs/cgroup none 5.0M 0 5.0M 0% /run/lock none 7.7G 0 7.7G 0% /run/shm none 100M 0 100M 0% /run/user root@broker1-dev-dnet:~# du -hsc /var/lib/rabbitmq/ 38G /var/lib/rabbitmq/ 38G total root@broker1-dev-dnet:~# du -hsc /var/lib/elasticsearch/ 40G /var/lib/elasticsearch/ 40G total
Is it possible to extend the volume? In the worst case we'd need ~200GB. As an alternative we could also benefit of separated volumes, 100Gb each, dedicated to elasticsearch and rabbitmq.
Updated by Tommaso Piccioli almost 8 years ago
Now on /var/lib/rabbitmq and /var/lib/elasticsearch are mounted two separate file system of 100 GB
After the reboot of broker1-dev-dnet I can see
Size Used Avail Use% Mounted on
12G 2.6G 9.5G 21% /
100G 38M 100G 1% /var/lib/rabbitmq
100G 40G 61G 40% /var/lib/elasticsearch
Updated by Andrea Dell'Amico almost 8 years ago
- Status changed from In Progress to Closed
Please open new tickets if new issues arise.
