Task #4371
closed
Upgrade #3868: D4Science Infrastructure Upgrade to gCube 3.11.0
Upgrade #3873: D4Science Gateways upgrade to gCube 3.11.0
Task #2516: Provide RStudio in the e-Infrastructure VREs
same R configuration (R version and packages) on R-Studio as the one on machine(s) used by Dataminer.
100%
Description
We should analyze and deliver a solution to automatize the configuration of the Dataminer instances. The idea is that a user configure RStudio and all packages he installs are then automatically installed on the Dateminer instances available in his VRE.
Files
Related issues
Updated by Andrea Dell'Amico almost 9 years ago
- Related to Task #4865: Installing data analysis machine to develop prototypes added
Updated by Andrea Dell'Amico over 8 years ago
The new proposal is the following:
- Three lists are maintained into a subversion repository. One for the debian packages, one for the R packages installed from CRAN or other sites that publish source tarbals, one for the R packages installed from github
- A cron job is installed on all the R enabled servers (dataminer, rstudio). The cron job runs frequently (at 10 minutes intervals?), downloads the files and installs the packages that aren't already present. It also runs once daily to reinstall the packages that have new versions available.
Updated by Andrea Dell'Amico over 8 years ago
- Related to Task #5448: Dataminer - Need to align R configuration with RStudio simulation environment added
Updated by Andrea Dell'Amico over 8 years ago
- Status changed from New to In Progress
- % Done changed from 0 to 80
- Infrastructure Development, Pre-Production added
The script and the cron jobs are ready.
We now only need a repository where to store the three lists.
Updated by Andrea Dell'Amico over 8 years ago
- File r_github_pkgs.txt r_github_pkgs.txt added
- File r_cran_pkgs.txt r_cran_pkgs.txt added
- File r_deb_pkgs.txt r_deb_pkgs.txt added
I'm attaching the files lists. @gianpaolo.coro@isti.cnr.it would you setup a subversion repository for them?
Updated by Gianpaolo Coro over 8 years ago
Updated by Andrea Dell'Amico over 8 years ago
- Status changed from In Progress to Feedback
- % Done changed from 80 to 100
The lists are now got from subversion. script and the cron jobs work as proposed in #note-2:
- One cron job runs at 10 minutes interval and installs new packages if any
- One cron jobs runs every night at 3am and updates all the listed packages.
Note that a complete reinstall needs slightly less than three hours.
The script relies on locking to avoid parallel runs.
Installed on dataminer1-d-d4s.d4science.org and dataminer1-proto.d4science.org right now.
Updated by Gianpaolo Coro over 8 years ago
Could you please install it on dataminer1-devnext?
What happens if one of the packages has typo? The complete installation should not stop, I guess.
Is the latest version always installed, by default configuration?
I have added one package on the SVN files. I will go to see if the package has been installed.
Updated by Andrea Dell'Amico over 8 years ago
Gianpaolo Coro wrote:
Could you please install it on dataminer1-devnext?
Done.
What happens if one of the packages has typo? The complete installation should not stop, I guess.
It doesn't stop.
Is the latest version always installed, by default configuration?
If a package is not already present, yes.
Otherwise it will be updated by the daily cron job.
Updated by Andrea Dell'Amico over 8 years ago
- Status changed from Feedback to Closed
Script and cron jobs have been installed on all the dataminer servers.
