Task #5451
closedTask #5448: Dataminer - Need to align R configuration with RStudio simulation environment
Ensure that dependent libraries invoked by R have same versions in Dataminer / RStudio environment
100%
Description
Non exhaustive inventory of libraries (to complete by R-related system admins probably):
- CURL
- GDAL
- libxml
- GEOS
Updated by Pasquale Pagano over 8 years ago
- Tracker changed from Support to Task
- Category set to High-Throughput-Computing
- Assignee set to Andrea Dell'Amico
- Target version changed from UnSprintable to Dataminer and StatMan provisioning
Updated by Andrea Dell'Amico over 8 years ago
The dataminer all have the same set of R packages installed.
On the rstudio/rstudio-dev servers the R installed packages are different.
I need a bit of work to merge the two lists, but after that the packages will always be the same everywhere.
Updated by Andrea Dell'Amico over 8 years ago
- Status changed from New to In Progress
Updated by Andrea Dell'Amico over 8 years ago
- % Done changed from 0 to 50
- Infrastructure Pre-Production added
The R packages update is running right now.
I'm listing the debian packages that provide libraries needed by some of the packages, the R packages installed from debian packages, the R packages installed from CRAN mirrors, and the R packages installed from github.
Other packages, like curl/libcurl/libxml, are always installed on our system or were installed as dependencies from other packages.
It's a raw list directly taken from the provisioning configuration.
r_distribution_required_packages: - gdal-bin - dans-gdal-scripts - libgdal1-dev - libgeos-dev - libspatialite-dev - proj-bin - proj-data - libproj-dev - texlive - texlive-base - texlive-binaries - texlive-latex-base - texlive-latex-extra - texlive-formats-extra - texlive-xetex - libnetcdf-dev - netcdf-bin - mono-runtime - libmono-microsoft-visualbasic10.0-cil - gsl-bin - libgsl0-dev - mesa-common-dev - libglu1-mesa-dev - postgis - postgresql-client - jags r_base_packages_list: - r-recommended - r-base - r-base-dev - r-base-html - r-base-core - r-doc-html - r-cran-boot - r-cran-cluster - r-cran-foreign - r-cran-kernsmooth - r-cran-lattice - r-cran-mgcv - r-cran-nlme - r-cran-rpart - r-cran-survival - r-cran-mass - r-cran-class - r-cran-nnet - r-cran-spatial - r-cran-codetools - r-cran-matrix r_plugins_list_to_install: - { name: 'data.table', repo: '{{ r_cran_mirror_site }}' } - { name: 'doBy', repo: '{{ r_cran_mirror_site }}' } - { name: 'multcomp', repo: '{{ r_cran_mirror_site }}' } - { name: 'mvtnorm', repo: '{{ r_cran_mirror_site }}' } - { name: 'survival', repo: '{{ r_cran_mirror_site }}' } - { name: 'splines', repo: '{{ r_cran_mirror_site }}' } - { name: 'TH.data', repo: '{{ r_cran_mirror_site }}' } - { name: 'Matrix', repo: '{{ r_cran_mirror_site }}' } - { name: 'abind', repo: '{{ r_cran_mirror_site }}' } - { name: 'baysemix', repo: '{{ r_cran_mirror_site }}' } - { name: 'coda', repo: '{{ r_cran_mirror_site }}' } - { name: 'R2jags ', repo: '{{ r_cran_mirror_site }}' } - { name: 'R2WinBUGS', repo: '{{ r_cran_mirror_site }}' } - { name: 'rjags ', repo: '{{ r_cran_mirror_site }}' } - { name: 'runjags ', repo: '{{ r_cran_mirror_site }}' } - { name: 'maptools', repo: '{{ r_cran_mirror_site }}' } - { name: 'sp', repo: '{{ r_cran_mirror_site }}' } - { name: 'compiler', repo: '{{ r_cran_mirror_site }}' } - { name: 'datasets', repo: '{{ r_cran_mirror_site }}' } - { name: 'graphics', repo: '{{ r_cran_mirror_site }}' } - { name: 'grDevices', repo: '{{ r_cran_mirror_site }}' } - { name: 'grid', repo: '{{ r_cran_mirror_site }}' } - { name: 'methods', repo: '{{ r_cran_mirror_site }}' } - { name: 'nnet', repo: '{{ r_cran_mirror_site }}' } - { name: 'parallel', repo: '{{ r_cran_mirror_site }}' } - { name: 'rpart', repo: '{{ r_cran_mirror_site }}' } - { name: 'stats', repo: '{{ r_cran_mirror_site }}' } - { name: 'stats4', repo: '{{ r_cran_mirror_site }}' } - { name: 'tools', repo: '{{ r_cran_mirror_site }}' } - { name: 'utils', repo: '{{ r_cran_mirror_site }}' } - { name: 'withr', repo: '{{ r_cran_mirror_site }}' } - { name: 'Rcpp ', repo: '{{ r_cran_mirror_site }}' } - { name: 'plyr ', repo: '{{ r_cran_mirror_site }}' } - { name: 'digest ', repo: '{{ r_cran_mirror_site }}' } - { name: 'httr ', repo: '{{ r_cran_mirror_site }}' } - { name: 'stringr ', repo: '{{ r_cran_mirror_site }}' } - { name: 'reshape2 ', repo: '{{ r_cran_mirror_site }}' } - { name: 'R2HTML ', repo: '{{ r_cran_mirror_site }}' } - { name: 'snow ', repo: '{{ r_cran_mirror_site }}' } - { name: 'RcppEigen ', repo: '{{ r_cran_mirror_site }}' } - { name: 'minqa ', repo: '{{ r_cran_mirror_site }}' } - { name: 'lme4 ', repo: '{{ r_cran_mirror_site }}' } - { name: 'RCurl ', repo: '{{ r_cran_mirror_site }}' } - { name: 'memoise ', repo: '{{ r_cran_mirror_site }}' } - { name: 'whisker ', repo: '{{ r_cran_mirror_site }}' } - { name: 'evaluate', repo: '{{ r_cran_mirror_site }}' } - { name: 'devtools ', repo: '{{ r_cran_mirror_site }}' } - { name: 'rgdal ', repo: '{{ r_cran_mirror_site }}' } - { name: 'rgeos', repo: '{{ r_cran_mirror_site }}' } - { name: 'knitr', repo: '{{ r_cran_mirror_site }}' } - { name: 'rworldmap', repo: '{{ r_cran_mirror_site }}' } - { name: 'spam', repo: '{{ r_cran_mirror_site }}' } - { name: 'maps', repo: '{{ r_cran_mirror_site }}' } - { name: 'fields', repo: '{{ r_cran_mirror_site }}' } - { name: 'highlight', repo: '{{ r_cran_mirror_site }}' } - { name: 'dichromat', repo: '{{ r_cran_mirror_site }}' } - { name: 'colorspace', repo: '{{ r_cran_mirror_site }}' } - { name: 'munsell', repo: '{{ r_cran_mirror_site }}' } - { name: 'labeling', repo: '{{ r_cran_mirror_site }}' } - { name: 'scales', repo: '{{ r_cran_mirror_site }}' } - { name: 'gtable', repo: '{{ r_cran_mirror_site }}' } - { name: 'ggplot2', repo: '{{ r_cran_mirror_site }}' } - { name: 'jsonlite', repo: '{{ r_cran_mirror_site }}' } - { name: 'magrittr', repo: '{{ r_cran_mirror_site }}' } - { name: 'gridExtra', repo: '{{ r_cran_mirror_site }}' } - { name: 'viridis', repo: '{{ r_cran_mirror_site }}' } - { name: 'base64enc', repo: '{{ r_cran_mirror_site }}' } - { name: 'htmltools', repo: '{{ r_cran_mirror_site }}' } - { name: 'htmlwidgets', repo: '{{ r_cran_mirror_site }}' } - { name: 'plotly', repo: '{{ r_cran_mirror_site }}' } - { name: 'mapdata', repo: '{{ r_cran_mirror_site }}' } - { name: 'mapplots', repo: '{{ r_cran_mirror_site }}' } - { name: 'mnormt', repo: '{{ r_cran_mirror_site }}' } - { name: 'numDeriv', repo: '{{ r_cran_mirror_site }}' } - { name: 'sn', repo: '{{ r_cran_mirror_site }}' } - { name: 'mclust', repo: '{{ r_cran_mirror_site }}' } - { name: 'tclust', repo: '{{ r_cran_mirror_site }}' } - { name: 'modeltools', repo: '{{ r_cran_mirror_site }}' } - { name: 'flexmix', repo: '{{ r_cran_mirror_site }}' } - { name: 'prabclus', repo: '{{ r_cran_mirror_site }}' } - { name: 'diptest', repo: '{{ r_cran_mirror_site }}' } - { name: 'DEoptimR', repo: '{{ r_cran_mirror_site }}' } - { name: 'robustbase', repo: '{{ r_cran_mirror_site }}' } - { name: 'kernlab', repo: '{{ r_cran_mirror_site }}' } - { name: 'trimcluster', repo: '{{ r_cran_mirror_site }}' } - { name: 'fpc', repo: '{{ r_cran_mirror_site }}' } - { name: 'RJSONIO', repo: '{{ r_cran_mirror_site }}' } - { name: 'cowplot', repo: '{{ r_cran_mirror_site }}' } - { name: 'DBI', repo: '{{ r_cran_mirror_site }}' } - { name: 'RPostgreSQL', repo: '{{ r_cran_mirror_site }}' } - { name: 'raster', repo: '{{ r_cran_mirror_site }}' } - { name: 'xtable', repo: '{{ r_cran_mirror_site }}' } - { name: 'reshape', repo: '{{ r_cran_mirror_site }}' } - { name: 'kobe', repo: '{{ r_cran_mirror_site }}' } - { name: 'shiny', repo: '{{ r_cran_mirror_site }}' } - { name: 'ncdf4', repo: '{{ r_cran_mirror_site }}' } - { name: 'lubridate', repo: '{{ r_cran_mirror_site }}' } - { name: 'dplyr', repo: '{{ r_cran_mirror_site }}' } - { name: 'tidyr', repo: '{{ r_cran_mirror_site }}' } - { name: 'gam', repo: '{{ r_cran_mirror_site }}' } - { name: 'rgl', repo: '{{ r_cran_mirror_site }}' } - { name: 'readxl', repo: '{{ r_cran_mirror_site }}' } - { name: 'geosphere', repo: '{{ r_cran_mirror_site }}' } - { name: 'shapefiles', repo: '{{ r_cran_mirror_site }}' } - { name: 'rmarkdown', repo: '{{ r_cran_mirror_site }}' } - { name: 'igraph', repo: '{{ r_cran_mirror_site }}' } - { name: 'curl', repo: '{{ r_cran_mirror_site }}' } - { name: 'caret', repo: '{{ r_cran_mirror_site }}' } - { name: 'XML', repo: '{{ r_cran_mirror_site }}' } - { name: 'gdata', repo: '{{ r_cran_mirror_site }}' } - { name: 'earth', repo: '{{ r_cran_mirror_site }}' } - { name: 'plotrix', repo: '{{ r_cran_mirror_site }}' } - { name: 'bitops', repo: '{{ r_cran_mirror_site }}' } - { name: 'sandwich', repo: '{{ r_cran_mirror_site }}' } - { name: 'googleVis', repo: '{{ r_cran_mirror_site }}' } - { name: 'gsl', repo: '{{ r_cran_mirror_site }}' } - { name: 'copula', repo: '{{ r_cran_mirror_site }}' } - { name: 'mgcv', repo: '{{ r_cran_mirror_site }}' } - { name: 'triangle', repo: '{{ r_cran_mirror_site }}' } - { name: 'FLa4a', repo: 'http://flr-project.org/R' } r_plugins_from_sources: - { name: 'ncdf', version: '1.6.9', source: 'ncdf_1.6.9.tar.gz', url: 'https://cran.r-project.org/src/contrib/Archive/ncdf/ncdf_1.6.9.tar.gz' } r_plugins_from_github: - { plugin_name: 'RFigisGeo', github_user: 'openfigis' } - { plugin_name: 'rsdmx', github_user: 'opensdmx' } - { plugin_name: 'R.methodsS3', github_user: 'HenrikBengtsson' } - { plugin_name: 'R.oo', github_user: 'HenrikBengtsson' } - { plugin_name: 'digest', github_user: 'eddelbuettel' } - { plugin_name: 'R.utils', github_user: 'HenrikBengtsson' } - { plugin_name: 'R.cache', github_user: 'HenrikBengtsson' } - { plugin_name: 'repmis', github_user: 'christophergandrud' } - { plugin_name: 'pryr', github_user: 'hadley' } - { plugin_name: 'RColorBrewer', github_user: 'cran' } - { plugin_name: 'rCharts', github_user: 'ramnathv' } - { plugin_name: 'IRDTunaAtlas', github_user: 'juldebar' } - { plugin_name: 'FLCore', github_user: 'flr' }
Updated by Andrea Dell'Amico over 8 years ago
- Status changed from In Progress to Feedback
- % Done changed from 50 to 100
The R packages and their dependencies are now aligned on all the dataminer and rstudio servers.
Updated by Andrea Dell'Amico over 8 years ago
We are going towards a continuous packages synchronization, see #4371.
Updated by Andrea Dell'Amico over 8 years ago
- Status changed from Feedback to Closed