Git Product home page Git Product logo

microsoft-r-open's Introduction

alt text

Microsoft R Open

Microsoft R Open is the enhanced distribution of R used for for statistical analysis and Data science. This is the repository containing the source code for the open source components of Microsoft R Open. If you're looking for the latest changes, check the "public" branch.

Directory Structure

/additionalPackages -> Microsoft authored GPLv2 licensed R packages

/patch -> Patches made to the R source code when building Microsoft R Open

/source -> CRAN R source code

/vendor -> Libraries needed to build Microsoft R Open

Building

Please see the R Installation and Administration Guide for instructions on building the R source. Patches can be applied using GNU Patch.

The additional Microsoft authored packages can be built and installed using R CMD INSTALL after the R source has been built.

Learn more about Microsoft R open at https://mran.microsoft.com/.

microsoft-r-open's People

Contributors

diwashrestha avatar garanews avatar iamalsaher avatar jeroenterheerdt avatar kant avatar microsoft-github-policy-service[bot] avatar nathansoz avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

microsoft-r-open's Issues

Unnecessary post-scripts in RPM packages of MRO

In microsoft-r-open-mro-3.3 and microsoft-r-open-mkl-3.3 rpm-s there're unnecessary scripts in pre/post sections, see comments

microsoft-r-open-mro-3.3:

postinstall scriptlet (using /bin/sh):

#!/bin/bash
VERSION="3.3"
INSTALL_PREFIX="${RPM_INSTALL_PREFIX}/microsoft-r/${VERSION}"

mkdir -p ${INSTALL_PREFIX}/lib64/R/backup/lib # Should be done during rpm build, not during install
mv ${INSTALL_PREFIX}/lib64/R/lib/*.so ${INSTALL_PREFIX}/lib64/R/backup/lib # Same here
cp ${INSTALL_PREFIX}/lib64/R/backup/lib/libR.so ${INSTALL_PREFIX}/lib64/R/lib # Same here
cp ${INSTALL_PREFIX}/stage/mkl_install_stage/*.so ${INSTALL_PREFIX}/lib64/R/lib # Same here
preuninstall scriptlet (using /bin/sh):
#!/bin/bash
VERSION="3.3"
DIRECTORY="${RPM_INSTALL_PREFIX}/microsoft-r/${VERSION}/lib64/R"
if [ -d "$DIRECTORY" ]; then
  rm ${DIRECTORY}/lib/*.so # Same here
  mv ${DIRECTORY}/backup/lib/*.so ${DIRECTORY}/lib # Same here
fi

So whole pre and post sections are unnecessary, beacuse everything they do could (moreover should!) be done during build. One mistake in "rm" statement and you destroy user's system like in MrMEEE/bumblebee-Old-and-abbandoned#123

postinstall scriptlet (using /bin/sh):

#!/bin/bash

VERSION="3.3"
INSTALL_PREFIX="${RPM_INSTALL_PREFIX}/microsoft-r/${VERSION}"

ln -s "${INSTALL_PREFIX}/lib64/R/bin/R" /usr/bin/R # Should be done through "alternatives" mechanism
ln -s "${INSTALL_PREFIX}/lib64/R/bin/Rscript" /usr/bin/Rscript # same here

rm /bin/sh # WHAT!!! This is insane! Never touch files of other packages please
ln -s /bin/bash /bin/sh
preuninstall scriptlet (using /bin/sh):
#!/bin/bash

VERSION=3.3
INSTALL_PREFIX="${RPM_INSTALL_PREFIX}/microsoft-r/${VERSION}"

rm /usr/bin/R # See comment about alternatives
rm /usr/bin/Rscript # same here

rm -rf "${INSTALL_PREFIX}/lib64/R/backup" # Should be done during rpm build, not during install
postuninstall scriptlet (using /bin/sh):
#!/bin/bash

# remove if empty, leave if not empty
rmdir "${RPM_INSTALL_PREFIX}/microsoft-r" 2>/dev/null # RPM will do this for you automatically

These pre/post sections can be reduced to couple of update-alternatives calls.
And playing with /bin/sh risking of cripple user's system is wrong from any point of view, please never do this.

Issues getting packages from MRAN

I am also having issues just starting today, whereas before I had no problems yesterday with the same Travis build using mran as a source repo

My Travis command:

#Install First Set of Dependencies
  - Rscript -e 'install.packages(c("bitops","Rcpp","digest","magrittr","stringi","stringr","yaml","evaluate","formatr","highr","R6","assertthat","lazyeval","DBI","jsonlite","brew","mime","curl","caTools","openssl","memoise","whisker","rstudioapi","git2r","withr","markdown","knitr","htmltools", "rmarkdown","RCurl","htmlTable","roxygen2","dplyr","lubridate", "readr", "base64enc", "whisker"), repos="http://mran.microsoft.com/snapshot/2017-02-08", type="source")'

Output when running looks like:

travis_fold:end:R-session-info
�[0Ktravis_fold:start:install.1
�[0Ktravis_time:start:29ee26ca
�[0K$ Rscript -e 'install.packages(c("bitops","Rcpp","digest","magrittr","stringi","stringr","yaml","evaluate","formatr","highr","R6","assertthat","lazyeval","DBI","jsonlite","brew","mime","curl","caTools","openssl","memoise","whisker","rstudioapi","git2r","withr","markdown","knitr","htmltools", "rmarkdown","RCurl","htmlTable","roxygen2","dplyr","lubridate", "readr", "base64enc", "whisker"), repos="http://mran.microsoft.com/snapshot/2017-02-08", type="source")'
Installing packages into ‘/usr/local/lib/R/site-library’
(as ‘lib’ is unspecified)
Warning: unable to access index for repository http://mran.microsoft.com/snapshot/2017-02-08/src/contrib:
  cannot open URL 'http://mran.microsoft.com/snapshot/2017-02-08/src/contrib/PACKAGES'
Warning message:
packages ‘bitops’, ‘Rcpp’, ‘digest’, ‘magrittr’, ‘stringi’, ‘stringr’, ‘yaml’, ‘evaluate’, ‘formatr’, ‘highr’, ‘R6’, ‘assertthat’, ‘lazyeval’, ‘DBI’, ‘jsonlite’, ‘brew’, ‘mime’, ‘curl’, ‘caTools’, ‘openssl’, ‘memoise’, ‘whisker’, ‘rstudioapi’, ‘git2r’, ‘withr’, ‘markdown’, ‘knitr’, ‘htmltools’, ‘rmarkdown’, ‘RCurl’, ‘htmlTable’, ‘roxygen2’, ‘dplyr’, ‘lubridate’, ‘readr’, ‘base64enc’ are not available (for R version 3.3.2) 

Any tips as to what has changed?

Download url accessible by script

We frequently deploy R studio server VMs and have some build script to do that.

I'd like to move them over to Microsoft R open.

I've noticed you haven't published the release files on github, also the parent directories on your webserver, for example https://mran.microsoft.com/install/mro/ return a 403 forbidden error.

Do you have a way to always get the url of the latest stable release? (apart from webscaping)

Installation in non-default directory (Windows).

When installing Microsoft R Open 3.4.3, I decided not to install in the default directory. Instead I installed on a separate SSD drive. Upon installation I picked the top level of that drive (V:/) like I do with all of my programming languages that I have.

Problems:

  • It would not let me select a directory that did not exists. So if I hadn't already created V:/Microsoft_R_3.4.3/, then I could not just type that into the install directory text box.
  • Instead of creating a folder called V:/Microsoft_R_3.4.3/ and installing the files there, MRO installed in V:/. I assumed after the first bullet point that MRO would take care of the installation directory by creating a new directory that was empty.
  • After the disappointment of the installation strategy, I decided to uninstall the program. Instead of only removing Microsoft R Open files/directorys, it removed everything in V:/ drive.
    • I had Python, Rstudio, R 3.4.3, git, Pycharm, and Python to name a few installed here along with a few projects.
  • When I saw my V:/ drive I was in shock, so I installed everything again and created a specific folder for Microsoft R Open before installing again.
  • Luckily I didn't lose any important files, however, this is a really dangerous setup.

Solution:

  • I would suggest creating a new directory if the chosen (non-default directory) is not empty, upon installing this software.
  • Give the user the ability to use a path that does not exist and creating a directory from that path. You could also prompt the user to let them know, so they can either cancel with the chose path or continue as needed.

Package installation error: "C++11 standard requested but CXX11 is not defined"

Hi

I have been trying to install packages such as text2vec on MRO open 3.4.0 on a completely updated Linux Mint 18.1 64 bit system and I am getting the above-mentioned error message; here are more details:

.libPaths()

[1] "/home/laptop/R/x86_64-pc-linux-gnu-library/3.3"

[2] "/usr/lib64/microsoft-r/3.4/lib64/R/library"

install.packages("text2vec", lib=.libPaths()[2])

[...]

* installing source package ‘text2vec’ ...

** package ‘text2vec’ successfully unpacked and MD5 sums checked

** libs

Error in .shlib_internal(args) :

C++11 standard requested but CXX11 is not defined

* removing ‘/usr/lib64/microsoft-r/3.4/lib64/R/library/text2vec’

I have seen this discussion http://r.789695.n4.nabble.com/R-3-4-has-broken-C-11-support-td4732692.html but it didn't help me figure out what to do. Here's some info that might help:

R.version

platform x86_64-pc-linux-gnu

arch x86_64

os linux-gnu

system x86_64, linux-gnu

status

major 3

minor 4.0

year 2017

month 04

day 21

svn rev 72570

language R

version.string R version 3.4.0 (2017-04-21)

nickname You Stupid Darkness

Any thoughts?

Incorrect PATH when installing via conda on Mac

I am not sure where this issue should be reported, but installing MRO via the conda package manager on a Mac does not currently work as expected due to a minor issue with the R_HOME environment variable in r-activate.sh.

Is there an issue tracker for the Microsoft R Open anaconda channel?

To reproduce on macOS 10.12.3 using conda 4.3.8...

conda install -c mro r
r
/Users/me/anaconda/bin/r: line 207: /etc/ldpaths: No such file or directory

The issue is related to conda/conda#2312. The script r-activate.sh currently expects $CONDA_ENV_PATH to reference the conda environment path, but this variable no longer exists in recent versions of the conda activate script. The fix is to replace this environment variable with $CONDA_PREFIX.

@mingwandroid, are you the person responsible for this script?

Microsoft R v3.4.0 - Segfault on Debian 9 'memory not mapped'

Installed as root on pretty fresh Debian 9 installation

Installed both the msro and the intel packages

did not see any error in the install output to the screen.

regularuser@debian9-stretch:~$ R

R version 3.4.0 (2017-04-21) -- "You Stupid Darkness"
Copyright (C) 2017 The R Foundation for Statistical Computing
Platform: x86_64-pc-linux-gnu (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.

Natural language support but running in an English locale

R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.

*** caught segfault ***
address 0x50, cause 'memory not mapped'

Traceback:
1: dyn.load(libPath)
2: doTryCatch(return(expr), name, parentenv, handler)
3: tryCatchOne(expr, names, parentenv, handlers[[1L]])
4: tryCatchList(expr, classes, parentenv, handlers)
5: tryCatch(expr, error = function(e) { call <- conditionCall(e) if (!is.null(call)) { if (identical(call[[1L]], quote(doTryCatch))) call <- sys.call(-4L) dcall <- deparse(call)[1L] prefix <- paste("Error in", dcall, ": ") LONG <- 75L msg <- conditionMessage(e) sm <- strsplit(msg, "\n")[[1L]] w <- 14L + nchar(dcall, type = "w") + nchar(sm[1L], type = "w") if (is.na(w)) w <- 14L + nchar(dcall, type = "b") + nchar(sm[1L], type = "b") if (w > LONG) prefix <- paste0(prefix, "\n ") } else prefix <- "Error : " msg <- paste0(prefix, conditionMessage(e), "\n") .Internal(seterrmessage(msg[1L])) if (!silent && identical(getOption("show.error.messages"), TRUE)) { cat(msg, file = outFile) .Internal(printDeferredWarnings()) } invisible(structure(msg, class = "try-error", condition = e))})
6: try(dyn.load(libPath), silent = TRUE)
7: tryLoadMKL(full_path, mklSymbol)
8: fun(libname, pkgname)
9: doTryCatch(return(expr), name, parentenv, handler)
10: tryCatchOne(expr, names, parentenv, handlers[[1L]])
11: tryCatchList(expr, classes, parentenv, handlers)
12: tryCatch(fun(libname, pkgname), error = identity)
13: runHook(".onLoad", env, package.lib, package)
14: loadNamespace(package, lib.loc)
15: doTryCatch(return(expr), name, parentenv, handler)
16: tryCatchOne(expr, names, parentenv, handlers[[1L]])
17: tryCatchList(expr, classes, parentenv, handlers)
18: tryCatch({ attr(package, "LibPath") <- which.lib.loc ns <- loadNamespace(package, lib.loc) env <- attachNamespace(ns, pos = pos, deps)}, error = function(e) { P <- if (!is.null(cc <- conditionCall(e))) paste(" in", deparse(cc)[1L]) else "" msg <- gettextf("package or namespace load failed for %s%s:\n %s", sQuote(package), P, conditionMessage(e)) if (logical.return) message(paste("Error:", msg), domain = NA) else stop(msg, call. = FALSE, domain = NA)})
19: library("RevoUtilsMath")
20: do.call("library", list(package))
21: load_if_installed("RevoUtilsMath")
22: eval(quote({ r <- getOption("repos") if (.Platform$OS.type == "unix") { options(download.file.method = "curl") } r["CRAN"] <- RevoUtils::getRevoRepos() options(repos = r) MRS.is.client <- RevoUtils:::isMicrosoftRClient() isMMLSupported <- FALSE if (identical(.Platform$OS.type, "windows")) { isMMLSupported <- TRUE } if (identical(.Platform$OS.type, "unix") && length(grep("Ubuntu", Sys.info()["version"]))) { if (file.exists("/etc/lsb-release")) { UbuntuReleaseInfo <- scan("/etc/lsb-release", what = "", sep = "\n", quiet = TRUE) if (identical(UbuntuReleaseInfo[2], "DISTRIB_RELEASE=14.04") || identical(UbuntuReleaseInfo[2], "DISTRIB_RELEASE=16.04")) { isMMLSupported <- TRUE } } } if (identical(.Platform$OS.type, "unix") && length(grep("el7.x86_64", Sys.info()["release"]))) { isMMLSupported <- TRUE } if (!identical(system.file(package = "RevoScaleR"), "")) { options(defaultPackages = c(getOption("defaultPackages"), "rpart", "lattice", "RevoScaleR", if (!identical(system.file(package = "mrsdeploy"), "") && identical(.Platform$OS, "windows")) "mrsdeploy", if (!identical(system.file(package = "MicrosoftML"), "") && isMMLSupported) "MicrosoftML", "RevoMods", "RevoUtils", "RevoUtilsMath")) if (nchar(hostName <- Sys.getenv("REVOHADOOPHOST")) && nchar(portNumber <- Sys.getenv("REVOHADOOPPORT"))) { RevoScaleR::rxHdfsConnect(hostName = hostName, portNumber = as.numeric(portNumber)) } } .RevoVersionShort <- Revo.version$version.string .RevoVersionShortLen <- regexpr("^.* \d+\.\d+", .RevoVersionShort, perl = TRUE) .RevoVersionShort <- substring(.RevoVersionShort, 1, attributes(.RevoVersionShortLen)$match) if ("setWindowTitle" %in% getNamespaceExports("utils")) { if (Revo.version$arch == "x86_64") { .RevoVersionShort <- paste(.RevoVersionShort, "(64-bit)") } try(utils::setWindowTitle(paste(" - ", .RevoVersionShort)), silent = TRUE) } if (.Platform$OS.type == "unix" && capabilities("X11")) { browseAvail <- Sys.which(c("firefox", "mozilla", "galeon", "opera", "xdg-open", "kfmclient", "gnome-moze-remote")) if (any(browseAvail != "")) { options(browser = browseAvail[which(browseAvail != "")[1]]) } } if (.Platform$OS.type == "windows") { options(help_type = "html") } load_if_installed <- function(package) { if (!identical(system.file(package = "RevoUtilsMath"), "")) { do.call("library", list(package)) return(TRUE) } else { return(FALSE) } } if (identical(system.file(package = "RevoScaleR"), "")) { if (load_if_installed("RevoUtilsMath")) { ncores <- RevoUtilsMath::getMKLthreads() } else { MROversion <- paste(Revo.version$major, Revo.version$minor, sep = ".") MKLmsg <- "No performance acceleration libraries were detected. To take advantage of \nthe available processing power, also install MKL for R Open. Visit \nhttp://go.microsoft.com/fwlink/?LinkID=698301 for more details.\n" } if (Sys.info()["sysname"] == "Darwin") { options(download.file.method = "libcurl") hw.ncpu <- try(system("sysctl hw.physicalcpu", intern = TRUE)) if (!inherits(hw.ncpu, "try-error")) { ncores <- sub("hw.physicalcpu: ", "", hw.ncpu) MKLmsg = paste0("Multithreaded BLAS/LAPACK libraries detected. Using ", ncores, " cores for math algorithms.\n") } } else { if (load_if_installed("RevoUtilsMath")) { ncores <- RevoUtilsMath::getMKLthreads() MKLmsg = "" } else { MROversion <- paste(Revo.version$major, Revo.version$minor, sep = ".") MKLmsg <- "No performance acceleration libraries were detected. To take advantage of \nthe available processing power, also install MKL for R Open. \n\nVisit http://go.microsoft.com/fwlink/?LinkID=698301 for more details." } } } else { ncores <- RevoUtilsMath::getMKLthreads() MKLmsg <- "" } quiet <- any(match(c("-q", "--silent", "--quiet", "--slave"), commandArgs()), na.rm = TRUE) if (!quiet && !identical(system.file(package = "RevoScaleR"), "")) { cat("Microsoft R Open ", R.version$major, ".", R.version$minor, "\n", sep = "") cat("The enhanced R distribution from Microsoft\n", sep = "") cat("Microsoft packages Copyright (C)", Revo.version$year, "Microsoft\n\n") if (MRS.is.client == FALSE) { ScaleRPkgName <- "RevoScaleR" pkgVersion <- utils::packageDescription(ScaleRPkgName)$Version cat("Loading Microsoft R Server packages, version ", pkgVersion, ".\n", sep = "") } else { RclientPkgName <- "MicrosoftR" pkgVersion <- utils::packageDescription(RclientPkgName)$Version cat("Loading Microsoft R Client packages, version ", pkgVersion, ". \n", sep = "") cat("Microsoft R Client limits some functions to available memory.\n") cat("See: https://go.microsoft.com/fwlink/?linkid=799476 for information\n", sep = "") cat("about additional features.\n\n", sep = "") } cat("Type 'readme()' for release notes, privacy() for privacy policy, or\n", sep = "") cat("'RevoLicense()' for licensing information.\n\n", sep = "") if (MKLmsg == "") { cat(paste("Using the Intel MKL for parallel mathematical computing(using", ncores, "cores).\n", sep = " ")) } else { cat(MKLmsg, MROversion, sep = " ") } cat(paste("Default CRAN mirror snapshot taken on ", repos.date, ".\n", sep = "")) cat("See: https://mran.microsoft.com/.", "\n\n", sep = "") mrupdate::mrCheckForUpdates() } else if (!quiet) { cat("Microsoft R Open ", R.version$major, ".", R.version$minor, "\n", sep = "") cat("The enhanced R distribution from Microsoft\n", sep = "") cat("Microsoft packages Copyright (C)", Revo.version$year, "Microsoft Corporation\n\n") if (MKLmsg == "") { cat(paste("Using the Intel MKL for parallel mathematical computing(using", ncores, "cores).\n", sep = " ")) } else { cat(MKLmsg) } cat("\nDefault CRAN mirror snapshot taken on ", repos.date, ".", sep = "") cat("\n", "See: https://mran.microsoft.com/.", sep = "") cat("\n\n") }}), new.env())
23: eval(quote({ r <- getOption("repos") if (.Platform$OS.type == "unix") { options(download.file.method = "curl") } r["CRAN"] <- RevoUtils::getRevoRepos() options(repos = r) MRS.is.client <- RevoUtils:::isMicrosoftRClient() isMMLSupported <- FALSE if (identical(.Platform$OS.type, "windows")) { isMMLSupported <- TRUE } if (identical(.Platform$OS.type, "unix") && length(grep("Ubuntu", Sys.info()["version"]))) { if (file.exists("/etc/lsb-release")) { UbuntuReleaseInfo <- scan("/etc/lsb-release", what = "", sep = "\n", quiet = TRUE) if (identical(UbuntuReleaseInfo[2], "DISTRIB_RELEASE=14.04") || identical(UbuntuReleaseInfo[2], "DISTRIB_RELEASE=16.04")) { isMMLSupported <- TRUE } } } if (identical(.Platform$OS.type, "unix") && length(grep("el7.x86_64", Sys.info()["release"]))) { isMMLSupported <- TRUE } if (!identical(system.file(package = "RevoScaleR"), "")) { options(defaultPackages = c(getOption("defaultPackages"), "rpart", "lattice", "RevoScaleR", if (!identical(system.file(package = "mrsdeploy"), "") && identical(.Platform$OS, "windows")) "mrsdeploy", if (!identical(system.file(package = "MicrosoftML"), "") && isMMLSupported) "MicrosoftML", "RevoMods", "RevoUtils", "RevoUtilsMath")) if (nchar(hostName <- Sys.getenv("REVOHADOOPHOST")) && nchar(portNumber <- Sys.getenv("REVOHADOOPPORT"))) { RevoScaleR::rxHdfsConnect(hostName = hostName, portNumber = as.numeric(portNumber)) } } .RevoVersionShort <- Revo.version$version.string .RevoVersionShortLen <- regexpr("^.* \d+\.\d+", .RevoVersionShort, perl = TRUE) .RevoVersionShort <- substring(.RevoVersionShort, 1, attributes(.RevoVersionShortLen)$match) if ("setWindowTitle" %in% getNamespaceExports("utils")) { if (Revo.version$arch == "x86_64") { .RevoVersionShort <- paste(.RevoVersionShort, "(64-bit)") } try(utils::setWindowTitle(paste(" - ", .RevoVersionShort)), silent = TRUE) } if (.Platform$OS.type == "unix" && capabilities("X11")) { browseAvail <- Sys.which(c("firefox", "mozilla", "galeon", "opera", "xdg-open", "kfmclient", "gnome-moze-remote")) if (any(browseAvail != "")) { options(browser = browseAvail[which(browseAvail != "")[1]]) } } if (.Platform$OS.type == "windows") { options(help_type = "html") } load_if_installed <- function(package) { if (!identical(system.file(package = "RevoUtilsMath"), "")) { do.call("library", list(package)) return(TRUE) } else { return(FALSE) } } if (identical(system.file(package = "RevoScaleR"), "")) { if (load_if_installed("RevoUtilsMath")) { ncores <- RevoUtilsMath::getMKLthreads() } else { MROversion <- paste(Revo.version$major, Revo.version$minor, sep = ".") MKLmsg <- "No performance acceleration libraries were detected. To take advantage of \nthe available processing power, also install MKL for R Open. Visit \nhttp://go.microsoft.com/fwlink/?LinkID=698301 for more details.\n" } if (Sys.info()["sysname"] == "Darwin") { options(download.file.method = "libcurl") hw.ncpu <- try(system("sysctl hw.physicalcpu", intern = TRUE)) if (!inherits(hw.ncpu, "try-error")) { ncores <- sub("hw.physicalcpu: ", "", hw.ncpu) MKLmsg = paste0("Multithreaded BLAS/LAPACK libraries detected. Using ", ncores, " cores for math algorithms.\n") } } else { if (load_if_installed("RevoUtilsMath")) { ncores <- RevoUtilsMath::getMKLthreads() MKLmsg = "" } else { MROversion <- paste(Revo.version$major, Revo.version$minor, sep = ".") MKLmsg <- "No performance acceleration libraries were detected. To take advantage of \nthe available processing power, also install MKL for R Open. \n\nVisit http://go.microsoft.com/fwlink/?LinkID=698301 for more details." } } } else { ncores <- RevoUtilsMath::getMKLthreads() MKLmsg <- "" } quiet <- any(match(c("-q", "--silent", "--quiet", "--slave"), commandArgs()), na.rm = TRUE) if (!quiet && !identical(system.file(package = "RevoScaleR"), "")) { cat("Microsoft R Open ", R.version$major, ".", R.version$minor, "\n", sep = "") cat("The enhanced R distribution from Microsoft\n", sep = "") cat("Microsoft packages Copyright (C)", Revo.version$year, "Microsoft\n\n") if (MRS.is.client == FALSE) { ScaleRPkgName <- "RevoScaleR" pkgVersion <- utils::packageDescription(ScaleRPkgName)$Version cat("Loading Microsoft R Server packages, version ", pkgVersion, ".\n", sep = "") } else { RclientPkgName <- "MicrosoftR" pkgVersion <- utils::packageDescription(RclientPkgName)$Version cat("Loading Microsoft R Client packages, version ", pkgVersion, ". \n", sep = "") cat("Microsoft R Client limits some functions to available memory.\n") cat("See: https://go.microsoft.com/fwlink/?linkid=799476 for information\n", sep = "") cat("about additional features.\n\n", sep = "") } cat("Type 'readme()' for release notes, privacy() for privacy policy, or\n", sep = "") cat("'RevoLicense()' for licensing information.\n\n", sep = "") if (MKLmsg == "") { cat(paste("Using the Intel MKL for parallel mathematical computing(using", ncores, "cores).\n", sep = " ")) } else { cat(MKLmsg, MROversion, sep = " ") } cat(paste("Default CRAN mirror snapshot taken on ", repos.date, ".\n", sep = "")) cat("See: https://mran.microsoft.com/.", "\n\n", sep = "") mrupdate::mrCheckForUpdates() } else if (!quiet) { cat("Microsoft R Open ", R.version$major, ".", R.version$minor, "\n", sep = "") cat("The enhanced R distribution from Microsoft\n", sep = "") cat("Microsoft packages Copyright (C)", Revo.version$year, "Microsoft Corporation\n\n") if (MKLmsg == "") { cat(paste("Using the Intel MKL for parallel mathematical computing(using", ncores, "cores).\n", sep = " ")) } else { cat(MKLmsg) } cat("\nDefault CRAN mirror snapshot taken on ", repos.date, ".", sep = "") cat("\n", "See: https://mran.microsoft.com/.", sep = "") cat("\n\n") }}), new.env())
24: eval(expr, p)
25: eval(expr, p)
26: eval.parent(substitute(eval(quote(expr), envir)))
27: local({ r <- getOption("repos") if (.Platform$OS.type == "unix") { options(download.file.method = "curl") } r["CRAN"] <- RevoUtils::getRevoRepos() options(repos = r) MRS.is.client <- RevoUtils:::isMicrosoftRClient() isMMLSupported <- FALSE if (identical(.Platform$OS.type, "windows")) { isMMLSupported <- TRUE } if (identical(.Platform$OS.type, "unix") && length(grep("Ubuntu", Sys.info()["version"]))) { if (file.exists("/etc/lsb-release")) { UbuntuReleaseInfo <- scan("/etc/lsb-release", what = "", sep = "\n", quiet = TRUE) if (identical(UbuntuReleaseInfo[2], "DISTRIB_RELEASE=14.04") || identical(UbuntuReleaseInfo[2], "DISTRIB_RELEASE=16.04")) { isMMLSupported <- TRUE } } } if (identical(.Platform$OS.type, "unix") && length(grep("el7.x86_64", Sys.info()["release"]))) { isMMLSupported <- TRUE } if (!identical(system.file(package = "RevoScaleR"), "")) { options(defaultPackages = c(getOption("defaultPackages"), "rpart", "lattice", "RevoScaleR", if (!identical(system.file(package = "mrsdeploy"), "") && identical(.Platform$OS, "windows")) "mrsdeploy", if (!identical(system.file(package = "MicrosoftML"), "") && isMMLSupported) "MicrosoftML", "RevoMods", "RevoUtils", "RevoUtilsMath")) if (nchar(hostName <- Sys.getenv("REVOHADOOPHOST")) && nchar(portNumber <- Sys.getenv("REVOHADOOPPORT"))) { RevoScaleR::rxHdfsConnect(hostName = hostName, portNumber = as.numeric(portNumber)) } } .RevoVersionShort <- Revo.version$version.string .RevoVersionShortLen <- regexpr("^.* \d+\.\d+", .RevoVersionShort, perl = TRUE) .RevoVersionShort <- substring(.RevoVersionShort, 1, attributes(.RevoVersionShortLen)$match) if ("setWindowTitle" %in% getNamespaceExports("utils")) { if (Revo.version$arch == "x86_64") { .RevoVersionShort <- paste(.RevoVersionShort, "(64-bit)") } try(utils::setWindowTitle(paste(" - ", .RevoVersionShort)), silent = TRUE) } if (.Platform$OS.type == "unix" && capabilities("X11")) { browseAvail <- Sys.which(c("firefox", "mozilla", "galeon", "opera", "xdg-open", "kfmclient", "gnome-moze-remote")) if (any(browseAvail != "")) { options(browser = browseAvail[which(browseAvail != "")[1]]) } } if (.Platform$OS.type == "windows") { options(help_type = "html") } load_if_installed <- function(package) { if (!identical(system.file(package = "RevoUtilsMath"), "")) { do.call("library", list(package)) return(TRUE) } else { return(FALSE) } } if (identical(system.file(package = "RevoScaleR"), "")) { if (load_if_installed("RevoUtilsMath")) { ncores <- RevoUtilsMath::getMKLthreads() } else { MROversion <- paste(Revo.version$major, Revo.version$minor, sep = ".") MKLmsg <- "No performance acceleration libraries were detected. To take advantage of \nthe available processing power, also install MKL for R Open. Visit \nhttp://go.microsoft.com/fwlink/?LinkID=698301 for more details.\n" } if (Sys.info()["sysname"] == "Darwin") { options(download.file.method = "libcurl") hw.ncpu <- try(system("sysctl hw.physicalcpu", intern = TRUE)) if (!inherits(hw.ncpu, "try-error")) { ncores <- sub("hw.physicalcpu: ", "", hw.ncpu) MKLmsg = paste0("Multithreaded BLAS/LAPACK libraries detected. Using ", ncores, " cores for math algorithms.\n") } } else { if (load_if_installed("RevoUtilsMath")) { ncores <- RevoUtilsMath::getMKLthreads() MKLmsg = "" } else { MROversion <- paste(Revo.version$major, Revo.version$minor, sep = ".") MKLmsg <- "No performance acceleration libraries were detected. To take advantage of \nthe available processing power, also install MKL for R Open. \n\nVisit http://go.microsoft.com/fwlink/?LinkID=698301 for more details." } } } else { ncores <- RevoUtilsMath::getMKLthreads() MKLmsg <- "" } quiet <- any(match(c("-q", "--silent", "--quiet", "--slave"), commandArgs()), na.rm = TRUE) if (!quiet && !identical(system.file(package = "RevoScaleR"), "")) { cat("Microsoft R Open ", R.version$major, ".", R.version$minor, "\n", sep = "") cat("The enhanced R distribution from Microsoft\n", sep = "") cat("Microsoft packages Copyright (C)", Revo.version$year, "Microsoft\n\n") if (MRS.is.client == FALSE) { ScaleRPkgName <- "RevoScaleR" pkgVersion <- utils::packageDescription(ScaleRPkgName)$Version cat("Loading Microsoft R Server packages, version ", pkgVersion, ".\n", sep = "") } else { RclientPkgName <- "MicrosoftR" pkgVersion <- utils::packageDescription(RclientPkgName)$Version cat("Loading Microsoft R Client packages, version ", pkgVersion, ". \n", sep = "") cat("Microsoft R Client limits some functions to available memory.\n") cat("See: https://go.microsoft.com/fwlink/?linkid=799476 for information\n", sep = "") cat("about additional features.\n\n", sep = "") } cat("Type 'readme()' for release notes, privacy() for privacy policy, or\n", sep = "") cat("'RevoLicense()' for licensing information.\n\n", sep = "") if (MKLmsg == "") { cat(paste("Using the Intel MKL for parallel mathematical computing(using", ncores, "cores).\n", sep = " ")) } else { cat(MKLmsg, MROversion, sep = " ") } cat(paste("Default CRAN mirror snapshot taken on ", repos.date, ".\n", sep = "")) cat("See: https://mran.microsoft.com/.", "\n\n", sep = "") mrupdate::mrCheckForUpdates() } else if (!quiet) { cat("Microsoft R Open ", R.version$major, ".", R.version$minor, "\n", sep = "") cat("The enhanced R distribution from Microsoft\n", sep = "") cat("Microsoft packages Copyright (C)", Revo.version$year, "Microsoft Corporation\n\n") if (MKLmsg == "") { cat(paste("Using the Intel MKL for parallel mathematical computing(using", ncores, "cores).\n", sep = " ")) } else { cat(MKLmsg) } cat("\nDefault CRAN mirror snapshot taken on ", repos.date, ".", sep = "") cat("\n", "See: https://mran.microsoft.com/.", sep = "") cat("\n\n") }})

Possible actions:
1: abort (with core dump, if enabled)
2: normal R exit
3: exit R without saving workspace
4: exit R saving workspace
Selection: 2
Save workspace image? [y/n/c]: n
Warning message:
In doTryCatch(return(expr), name, parentenv, handler) :
unable to load shared object '/usr/lib64/microsoft-r/3.4/lib64/R/modules//R_X11.so':
libpng12.so.0: cannot open shared object file: No such file or directory
testu1@debian9-stretch-vm-template:~$

This was the fix for me: (as root)

apt-get install libpng16-16

cd /usr/lib/x86_64-linux-gnu

ln -s libpng16.so.16.28.0 libpng12.so.0

Could this be added to the installer?

Packages that utilize built in Curl are not able to find a certificate bundle

An example:

R
install.packages("ctv")
library(ctv)
install.views("Econometrics")


I was faced with the error.
Error in url(paste(contriburl[i], "Views.rds", sep = "/"), open = "rb") : 
  cannot open connection
In addition: Warning message:
In url(paste(contriburl[i], "Views.rds", sep = "/"), open = "rb") :
  URL 'https://mran.revolutionanalytics.com/snapshot/2016-07-01/src/contrib/Views.rds': status was 'Problem with the SSL CA cert (path? access rights?)'

The issue was [reported here](https://social.msdn.microsoft.com/Forums/en-US/20c2667c-1518-4e74-8ba6-0d8ebb7da9f0/installing-views?forum=ropen&prof=required)

The solution is to modify the command to look like this:

``` R```
Sys.setenv(CURL_CA_BUNDLE = "/usr/lib64/microsoft-r/3.3/lib64/R/lib/microsoft-r-cacert.pem")
install.packages("ctv")
library(ctv)
install.views("Econometrics")

Installation fails in Ubuntu 16.04 if there is a previous version installed

I had MRO version 3.3.1 installed, downloaded and tried to install version 3.3.2, and it fails with this message:

There was an error installing Microsoft R Open.
Please check the logs at:
/home/javier/Downloads/microsoft-r-open/logs

in the logs/mkl.txt file, I find this:

(Reading database ... 958646 files and directories currently installed.)
Preparing to unpack .../microsoft-r-open-mkl-3.3.deb ...
mv: cannot stat '/usr/lib64/microsoft-r/3.3/lib64/R/backup/lib/*.so': No such file or directory
dpkg: warning: subprocess old pre-removal script returned error exit status 1
dpkg: trying script from the new package instead ...
rm: cannot remove '/usr/lib64/microsoft-r/3.3/lib64/R/lib/*.so': No such file or directory
mv: cannot stat '/usr/lib64/microsoft-r/3.3/lib64/R/backup/lib/*.so': No such file or directory
dpkg: error processing archive /home/javier/Downloads/microsoft-r-open/deb/microsoft-r-open-mkl-3.3.deb (--install):
 subprocess new pre-removal script returned error exit status 1
mv: cannot stat '/usr/lib64/microsoft-r/3.3/lib64/R/lib/*.so': No such file or directory
cp: cannot stat '/usr/lib64/microsoft-r/3.3/lib64/R/backup/lib/libR.so': No such file or directory
cp: cannot stat '/usr/lib64/microsoft-r/3.3/stage/mkl_install_stage/*.so': No such file or directory
dpkg: error while cleaning up:
 subprocess installed post-installation script returned error exit status 1
Errors were encountered while processing:
 /home/javier/Downloads/microsoft-r-open/deb/microsoft-r-open-mkl-3.3.deb

I have also tried to force-remove previous versions of mkl as suggested in #10 , to no avail:

javier@javier-Desktop:~/Downloads/microsoft-r-open/logs$ sudo dpkg --remove --force-remove-reinstreq microsoft-r-open-mkl-3.3
dpkg: warning: overriding problem because --force enabled:
dpkg: warning: package is in a very bad inconsistent state; you should
 reinstall it before attempting a removal
(Reading database ... 958645 files and directories currently installed.)
Removing microsoft-r-open-mkl-3.3 (3.3.1) ...
rm: cannot remove '/usr/lib64/microsoft-r/3.3/lib64/R/lib/*.so': No such file or directory
mv: cannot stat '/usr/lib64/microsoft-r/3.3/lib64/R/backup/lib/*.so': No such file or directory
dpkg: error processing package microsoft-r-open-mkl-3.3 (--remove):
 subprocess installed pre-removal script returned error exit status 1
mv: cannot stat '/usr/lib64/microsoft-r/3.3/lib64/R/lib/*.so': No such file or directory
cp: cannot stat '/usr/lib64/microsoft-r/3.3/lib64/R/backup/lib/libR.so': No such file or directory
cp: cannot stat '/usr/lib64/microsoft-r/3.3/stage/mkl_install_stage/*.so': No such file or directory
dpkg: error while cleaning up:
 subprocess installed post-installation script returned error exit status 1
Errors were encountered while processing:
 microsoft-r-open-mkl-3.3

Other suggestion in this post also doesn't wotk:

javier@javier-Desktop:~/Downloads/microsoft-r-open/logs$ sudo apt-get -f autoremove
Reading package lists... Done
Building dependency tree       
Reading state information... Done
E: The package microsoft-r-open-mkl-3.3 needs to be reinstalled, but I can't find an archive for it.

After attempting this I cannot even run my old R version. Is there a way for force a clean-up and reinstall?

Issues with MKL when installing Microsoft R Open

My companies IT department installed Microsoft R Open 3.3.1 for me. However, when opening R studio and selecting Microsoft R Open I receive the following comment in the console;
No performance acceleration libraries were detected. To take advantage of
the available processing power, also install MKL for R Open.

So I checked with my IT department and they let me know the following;
While installing the given source we got the following error (Proxy Authentication Error - 407) and the error was caused by the MKL library that has been embedded with the source that we were provided . On research we came to know that MKL is a library by Intel to accelerate performance , so we disabled the library installation to prevent this error.

Is there anyone here that can help me with this issue?
Thanks!

Installation of Open Cpu on RHEL 6.4

Hello,

We have oopencpu on RHEL Server 6.4, While installing everything got installed without any errors, but when we try to see the libraries of the open cpu using curl http://localhost/ocpu/library/ we are unable to see any response.

Can you please help us resolving this.

Regards,
Raghuram.

libpng12.so.0: cannot open shared object file: No such file or directory

I have ropen 3.4.1 installed and for some reason it is not recognizing the shared library file. I've tried adding a symlink but that doesn't fix the issue. Im running centos7.

ERROR:

*** caught segfault ***
address 0x50, cause 'memory not mapped'

Traceback:
1: dyn.load(libPath)
2: doTryCatch(return(expr), name, parentenv, handler)
3: tryCatchOne(expr, names, parentenv, handlers[[1L]])
4: tryCatchList(expr, classes, parentenv, handlers)

Warning message:
In doTryCatch(return(expr), name, parentenv, handler) :
unable to load shared object '/cm/shared/apps/R/Microsoft/3.4.1/ropen/3.4.1/lib64/R/modules//R_X11.so':
libpng12.so.0: cannot open shared object file: No such file or directory

Error message from foreach+doParallel loop

I typically parallelize my code as follows:

cl <- makeCluster(20, outfile='log.txt')
registerDoParallel(cl)
foreach(x=some_vectro) %dopar% {
    # time consuming processes
}

The process usually succeeds, however, when I check the log file, I usually see the following at the end of the file:

Error in unserialize(node$con) : error reading from connection
Calls: <Anonymous> ... doTryCatch -> recvData -> recvData.SOCKnode -> unserialize
Execution halted

This is reproducible on my PC. Does this hint something is wrong? how can I find out where things went wrong?

Registry key 'SOFTWARE\Revolution' not found

on Windows, when I ran

Windows = findRscript(version = "3.3.1.*x64" )

I got the following error message,

Error in readRegistry(ptn, maxdepth = 3) : 
  Registry key 'SOFTWARE\Revolution' not found

Potential issue when computing SVD on Mac OS

I was doing some principal component analysis on my macbook running Microsoft R 3.3.0 when I got some strange results. Double checking with a colleague, I've realised that the output of the SVD function was different from what I may get by using vanilla R.

This is the reproducible result, please load the file (~78 Mb) here: https://dl.dropboxusercontent.com/u/1249990/Cx.rda

With Microsoft R 3.3.0 (x86_64-apple-darwin14.5.0) I get:

>> sv <- svd(Cx)
>> print(sv$d[1:10])

 [1] 122.73664 104.45759  90.52001  87.21890  81.28256  74.33418      73.29427  66.26472  63.51379
[10]  55.20763

Instead on a vanilla R (both with R 3.3 and R 3.3.1 on two different linux machines):

>> sv <- svd(Cx)
>> print(sv$d[1:10])

 [1] 122.73664  34.67177  18.50610  14.04483   8.35690   6.80784   6.14566
 [8]   3.91788   3.76016   2.66381

This is not happening with all the data, if I create some random matrix and I apply svd on that, I get the same results. So, it looks like a sort of numerical instability, isn't it?

UPDATE: I've tried to compute the SVD on the same matrix (Cx) on the same machine (macbook) with the same version of R by using the svd package and finally I get the "right" numbers. Then it seems due to the svd implementation used by Microsoft R Open.

Problem with 3.3.3 installer? (Windows)

I've gone through lots of trouble, uninstalling MRO 3.3.2 and 3.3.3, giant PIA.

So far I have observed two problems:

  1. The installer will DO NOTHING if it thinks its version of MRO is already installed;
  2. The installer will ignore the installation directory you entered, and will always dump its payload at (program files)\Microsoft\ROpen.

Regarding problem No. 1, is there a force install switch for the installer?

Regarding problem No. 2, the only comment I have is, WTF?

mran -> cran URL change broke install.packages

It appears that Microsoft changed mran.microsoft.com to cran.microsoft.com, but didn't (a) put up an HTTP 301 at mran.microsoft.com or (b) change getRevoRepos.R(? file looks out of date in this repo) to use cran.microsoft.com for installing packages.

There are a handful of reports of this, but it doesn't seem to be getting the attention it merits given that it breaks a major point of MRO...

Failed to compile Rcpp based packages

I couldn't compile Rcpp-based package RcppBDT on two of my PCs, one uses CentOS and the other uses Ubuntu. The errors are the same. (I can compile some other Rcpp-based packages though)

Here's the link to the original post: eddelbuettel/rcppbdt#3

The problem is weird. R is supposed to compile c++ source scripts with something like

g++ -I/usr/lib64/microsoft-r/3.3/include ...

However, it removed the first part of the above command and run the following instead

I/user/lib64/microsoft-r/3.3/include ...

Then I got a No File Found error, because there's no file named I/user/lib64/microsoft-r/3.3/include

Package limSolve does not install with MKL on CentOS 7

The MKL file libRblas.so is missing the fortran symbol "lsame_" which prevents installation of the R package limSolve. It works if I use MRO without MKL because the lsame_ symbol is present in the default libRblas.so

libpng12.so.0: cannot open shared object file: No such file or directory

unable to load shared object '/usr/lib64/microsoft-r/3.3/lib64/R/modules//R_X11.so':
  libpng12.so.0: cannot open shared object file: No such file or directory

debian test version
solution,
it has libpng16.so.0
so I tried

ln -s /usr/lib/x86_64-linux-gnu/libpng.so /usr/lib64/microsoft-r/3.3/lib64/R/lib/libpng12.so.0

and it works

Ubuntu 16.04

Is support for Ubuntu 16.04 LTS to be expected soon?

R load / capabilities("X11") hangs

Recently my R stopped loading.

It will say R is loading and will be stuck there forever. I tried from Rstudio, directly from MRO GUI, and console. the same results.

Tried fully deleting and installing MRO (R version 3.3.3, Mac OS Sierra 10.12.6).

It will still not fully load. R --vanilla would run, so I tried to go down from R --no-site-file --no-init-file --no-environ --no-restore. Removing --no-site-file would break loading again.

Tracked down Rprofile.site to: /Library/Frameworks/R.framework/Versions/3.3.3-MRO/Resources/etc/Rprofile.site

Tried to run it by-hand. And R hangs when it reaches capabilities("X11") (Just capabilities() has the same result, something like capabilities("jpeg") would run normally).

Any suggestions?

if (!identical(system.file(package="RevoUtils"), "")) {
Revo.version <- RevoUtils:::makeRevoVersion()
repos.date <- utils::packageDescription("RevoUtils")$MRANDate
}

if (!identical(system.file(package="RevoScaleR"), "")) {
    if (.Platform$OS.type == "windows"){
        defaultRevoNodePath <- paste("C:\\Program Files\\Microsoft\\MRO-for-RRE\\", paste(Revo.version$major, substr(Revo.version$minor,1,1), sep="."), sep="")
        defaultRNodePath <- utils::shortPathName(R.home())
    } else {
        defaultRevoNodePath <- paste("/usr/lib64/MRS-", paste(Revo.version$major, substr(Revo.version$minor,1,1), sep="."), sep="")
        defaultRNodePath <- paste(defaultRevoNodePath, "/R-", paste(R.version$major, R.version$minor, sep="."), "/lib64/R", sep="")
    }
}

local(
{
    # set a CRAN mirror
    r <- getOption("repos")
    if (.Platform$OS.type == "unix") {
        options(download.file.method = "curl")
    }
    r["CRAN"] <- RevoUtils::getRevoRepos()
    options(repos=r)

    MRS.is.client <- RevoUtils:::isMicrosoftRClient()
    # set default packages
    # For MicrosoftML, check to see if this is a supported platform (Windows, RHEL/Cent 7, Ubuntu 14.04/16.04)
    isMMLSupported <- FALSE
    if (identical(.Platform$OS.type,"windows")) {
        isMMLSupported <- TRUE
    }
    if (identical(.Platform$OS.type, "unix") && length(grep("Ubuntu",Sys.info()["version"]))){
        if (file.exists("/etc/lsb-release")){
            UbuntuReleaseInfo <- scan("/etc/lsb-release", what="", sep="\n", quiet=TRUE)
            if (identical(UbuntuReleaseInfo[2], "DISTRIB_RELEASE=14.04") || identical(UbuntuReleaseInfo[2], "DISTRIB_RELEASE=16.04")) {
                isMMLSupported <- TRUE
            }
        }
    }
    if ( identical(.Platform$OS.type, "unix") && length(grep("el7.x86_64",Sys.info()["release"]))){
        isMMLSupported <- TRUE
    }

    if (!identical(system.file(package="RevoScaleR") , "")){
        options(defaultPackages=c(getOption("defaultPackages"), "rpart", "lattice", "RevoScaleR", 
            if(!identical(system.file(package="mrsdeploy"), "") && identical(.Platform$OS, "windows")) "mrsdeploy", 
            # we have MicrosoftML package
            if(!identical(system.file(package="MicrosoftML"),"") && isMMLSupported) "MicrosoftML", 
            "RevoMods", "RevoUtils", "RevoUtilsMath"))
        if (nchar(hostName <- Sys.getenv("REVOHADOOPHOST")) && nchar(portNumber <- Sys.getenv("REVOHADOOPPORT")))
        {
             RevoScaleR::rxHdfsConnect(hostName=hostName, portNumber=as.numeric(portNumber))
        }
    } 

    # branding information
    .RevoVersionShort <- Revo.version$version.string
    .RevoVersionShortLen <- regexpr("^.* \\d+\\.\\d+", .RevoVersionShort,  perl=TRUE)
    .RevoVersionShort <- substring(.RevoVersionShort, 1, attributes(.RevoVersionShortLen)$match)
    if ("setWindowTitle" %in% getNamespaceExports("utils")) {
        if (Revo.version$arch=="x86_64") {
            .RevoVersionShort <- paste(.RevoVersionShort, "(64-bit)")
        }
        try(utils::setWindowTitle(paste(" - ", .RevoVersionShort)), silent=TRUE)
    }
    if (.Platform$OS.type == "unix" && capabilities("X11")) {
        browseAvail <- Sys.which(c("firefox", "mozilla", "galeon", "opera", "xdg-open", "kfmclient", "gnome-moze-remote"))
        if (any(browseAvail != "")) {
            options(browser = browseAvail[which(browseAvail != "")[1]])
        }
    }

    if (.Platform$OS.type == "windows" ) { 
       options(help_type="html") 
    } 

    load_if_installed <- function(package) { 
       if (!identical(system.file(package="RevoUtilsMath"), "")) { 
       do.call('library', list(package)) 
       return(TRUE) 
       } else { 
          return(FALSE) 
       }  
    } 

    if (identical(system.file(package="RevoScaleR"), "")) {
        if (load_if_installed("RevoUtilsMath")) {
            ncores <- RevoUtilsMath::getMKLthreads()
        } else {
            MROversion <- paste(Revo.version$major, Revo.version$minor, sep=".")
            MKLmsg <- "No performance acceleration libraries were detected. To take advantage of \nthe available processing power, also install MKL for R Open. Visit \nhttp://go.microsoft.com/fwlink/?LinkID=698301 for more details.\n"
        }

        if (Sys.info()["sysname"] == "Darwin") {
            options(download.file.method = "libcurl") 
            hw.ncpu <- try(system('sysctl hw.physicalcpu', intern = TRUE)) 
            if (!inherits(hw.ncpu, "try-error")) { 
                ncores <- sub("hw.physicalcpu: ", "", hw.ncpu) 
                MKLmsg = paste0("Multithreaded BLAS/LAPACK libraries detected. Using ", ncores, " cores for math algorithms.\n")
            } 
        } else {
            if (load_if_installed("RevoUtilsMath")) {
                ncores <- RevoUtilsMath::getMKLthreads()
                MKLmsg = ""
            } else {
                MROversion <- paste(Revo.version$major, Revo.version$minor, sep=".")
                MKLmsg <- "No performance acceleration libraries were detected. To take advantage of \nthe available processing power, also install MKL for R Open. \n\nVisit http://go.microsoft.com/fwlink/?LinkID=698301 for more details."
            }      
        }
    } else {
        ncores <- RevoUtilsMath::getMKLthreads()
        MKLmsg <- ""
    }

    quiet <- any(match(c("-q", "--silent", "--quiet", "--slave"), commandArgs()), na.rm=TRUE)
    if (!quiet && !identical(system.file(package="RevoScaleR") , "")) {
        cat("Microsoft R Open ",R.version$major,".",R.version$minor,"\n",sep="")
        cat("The enhanced R distribution from Microsoft\n",sep="")
        cat("Microsoft packages Copyright (C)", Revo.version$year, "Microsoft\n\n")
        if (MRS.is.client == FALSE) {
           ScaleRPkgName <- "RevoScaleR"
           pkgVersion <- utils::packageDescription(ScaleRPkgName)$Version
           cat("Loading Microsoft R Server packages, version ", pkgVersion,".\n", sep = "")
        } else {
           RclientPkgName <- "MicrosoftR"
           pkgVersion <- utils::packageDescription(RclientPkgName)$Version
           cat("Loading Microsoft R Client packages, version ", pkgVersion,". \n", sep = "")
           cat("Microsoft R Client limits some functions to available memory.\n") 
           cat("See: https://msdn.microsoft.com/en-us/microsoft-r-client-windows for information\n",sep="")
           cat("about additional features.\n\n",sep="")
        }   
        cat("Type 'readme()' for release notes, privacy() for privacy policy, or\n", sep = "")
        cat("'RevoLicense()' for licensing information.\n\n", sep = "")
        if (MKLmsg == "") {
           cat(paste("Using the Intel MKL for parallel mathematical computing(using", ncores, "cores).\n", sep = " "))
        } else {
           cat(MKLmsg, MROversion, sep = " ")
        }
        cat(paste("Default CRAN mirror snapshot taken on ",repos.date, ".\n",sep=""))
        cat("See: https://mran.microsoft.com/.", "\n\n", sep = "")
        mrupdate::mrCheckForUpdates()
    } else if (!quiet) {
        cat("Microsoft R Open ",R.version$major,".",R.version$minor,"\n",sep="")
        cat("The enhanced R distribution from Microsoft\n",sep="")
        cat("Microsoft packages Copyright (C)", Revo.version$year, "Microsoft Corporation\n\n")
        if (MKLmsg == "") {
           cat(paste("Using the Intel MKL for parallel mathematical computing(using", ncores, "cores).\n", sep = " "))
        } else {
           cat(MKLmsg)
        }
        cat("\nDefault CRAN mirror snapshot taken on ",repos.date, ".", sep = "")
        cat("\n", "See: https://mran.microsoft.com/.",sep="")
        cat("\n\n")
    }   
}
)   

before build error configure: error: Some of the recommended packages are missing

I am trying to compile MRO 3.3.2 on my ubuntu 17 machine.

This pops up at he configure stage before building, but all recommended packages are in their position:

configure: error: Some of the recommended packages are missing
Use --without-recommended-packages if this was intentional

I checked vars.mak and the configure files... .... I am not an expert but all seems ok...

PCRE not support unicode pattern makes jiebaR failed running on MS -r 3.3.1

when using locally installed jiebaR in MS r 3.3.1, met errors below:

> test_worker <- worker('tag')
> test_worker <= '这是一个测试句子。'
Error in grep("(*UCP)^[^⺀- 〡-﹏a-zA-Z0-9]*$", result, perl = TRUE, :
invalid regular expression '(*UCP)^[^⺀- 〡-﹏a-zA-Z0-9]*$'
In addition: Warning message:
In grep("(*UCP)^[^⺀- 〡-﹏a-zA-Z0-9]*$", result, perl = TRUE, :
PCRE pattern compilation error
'this version of PCRE is not compiled with Unicode property support'
at '(*UCP)^[^⺀- 〡-﹏a-zA-Z0-9]*$'

reference from: jiebaR#43

CRAN

PCRE must be built with UTF-8 support (not the default, and checked by @command{configure}) and support for Unicode properties is assumed by some @r{} packages.

https://github.com/wch/r-source/blob/ceeebfaccc10fdf946920cef641d6efbd64bab59/doc/manual/R-admin.texi#L3289-L3302

MRO:

# Handle --enable-unicode-properties
AC_ARG_ENABLE(unicode-properties,
              AS_HELP_STRING([--enable-unicode-properties],
                             [enable Unicode properties support (implies --enable-utf)]),
, enable_unicode_properties=no)

https://github.com/Microsoft/microsoft-r-open/blob/6d2bbb4fc9ed0b6a5212a4694de4c14dd48d25f1/vendor/pcre-8.37/configure.ac#L182-L186

Microsoft R Open *** caught segfault *** address 0x54d8, cause 'memory not mapped'

Running MacBook Pro (Retina, Mid-2002)
Processor: 2.7 GHz Intel Core i7
Memory: 16GB
Graphics: Intel HD Graphics 4000 1536

R Version 3.4.0 GUI 1.69 Mavericks Build
R.app GUI 1.69 (7328 Mavericks build)

Any time I try to start Microsoft R, I get a fatal system error. As the traceback is short, I'll put it in this message. It displays in red, and only gives me options to quit R. Note that I am running "regular" R and RStudio on my Mac as well, and they work fine.

Any hints on resolution are helpful.

*** caught segfault ***
address 0x54d8, cause 'memory not mapped'

Traceback:
1: initMethodDispatch(where)
2: fun(libname, pkgname)
3: doTryCatch(return(expr), name, parentenv, handler)
4: tryCatchOne(expr, names, parentenv, handlers[[1L]])
5: tryCatchList(expr, classes, parentenv, handlers)
6: tryCatch(fun(libname, pkgname), error = identity)
7: runHook(".onLoad", env, package.lib, package)
8: loadNamespace(package, lib.loc)
9: doTryCatch(return(expr), name, parentenv, handler)
10: tryCatchOne(expr, names, parentenv, handlers[[1L]])
11: tryCatchList(expr, classes, parentenv, handlers)
12: tryCatch({ attr(package, "LibPath") <- which.lib.loc ns <- loadNamespace(package, lib.loc) env <- attachNamespace(ns, pos = pos, deps)}, error = function(e) { P <- if (!is.null(cc <- conditionCall(e))) paste(" in", deparse(cc)[1L]) else "" msg <- gettextf("package or namespace load failed for %s%s:\n %s", sQuote(package), P, conditionMessage(e)) if (logical.return) message(paste("Error:", msg), domain = NA) else stop(msg, call. = FALSE, domain = NA)})
13: library(package, lib.loc = lib.loc, character.only = TRUE, logical.return = TRUE, warn.conflicts = warn.conflicts, quietly = quietly)
14: doTryCatch(return(expr), name, parentenv, handler)
15: tryCatchOne(expr, names, parentenv, handlers[[1L]])
16: tryCatchList(expr, classes, parentenv, handlers)
17: tryCatch(library(package, lib.loc = lib.loc, character.only = TRUE, logical.return = TRUE, warn.conflicts = warn.conflicts, quietly = quietly), error = function(e) e)
18: require(pkg, quietly = TRUE, warn.conflicts = FALSE, character.only = TRUE)
19: .OptRequireMethods()

Installation failed on Ubuntu 16.04

I am having the following error message:

Press [Enter] key to display the Microsoft R Open license. When finished reading, press q to continue: 

Do you wish to install the Intel MKL libraries?
Choose [y]es|[n]o y

Press [Enter] key to display the Intel MKL license. When finished reading, press q to continue: 
Do you agree to the terms of the previously displayed license?
Choose [y]es|[n]o y

Updating apt package repositories...done
Installing apt package dependencies libxt6 libsm6 libpango1.0-0 libgomp1 curl...done
Installing /home/yue/Downloads/microsoft-r-open/deb/microsoft-r-open-mro-3.3.deb...done
Installing /home/yue/Downloads/microsoft-r-open/deb/microsoft-r-open-foreachiterators-3.3.deb...done
Installing /home/yue/Downloads/microsoft-r-open/deb/microsoft-r-open-mkl-3.3.deb...ERROR!

There was an error installing Microsoft R Open.
Please check the logs at:
/home/yue/Downloads/microsoft-r-open/logs

And the error log is:

(Reading database ... 228171 files and directories currently installed.)
Preparing to unpack .../microsoft-r-open-mkl-3.3.deb ...
mv: cannot stat ‘/usr/lib64/microsoft-r/3.3/lib64/R/backup/lib/*.so’: No such file or directory
dpkg: warning: subprocess old pre-removal script returned error exit status 1
dpkg: trying script from the new package instead ...
rm: cannot remove ‘/usr/lib64/microsoft-r/3.3/lib64/R/lib/*.so’: No such file or directory
mv: cannot stat ‘/usr/lib64/microsoft-r/3.3/lib64/R/backup/lib/*.so’: No such file or directory
dpkg: error processing archive /home/yue/Downloads/microsoft-r-open/deb/microsoft-r-open-mkl-3.3.deb (--install):
 subprocess new pre-removal script returned error exit status 1
mv: cannot stat ‘/usr/lib64/microsoft-r/3.3/lib64/R/lib/*.so’: No such file or directory
cp: cannot stat ‘/usr/lib64/microsoft-r/3.3/lib64/R/backup/lib/libR.so’: No such file or directory
cp: cannot stat ‘/usr/lib64/microsoft-r/3.3/stage/mkl_install_stage/*.so’: No such file or directory
dpkg: error while cleaning up:
 subprocess installed post-installation script returned error exit status 1
Errors were encountered while processing:
 /home/yue/Downloads/microsoft-r-open/deb/microsoft-r-open-mkl-3.3.deb

if I only install R and skip MKL, i cannot install pakcages in an R session:

> install.packages('microbenchmark')
Installing package into ‘/home/yue/R/3.2’
(as ‘lib’ is unspecified)
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 15405  100 15405    0     0  37000      0 --:--:-- --:--:-- --:--:-- 40539
Error : .onLoad failed in loadNamespace() for 'RevoUtilsMath', details:
  call: fun(libname, pkgname)
  error: To use RevoUtilsMath you must first install the MKL Math Library.
 Visit http://mran.revolutionanalytics.com/download.
 If you have previously installed the MKL Math Library,
remove it and then re-install.
Error: package or namespace load failed for ‘RevoUtilsMath’
Execution halted

The downloaded source packages are in
    ‘/tmp/Rtmp8KvUwc/downloaded_packages’
Warning message:
In install.packages("microbenchmark") :
  installation of package ‘microbenchmark’ had non-zero exit status

Any one can help?

Making MRO work with rpy2

I am trying to use MRO from python using rpy2, and encountering some issues.

First, rpy2 does not find the R libraries out of the box; this can be solved by setting up the environment variables LD_LIBRARY_PATH and R_HOME before installing rpy2

export LD_LIBRARY_PATH=/usr/lib64/microsoft-r/3.3/lib64/R/lib
export R_HOME="/usr/lib64/microsoft-r/3.3/lib64/R"

after doing this, rpy2 installs and run mostly fine (if it was installed before setting the environment libraries, it must be removed and installed again!). Perhaps this should be added to the documentation somewhere?

Secondly, after installing rpy2 I get constant warnings coming from the R side, concerning the RevoUtilsMath pacakge and some getThreads method:

from rpy2 import robjects as ro

/home/javier/anaconda2/lib/python2.7/site-packages/rpy2/rinterface/__init__.py:185: RRuntimeWarning: Warning messages:

  warnings.warn(x, RRuntimeWarning)
/home/javier/anaconda2/lib/python2.7/site-packages/rpy2/rinterface/__init__.py:185: RRuntimeWarning: 1: 
  warnings.warn(x, RRuntimeWarning)
/home/javier/anaconda2/lib/python2.7/site-packages/rpy2/rinterface/__init__.py:185: RRuntimeWarning: In value[[3L]](cond) :
  warnings.warn(x, RRuntimeWarning)
/home/javier/anaconda2/lib/python2.7/site-packages/rpy2/rinterface/__init__.py:185: RRuntimeWarning: 
 
  warnings.warn(x, RRuntimeWarning)
/home/javier/anaconda2/lib/python2.7/site-packages/rpy2/rinterface/__init__.py:185: RRuntimeWarning:  "getThreads" not available for .C() for package "RevoUtilsMath"

  warnings.warn(x, RRuntimeWarning)
/home/javier/anaconda2/lib/python2.7/site-packages/rpy2/rinterface/__init__.py:185: RRuntimeWarning: 2: 
  warnings.warn(x, RRuntimeWarning)
/home/javier/anaconda2/lib/python2.7/site-packages/rpy2/rinterface/__init__.py:185: RRuntimeWarning: 3: 
  warnings.warn(x, RRuntimeWarning)

I don't know if it is related to this warning, but when running long R processes from python they randomly die (from jupyter I just get a Kernel has died message, without any error I can trace back). I am not sure what is causing this, as it seem to happen randomly. I am guessing some race condition, or the multithreaded libraries not playing nice with rpy2.

Any ideas on how I could debug/fix this issue?

'translateCharUTF8' must be called on a CHARSXP Execution halted

Hi,

I installed Microsoft-R-Open 3.4.0 on a Red Hat Linux Enterprise 7.3 machine following the instructions https://mran.microsoft.com/documents/rro/installation/ .
R starts up and seems to be doing fine at first sight. However, when I try to list the files in a directory with the command

files <- list.files(path="/home/username/directory_name/", pattern="*.Rda",, full.names=T, recursive=FALSE)

I get the error

translateCharUTF8' must be called on a CHARSXP
Execution halted

On my local windows machine the command works fine.
Googling this nothing really comes up except that the installation might be broken.

The strange thing is, that if I copy and paste the command into R and execute it, it does not work, but if I copy and paste it into R and change that command in a way that should not change its result but only add spaces or something like that it might run. E.g. changing it to

files <- list.files(path = "/home/username/directory_name/", pattern = "*.Rda",, full.names = T, recursive = FALSE)

might work, might not work and return the same error, or might execute but when I then type "files" that might return

[1]Error: 'getCharCE' must be called on a CHARSXP

Any help would be greatly appreciated,
best wishes
Stefan Braun

read.dbf() unable to open DBF file

Error in read.dbf() : unable to open DBF file

read.dbf() under foreign library doesn´t open DBF File. meanwhile RStudio and RGUI both can open DBF File with same command

I am using Microsoft R Open in Visual Studio Community 2017. with R version 3.3.2 (2016-10-31) -- "Sincere Pumpkin Patch"

Simply don't want to open DBF File or it's a issue?

thanks

Default User Home Personal Library creation in Linux is still prefixed 3.3 for MRO 3.4.0/3.4.1/3.4.2

On Linux , the default library install location proposed/used is still on the subdirectory named "3.3"

Tested under both RPM and Debian based environments.

> install.packages("packagename")                                                                                                
Warning in install.packages("packagename") :
  'lib = "/usr/lib64/microsoft-r/3.4/lib64/R/library"' is not writable
Would you like to use a personal library instead?  (y/n) y
Would you like to create a personal library
~/R/x86_64-pc-linux-gnu-library/3.3
to install packages into?  (y/n) 

For Windows, it is correctly on a "3.4" subdirectory.

~/R/win-library/3.4

Adopt the abandoned AUR packagages & update readme

Hey there,
the packages in the Arch User Repository got abandoned quite some time ago. Maybe one of your developers could maintain them!
Links:
https://aur.archlinux.org/packages/microsoft-r-open/
https://aur.archlinux.org/packages/microsoft-r-open-blas/
https://aur.archlinux.org/packages/microsoft-r-open-blas-systemblas/
https://aur.archlinux.org/packages/revomath/

It would really help people that manage all their packages on Arch based systems with something like octopi and who don't have the experience to manage, pull and compile from github, especially since your Building/Installation chapter in your readme points to the R manual which does not specify patching et cetera. An updated readme would be greatly appreciated.
Packages like microsoft-r-open-blas, microsoft-r-open-blas-systemblas and revomath could use some love, too.

Thank you!

3.4 install failure, can not uninstall MKL

I have been attempting to install the 3.4.0 on my Ubuntu 16.04 system and am having errors mainly tracing back to the MKL package it appears. I can not uninstall as described in the documentation https://mran.microsoft.com/documents/rro/installation/#tab-X1jJ9Wh74-1 , and attempted the piece-wise uninstall like described in #10 and it seems similar to #21 . I can not find a way to uninstall. Any suggestions?

The MKL log reads:
Selecting previously unselected package microsoft-r-open-mkl-3.4. (Reading database ... 230227 files and directories currently installed.) Preparing to unpack .../microsoft-r-open-mkl-3.4.deb ... mv: cannot stat '/usr/lib64/microsoft-r/3.4/lib64/R/backup/lib/*.so': No such file or directory dpkg: warning: subprocess old pre-removal script returned error exit status 1 dpkg: trying script from the new package instead ... rm: cannot remove '/usr/lib64/microsoft-r/3.4/lib64/R/lib/*.so': No such file or directory mv: cannot stat '/usr/lib64/microsoft-r/3.4/lib64/R/backup/lib/*.so': No such file or directory dpkg: error processing archive /home/reed/Downloads/microsoft-r-open/deb/microsoft-r-open-mkl-3.4.deb (--install): subprocess new pre-removal script returned error exit status 1 mv: cannot stat '/usr/lib64/microsoft-r/3.4/lib64/R/lib/*.so': No such file or directory cp: cannot stat '/usr/lib64/microsoft-r/3.4/lib64/R/backup/lib/libR.so': No such file or directory cp: cannot stat '/usr/lib64/microsoft-r/3.4/stage/Linux/bin/x64/*.so': No such file or directory dpkg: error while cleaning up: subprocess installed post-installation script returned error exit status 1 Errors were encountered while processing: /home/reed/Downloads/microsoft-r-open/deb/microsoft-r-open-mkl-3.4.deb

3.3.1 release made jiebaR failed to compile

I met problem listed below when try to install jiebaR package on MS-r 3.3.1, Ubuntu16.04.
Neither CRAN nor devtools::install_github failed with the same error log no matter
which library(personal or system) path chosen.

Key error info:sh: I/usr/lib64/microsoft-r/3.3/lib64/R/include: No such file or directory

I've got in touch with developer of jieba and made sure it is raised by bugs of MS-r 3.3.1.
issue's here: jieba#42

As long as Makevars includes codes below the compiling process will raise error:

PKG_CPPFLAGS =   -I../inst/include 

CXX_STD = CXX11

another same issue raised of this bug: sparseHessianFD

error details:
* installing *source* package ‘jiebaR’ ...

** libs

I/usr/lib64/microsoft-r/3.3/lib64/R/include -DNDEBUG -I../inst/include -DLOGGING_LEVEL=LL_WARNING -DU_STATIC_IMPLEMENTATION -I"/usr/lib64/microsoft-r/3.3/lib64/R/library/Rcpp/include" -c RcppExports.cpp -o RcppExports.o

sh: I/usr/lib64/microsoft-r/3.3/lib64/R/include: No such file or directory

/usr/lib64/microsoft-r/3.3/lib64/R/etc/Makeconf:141: recipe for target 'RcppExports.o' failed

make: [RcppExports.o] Error 127 (ignored)

I/usr/lib64/microsoft-r/3.3/lib64/R/include -DNDEBUG -I../inst/include -DLOGGING_LEVEL=LL_WARNING -DU_STATIC_IMPLEMENTATION -I"/usr/lib64/microsoft-r/3.3/lib64/R/library/Rcpp/include" -c detect.cpp -o detect.o

sh: I/usr/lib64/microsoft-r/3.3/lib64/R/include: No such file or directory

/usr/lib64/microsoft-r/3.3/lib64/R/etc/Makeconf:141: recipe for target 'detect.o' failed

make: [detect.o] Error 127 (ignored)

I/usr/lib64/microsoft-r/3.3/lib64/R/include -DNDEBUG -I../inst/include -DLOGGING_LEVEL=LL_WARNING -DU_STATIC_IMPLEMENTATION -I"/usr/lib64/microsoft-r/3.3/lib64/R/library/Rcpp/include" -c get_idf.cpp -o get_idf.o

sh: I/usr/lib64/microsoft-r/3.3/lib64/R/include: No such file or directory

/usr/lib64/microsoft-r/3.3/lib64/R/etc/Makeconf:141: recipe for target 'get_idf.o' failed

make: [get_idf.o] Error 127 (ignored)

I/usr/lib64/microsoft-r/3.3/lib64/R/include -DNDEBUG -I../inst/include -DLOGGING_LEVEL=LL_WARNING -DU_STATIC_IMPLEMENTATION -I"/usr/lib64/microsoft-r/3.3/lib64/R/library/Rcpp/include" -c get_tuple.cpp -o get_tuple.o

sh: I/usr/lib64/microsoft-r/3.3/lib64/R/include: No such file or directory

/usr/lib64/microsoft-r/3.3/lib64/R/etc/Makeconf:141: recipe for target 'get_tuple.o' failed

make: [get_tuple.o] Error 127 (ignored)

gcc -std=gnu99 -I/usr/lib64/microsoft-r/3.3/lib64/R/include -DNDEBUG -I../inst/include -DLOGGING_LEVEL=LL_WARNING -DU_STATIC_IMPLEMENTATION -I"/usr/lib64/microsoft-r/3.3/lib64/R/library/Rcpp/include" -fpic -DU_STATIC_IMPLEMENTATION -O2 -g -c init.c -o init.o

I/usr/lib64/microsoft-r/3.3/lib64/R/include -DNDEBUG -I../inst/include -DLOGGING_LEVEL=LL_WARNING -DU_STATIC_IMPLEMENTATION -I"/usr/lib64/microsoft-r/3.3/lib64/R/library/Rcpp/include" -c segtype-v4.cpp -o segtype-v4.o

sh: I/usr/lib64/microsoft-r/3.3/lib64/R/include: No such file or directory

/usr/lib64/microsoft-r/3.3/lib64/R/etc/Makeconf:141: recipe for target 'segtype-v4.o' failed

make: [segtype-v4.o] Error 127 (ignored)

I/usr/lib64/microsoft-r/3.3/lib64/R/include -DNDEBUG -I../inst/include -DLOGGING_LEVEL=LL_WARNING -DU_STATIC_IMPLEMENTATION -I"/usr/lib64/microsoft-r/3.3/lib64/R/library/Rcpp/include" -c util.cpp -o util.o

sh: I/usr/lib64/microsoft-r/3.3/lib64/R/include: No such file or directory

/usr/lib64/microsoft-r/3.3/lib64/R/etc/Makeconf:141: recipe for target 'util.o' failed

make: [util.o] Error 127 (ignored)

I/usr/lib64/microsoft-r/3.3/lib64/R/include -DNDEBUG -I../inst/include -DLOGGING_LEVEL=LL_WARNING -DU_STATIC_IMPLEMENTATION -I"/usr/lib64/microsoft-r/3.3/lib64/R/library/Rcpp/include" -c word_freq.cpp -o word_freq.o

sh: I/usr/lib64/microsoft-r/3.3/lib64/R/include: No such file or directory

/usr/lib64/microsoft-r/3.3/lib64/R/etc/Makeconf:141: recipe for target 'word_freq.o' failed make: [word_freq.o] Error 127 (ignored)

-shared -L/usr/lib64/microsoft-r/3.3/lib64/R/lib -o jiebaR.so RcppExports.o detect.o get_idf.o get_tuple.o init.o segtype-v4.o util.o word_freq.o -L/usr/lib64/microsoft-r/3.3/lib64/R/lib -lR

sh: line 2: -shared: command not found

/usr/lib64/microsoft-r/3.3/lib64/R/share/make/shlib.mk:6: recipe for target 'jiebaR.so' failed

make: *** [jiebaR.so] Error 127

ERROR: compilation failed for package ‘jiebaR’

* removing ‘/home/da/R/x86_64-pc-linux-gnu-library/3.3/jiebaR’

Error: Command failed (1)

session_Info():
Session info ------------------------------------------------------------------------------------------------------------------
setting value
version R version 3.3.1 (2016-06-21)
system x86_64, linux-gnu
ui RStudio (0.99.902)
language (EN)
collate zh_CN.UTF-8
tz PRC
date 2016-10-26

Packages ----------------------------------------------------------------------------------------------------------------------
package * version date source
colorspace 1.2-6 2015-03-11 CRAN (R 3.3.0)
devtools * 1.12.0 2016-06-24 CRAN (R 3.3.1)
digest 0.6.9 2016-01-08 CRAN (R 3.2.5)
ggplot2 2.1.0 2016-03-01 CRAN (R 3.3.0)
gtable 0.2.0 2016-02-26 CRAN (R 3.3.0)
memoise 1.0.0 2016-01-29 CRAN (R 3.2.5)
munsell 0.4.3 2016-02-13 CRAN (R 3.3.0)
plyr 1.8.4 2016-06-08 CRAN (R 3.3.1)
Rcpp 0.12.5 2016-05-14 CRAN (R 3.3.0)
RevoUtils 10.0.1 2016-08-24 local
RevoUtilsMath * 10.0.0 2016-06-15 local
scales 0.4.0 2016-02-26 CRAN (R 3.3.0)
withr 1.0.2 2016-06-20 CRAN (R 3.3.1)

sessionInfo():
R version 3.3.1 (2016-06-21)
Platform: x86_64-pc-linux-gnu (64-bit)
Running under: Ubuntu 16.04.1 LTS

locale:
[1] LC_CTYPE=en_US.UTF-8 LC_NUMERIC=C LC_TIME=zh_CN.UTF-8 LC_COLLATE=zh_CN.UTF-8
[5] LC_MONETARY=zh_CN.UTF-8 LC_MESSAGES=en_US.UTF-8 LC_PAPER=zh_CN.UTF-8 LC_NAME=C
[9] LC_ADDRESS=C LC_TELEPHONE=C LC_MEASUREMENT=zh_CN.UTF-8 LC_IDENTIFICATION=C

attached base packages:
[1] stats graphics grDevices utils datasets methods base

other attached packages:
[1] devtools_1.12.0 RevoUtilsMath_10.0.0

loaded via a namespace (and not attached):
[1] colorspace_1.2-6 scales_0.4.0 plyr_1.8.4 RevoUtils_10.0.1 tools_3.3.1 withr_1.0.2 gtable_0.2.0
[8] rstudioapi_0.6 memoise_1.0.0 Rcpp_0.12.5 ggplot2_2.1.0 grid_3.3.1 digest_0.6.9 munsell_0.4.3

gcc edition: 5.4.0 20160609

Why does the R-Open 3.4.1 installer remove prior versions?

@nicholaelaw brought this up in #40, but I felt like it should have it's own issue.

I know I had a working environment with the loaded packages and the packages I built myself in 3.4.0. Now if something fails to work in 3.4.1, I no longer have the option to quickly switch back to 3.4.0.

Help us understand why this is necessary or please consider adding an option to the installer to not remove prior installations.

Thanks,

3.4.1 installation fails if other versions of MRO exist

Just ran into a strange problem here. The 3.4.1 installer fails when the installation is almost finished. Looking through the logs reveals that the installer encountered an error when trying to remove a previous MRO installation. But at this point, the 3.4.1 is already installed and usable, while the previous version has already been removed.

Removing previous installation(s) manually before commencing produces no error.

The previous versions mentioned above are MRO 3.3.3 and MRO 3.4.0. Which leads to my other question: why would MRO start messing with previous versions? Shouldn't it just leave them as they are, instead of trying to 'upgrade' an older version?

Logs attached:
MRO_3.4.1_20170914093034.zip

MRO 3.4.2/3.4.3 R binary was not built as a shared library

rApache cannot be compiled with current MRO 3.4.2 release. It indicates "R was not built as a shared library"
Is MRO 3.4.2 release compiled with "--enable-R-shlib" ?

checking for unistd.h... (cached) yes
checking for stdlib.h... (cached) yes
checking for uname... /usr/bin/uname
checking for --with-apxs... no
checking for apxs... /usr/bin/apxs
checking for R... /usr/bin/R


R was not built as a shared library

Either build it with one, or use another install of R

configure: error: aborting! 

Installation complete, but fail to start R

I previously installed MRO with MKL on my Ubuntu 17.04. I then removed it, and now I wanted to install it again. I encounter the problem in the previously-reported issue: #21 , but I could then install by force-removing the previous installation and removing the folder /usr/lib64/microsoft-r/3.4. So, then the installation went without any trouble, but when I try to start R, I get:

R version 3.4.0 (2017-04-21) -- "You Stupid Darkness"
Copyright (C) 2017 The R Foundation for Statistical Computing
Platform: x86_64-pc-linux-gnu (64-bit)
....
caught segfault ***
address 0x38, cause 'memory not mapped'

Traceback:

 1: dyn.load(libPath)
 2: doTryCatch(return(expr), name, parentenv, handler)
 3: tryCatchOne(expr, names, parentenv, handlers[[1L]])
 4: tryCatchList(expr, classes, parentenv, handlers)
...
(long messages)
...
Possible actions:
1: abort (with core dump, if enabled)
2: normal R exit
3: exit R without saving workspace
4: exit R saving workspace
Selection: 2

Removing and reinstalling doesn't help. Any advice?

Improved instructions for installation from source on Linux? (or alternately a non-root installation script)

Since I am a non-root user, I can't use the provided installation scripts, I have been trying to install Microsoft-R-Open from source.

Are there more instructions for building Microsoft-R-Open from source that are more detailed than the following README.md file? It seems to help, but I'm still not sure what to do with the vendor directory and how I'm supposed to install the curl or the RODBC packages in the "additionalPackages" directory.

Microsoft R Open

This is the repository containing the source code for the open source components of Microsoft R Open.

Directory Structure

/additionalPackages -> GPLv2 licensed R packages not part of the R source
/patch -> Patches made to the R source code when building Microsoft R Open
/source -> CRAN R source code
/vendor -> Libraries needed to build Microsoft R Open

Building

Please see the R Installation and Administration Guide for instructions on building the R source. Patches can be applied using GNU Patch.

The additional Microsoft authored packages can be built and installed using R CMD INSTALL after the R source has been built.

I've tried to build it from source. Below are the details. I left out the "dead ends" and only include what seemed to work, except that I have also included the errors I am getting for "curl" and "RODBC":

wget https://mran.blob.core.windows.net/install/mro/3.4.3/microsoft-r-open-MRO-3.4.3.tar.gz
tar xvf microsoft-r-open-MRO-3.4.3.tar.gz
cd microsoft-r-open-MRO-3.4.3/
patch -p0 < patch/relocatable-r.patch
cd source/

./configure --without-recommended-packages  --enable-R-shlib
make

export PATH=/path/to/microsoft-r-open/microsoft-r-open-MRO-3.4.3/bin:$PATH

R
> install.packages('foreach')
>q()

cd ../additionalPackages
R CMD INSTALL RUnit
R CMD INSTALL R6
R CMD INSTALL doParallel
R CMD INSTALL checkpoint

cd deployr-rserve/

cd Rserve
chmod a+x configure
cd ..
R CMD INSTALL Rserve
cd ..
R CMD INSTALL png
R CMD INSTALL jsonlite
R CMD INSTALL RevoIOQ

R
> install.packages('rpart')
> q()

R CMD INSTALL RevoMods
R CMD INSTALL RevoUtils

R CMD INSTALL RODBC
* installing to library ‘/path/to/microsoft-r-open/microsoft-r-open-MRO-3.4.3/lib64/R/library’
* installing *source* package ‘RODBC’ ...
file ‘build/vignette.rds’ is missing
files ‘tests/DB2.Rout.save’, ‘tests/Oracle.Rout.save’, ‘tests/SQLServer.Rout.save’, ‘tests/access.Rout.save’, ‘tests/excel.Rout.save’, ‘tests/mimer.Rout.save’, ‘tests/mysql-win.Rout.save’ have the wrong MD5 checksums
ERROR: 'configure' exists but is not executable -- see the 'R Installation and Administration Manual'
* removing ‘/path/to/microsoft-r-open/microsoft-r-open-MRO-3.4.3/lib64/R/library/RODBC’

configure: error: "ODBC headers sql.h and sqlext.h not found"
ERROR: configuration failed for package ‘RODBC’

R 
>install.packages('curl')
>q()

R CMD INSTALL curl
Error in (function() { :
  Failed to find 'tools/option_table.txt' from:/path/to/microsoft-r-open/microsoft-r-open-MRO-3.4.3-src/additionalPackages/curl
Error : unable to load R code in package ‘curl’
ERROR: lazy loading failed for package ‘curl’
* removing ‘/path/to/microsoft-r-open/microsoft-r-open-MRO-3.4.3/lib64/R/library/curl’
* restoring previous ‘/path/to/microsoft-r-open/microsoft-r-open-MRO-3.4.3/lib64/R/library/curl’

Installation

Can I install Microsoft Open R on a Sony Vaio machine? The processor is i5-3337U CPU.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.