Machine Learning Library (MLlib) - Spark 1.1.0 Documentation

Machine Learning Library (MLlib) - Spark 1.1.0 Documentation

Experimental DeveloperApi may change in future releases, and the migration guide below will explain all changes between releases. Dependencies MLlib uses the linear algebra package Breeze , which depends on netlib-java , and jblas . netlib-java and jblas depend on native Fortran routines. You need to install the gfortran runtime library if it is not already present on your nodes. MLlib will throw a linking error if it cannot detect these libraries automatically. Due to license issues, we do not include netlib-java 's native libraries in MLlib's dependency set under default settings. If no native library is available at runtime, you will see a warning message. To use native libraries from netlib-java com.github.fommil.netlib:all:1.1.2 as a dependency of your project. If you want to use optimized BLAS/LAPACK libraries such as OpenBLAS , please link its shared libraries to /usr/lib/libblas.so.3 and /usr/lib/liblapack.so.3 , respectively.

Read full article from Machine Learning Library (MLlib) - Spark 1.1.0 Documentation