Skip to content

Install ML Prerequisites

natedogs911 edited this page Apr 21, 2016 · 1 revision

Building or installing prerequisites should be done in a directory created under the /home/solution-user/ directory. It is recommended to create a temporary folder called “src” so that it can be deleted easily after successful validation.

Note: Building from source should be done ONLY on an Edge node, not on a DataNode!

mkdir src
cd src

A development version of MPI will be required on the machine where you build the source code; only a runtime engine is required on the nodes in the ML pipeline. The solution has been tested on MPICH 3.1.4 mpi and the Intel MPI Library 5.1 intel-mpi. Please refer to the specific release documentation for full installation steps.

Install MPICH 3.1.4

#Pre-requisites
sudo yum -y groupinstall "Development Tools"

#create directories, be sure to keep the src in the mpich-install path
mkdir -p /home/oni/mpich-install/src
mkdir -p /home/oni/src/tmp/mpich-3.1.4
cd /home/oni/mpich-install/src
wget http://www.mpich.org/static/downloads/3.1.4/mpich-3.1.4.tar.gz
tar xvf mpich-3.1.4.tar.gz

#continued on next page
cd /home/oni/src/tmp/mpich-3.1.4/
/home/oni/mpich-install/src/mpich-3.1.4/configure -prefix=/home/oni/mpich-install/ |& tee c.txt
make |& tee m.txt
make install |& tee mi.txt
#TBD creat path variables and sh
  • Home
  • [Overview of Open Network Insight](Overview of Open Network Insight)
    • [Technical Overview](Technical Overview)
  • [Planning Guide](Planning Guide)
    • [Deployment Option 1: Pure Hadoop](Pure Hadoop)
    • [Deployment Option 2: Hybrid Hadoop / Virtual](Hybrid Hadoop)
  • Development Guide
  • [Deployment Guide](Deployment Guide)
  • [Installation Guide](Installation Guide)
    • Step 0: Initial Configuration
      • [Configure User Accounts](Configure User Accounts)
      • [Edit Solution Configuration](Edit Solution Configuration).
      • [Setup HDFS](Setup HDFS)
    • Step 1: Ingest Component Installation
      • [Install Prerequisites](Install Ingest Prerequisites)
      • [Install and Configure Ingest](Install and Configure Ingest)
      • [Validate](Validate ingest)
    • Step 2: Machine Learning
      • [Install Prerequisites](Install ML Prerequisites).
      • [Install and Configure ML](Install and Configure ML)
      • [Validate](Validate ML)
    • Step 3: Operational Analytics Component Installation
      • [Install Prerequisites](Install OA Prerequisites).
      • [Install OA solution](Install OA Solution)
      • [Validate](Validate OA)
  • [User Guide](User Guide)
    • [Suspicious Connects – Analyst View](Suspicious Connects)
    • [Threat Investigation – Analyst View](Threat Investigation)
    • [Ingest Summary – Analyst View](Ingest Summary)

Clone this wiki locally