Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The following are the specs for the Hadoop related nodes:

  1. All cluster nodes must be running CentOS 6.x.
  2. The cluster must be an running HDP 2.4 managed by Ambari 2.2.x.X
  3. At a minimum, there needs to be at least 2 Hadoop Master nodes and 4 Hadoop slave nodes.

  4. The minimum spec for each of the Hadoop Slave and Master nodes should be (for Dev/Test/POC envs):
    1. 8-16 GB RAM
    2. 4 cores
    3. 100 GB of storage
  5. The following services must be installed across the Hadoop Master and Slave nodes:

  6. Each of the following components must be installed on at least 4 Hadoop Slave Nodes.

  7. No other workloads should be running on the cluster. In other words, this cluster should be dedicated for Metron jobs.

 

Specs for Metron Nodes

  1. At least 3 nodes must be dedicated for Metron-specific components.
  2. You should have root access on all Metron nodes.
  3. All Metron nodes (Search, Probes, and Web) must have the following:

    1. Centos 6.7
    2. Oracle JDK 1.8
  4. The minimum spec for each of the Metron nodes should be (for Dev/Test/POC envs):
    1. 8-16 GB RAM
    2. 4 cores
    3. 100 GB of storage
  5. The Metron Installer node must have Docker installed (Note: if If using Centos, 7.x is preferred for the Metron Installer node)

  6. The Metron Installer node requires SSH access to all Hadoop Cluster and Metron nodes. Passwordless is preferred.

...