...
The following are the specs for the Hadoop related nodes:
- All cluster nodes must be running CentOS 6.x.
- The cluster must be an running HDP 2.4 managed by Ambari 2.2.x.X
At a minimum, there needs to be at least 2 Hadoop Master nodes and 4 Hadoop slave nodes.
- The minimum spec for each of the Hadoop Slave and Master nodes should be (for Dev/Test/POC envs):
- 8-16 GB RAM
- 4 cores
- 100 GB of storage
- The following services must be installed across the Hadoop Master and Slave nodes:
Each of the following components must be installed on at least 4 Hadoop Slave Nodes.
- No other workloads should be running on the cluster. In other words, this cluster should be dedicated for Metron jobs.
Specs for Metron Nodes
- At least 3 nodes must be dedicated for Metron-specific components.
- You should have root access on all Metron nodes.
All Metron nodes (Search, Probes, and Web) must have the following:
- Centos 6.7
- Oracle JDK 1.8
- The minimum spec for each of the Metron nodes should be (for Dev/Test/POC envs):
- 8-16 GB RAM
- 4 cores
- 100 GB of storage
The Metron Installer node must have Docker installed (Note: if If using Centos, 7.x is preferred for the Metron Installer node)
The Metron Installer node requires SSH access to all Hadoop Cluster and Metron nodes. Passwordless is preferred.
...