THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
IMPORTANT: Some of the values specified in this article need to be substituted with your info, like IP addresses and hostnames. Such values are enclosed with brackers <like that>. Please make sure replace them with your info.
Prerequisites:
Centos 6
In order to ease install make sure that your main interface is named eth0. If it is not, you need to adjust some Ambari services configuration accordingly (e.g. ElasticSearch)
Single-node: At least 48 GB RAM, 8 cores and 400 GB HDD. Multi-node: At least 32 GB RAM, 4 cores and 200 GB HDD for smooth performance.
(optional) Disable PackageKit if it is installed, if it is not, just ignore this point:
Code Block sed -i 's/enabled=1/enabled=0/g' /etc/yum/pluginconf.d/refresh-packagekit.conf
...
Disable Transparent Hugepage. Add "transparent_hugepage=never" to the end of the kernel line in grub.conf and reboot. (Ambari demands it, do we need to comply?):
Code Block transparent_hugepage=never
After reboot check that changes were applied (make sure that word "never" is selected in square-brackets):
Code Block # cat /sys/kernel/mm/transparent_hugepage/enabled always madvise [never]
Metron install pre-preparation
On all nodes Install pre-requisites for Ambari:
| Code Block |
|---|
yum install epel-release -y
yum update -y
yum install git wget curl rpm scp tar unzip bzip2 wget createrepo reposync yum-utils ntp python-pip -y |
...
| Code Block |
|---|
yum install docker-io -y service docker start |
Also on your build box, install npm (needed to build metron-config, part of the UI):
| Code Block |
|---|
yum install npm -y |
Build Metron code:
On main node clone Metron repository:
...
| Code Block |
|---|
ssh-copy-id -i ~/.ssh/id_rsa.pub <replace_with_node_ip> |
Ambari 2.4 with HDP 2.5 install
Inspired by: http://docs.hortonworks.com/HDPDocuments/Ambari-2.4.1.0/bk_ambari-installation/content/ch_Getting_Ready.html
...
| Code Block |
|---|
wget -nv http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.4.13.0/ambari.repo -O /etc/yum.repos.d/ambari.repo |
...
Set rest of the configuration values to recommended by Ambari or the one you desire (like DB passwords) and perform install.
After install configuration
Fix ElasticSearch permission (it will crash right after start in Ambari) (unless it is already fixed as reported in METRON-642):
...
It is ok if some service will not able to start, check the errors and start them all manually.
TROUBLESHOOTING
Ignore the error Storm UI shown on the screenshot below if you've built your Metron code with HDP-2.5.0.0 profile (in Maven):
...