Introduction
Application "TOPOLOGY HEALTH CHECK" provide embedded collector script to ingest hadoop/hbase jmx metric as eagle stream and provide ability to define alert policy and detect anomaly in real-time from metric.
Type | TOPOLOGY_HEALTH_CHECK |
---|---|
Version | 0.5.0-version |
Description | Collect MR,HBASE,HDFS node status and cluster ratio |
Streams | TOPOLOGY_HEALTH_CHECK_STREAM |
Configuration |
|
Setup & Installation
- Make sure already setup a site (here use a demo site named "sandbox")
- Install "Hadoop JMX Monitor" app in eagle server
- Configure Application settings
- Ensure a kafka topic named
topology_health_check (In current guide, it should be
topology_health_check
) - Setup metric collector for monitored Hadoop/HBase using hadoop_jmx_collector and modify the configuration
- Collector scripts: https://github.com/apache/incubator-eagle/tree/master/eagle-external/hadoop_jmx_collector
Rename config-sample.json to config.json: https://github.com/apache/incubator-eagle/blob/master/eagle-external/hadoop_jmx_collector/config-sample.json
- Click "Install" button then you will see the
TOPOLOGY_HEALTH_CHECK_STREAM_{SITE_ID}
in Streams
Usage
Define Health Check Alert Policy
- Go to "Define Policy"
- Select TOPOLOGY_HEALTH_CHECK related streams
Define SQL-Like policy, for example
from TOPOLOGY_HEALTH_CHECK_STREAM_SANDBOX[status=='dead'] select * insert into topology_health_check_stream_out;