Roadmap

• Declarative Policy
• Eagle API

1. Support user defined policy repository
   1. Community Policy Templates
2. Real time metrics aggregation over different dimensions (Time, Spatial) Design
   1. Example: Average memory used by NameNode process per minute.
3. Support Declarative topologies
   1. User can specify a particular source of metrics, values, threshold, aggregation parameters.
4. Extensible notification

1. Policy State Management
   1. Support policy over a long window.
2. Fully declarative topologies
   1. Declarative policies, source, notification.
3. Eagle deployment management

EIV and DE models:

• HDFS User profiles

1. Hadoop System Monitoring Design
   1. Master node monitoring (Eagle monitors the health of master nodes in a hadoop cluster by aggregating metrics from different data sources).
   2. Namenode health
   3. Resource manager health
   4. Hbase master health
2. Spark application monitoring
   1. Monitor spark applications for memory

Security Monitoring

Supported Hadoop data Sources:

• HDFS Audit Log
• Hive Query Log (YARN api)
• Hbase audit log
• Hadoop Secure log
• Eagle Web Application

1. Splunk Integration
2. Dataguise Integration
3. Community policy templates
4. Ranger Integration for remediation