Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
 Current ReleaseQ1 2016Q2 2016
Eagle Framework
  • Declarative Policy
  • Eagle API
  1. Support user defined policy repository
    1. Community Policy Templates
  2. Real time metrics aggregation over different dimensions (Time, Spatial)
    1. Example: Average memory used by NameNode process per minute.
  3. Support Declarative topologies
    1. User can specify a particular source of metrics, values, threshold, aggregation parameters.
  4. Extensible notification
 
Machine Learning

EIV and DE models:

  • HDFS User profiles

 

  
System MonitoringNone
  1. Hadoop System Monitoring Design
    1. Master node monitoring (Eagle monitors the health of master nodes in a hadoop cluster by aggregating metrics from different data sources).
    2. Namenode health
    3. Resource manager health
    4. Hbase master health
  2. Spark application monitoring
    1. Monitor spark applications for memory
 

Security Monitoring

 

Supported Hadoop data Sources:

  • HDFS Audit Log
  • Hive Query Log (YARN api)
  • Hbase audit log
  • Hadoop Secure log
  • Eagle Web Application
  1. Splunk Integration
  2. Dataguise Integration
  3. Community policy templates
 

...