(Work in progress)
Ambari Metrics System - Architecture
Following image depicts the high level conceptual architecture of the new Ambari Metrics System.
Key design points in the conceptual architecture:
Metrics collector is daemon that receives data from registered publishers and provides ability to push the metrics data to an external metric storage like OpenTSDB or HDFS along with pushing data to a local metrics store.
Additionally, the metrics collector provides ability to plugin aggregators for the collected metric data and streams data to the aggregation layer in real-time.
The current system implementation does a post-write aggregation and does not require live streaming of the data to the aggregation layer.
Ambari Views on top of Phoenix provide ad-hoc query capability to the user along with a customized views for deployed services.
- The API design for the Metrics Service supports GET and POST API using key and time range similar what exists on the HBASE cluster.