Versions Compared

Old Version 1

changes.mady.by.user Siddharth Wagle

Saved on

compared with

New Version 2

changes.mady.by.user Siddharth Wagle

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Following image depicts the high level conceptual architecture of the new Ambari Metrics System.

 


























Key design points in the conceptual architecture:

  • Metrics collector is daemon that receives data from registered publishers and provides ability to push the metrics data to an external metric storage like OpenTSDB or HDFS along with pushing data to a local metrics store.

  • Additionally, the metrics collector provides ability to plugin aggregators for the collected metric data and streams data to the aggregation layer in real-time. 

  • The current system implementation does a post-write aggregation and does not require live streaming of the data to the aggregation layer.

  • Ambari Views on top of Phoenix provide ad-hoc query capability to the user along with a View to replace Ganglia Webcustomized views for deployed services.

  • The API design for the Metrics Service should support supports GET and POST API using key and time range similar what exists on the HBASE cluster. No SQL support required since Phoenix can be used through a View.