You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 11 Next »

Metrics Collector

Configuration Items

Configuration TypeFile pathComment
ams-site/etc/ambari-metrics-collector/conf/ams-site.xmlSettings that control the API daemon and the aggregator threads.
ams-env/etc/ambari-metrics-collector/conf/ams-env.shMemory / PATH settings for the API daemon
ams-hbase-site

/etc/ams-hbase/conf/hbase-site.xml

/etc/ambari-metrics-collector/conf/hbase-site.xml

Settings for the HBase storage used for the metrics data.
ams-hbase-env/etc/ams-hbase/conf/hbase-env.sh

Memory / PATH settings for the HBase storage.

Note: In embedded more, the heap memory setting for master and regionserver is summed up as total memory for single HBase daemon.

Pid file locations

DaemonDefault userPid file path
Metrics Collector APIams/var/run/ambari-metrics-collector/ambari-metrics-collector.pid
Metrics Collector Hbaseams/var/run/ambari-metrics-collector/hbase-ams-master.pid

 

Log file locations

DaemonLog file path
Metrics Collector API

/var/log/ambari-metrics-collector/ambari-metrics-collector.log

/var/log/ambari-metrics-collector/ambari-metrics-collector.out

Metrics Collector HBase

/var/log/ambari-metrics-collector/hbase-ams-master-<hostname>.log

/var/log/ambari-metrics-collector/hbase-ams-master-<hostname>.out

Metrics Monitor

Configuration TypeFile pathComment
ams-env/etc/ambari-metrics-monitor/conf/ams-env.shUsed for log and pid dir modifications, this is the same configuration as above, common to both components.
metric_groups/etc/ambari-metrics-monitor/conf/metric_groups.confNot available in the UI. Used to control what HOST/SYSTEM metrics are reported.
metric_monitor/etc/ambari-metrics-monitor/conf/metric_monitor.iniNot available in the UI. Settings for the monitor daemon.

Pid File location

/var/run/ambari-metrics-monitor/ambari-metrics-monitor.pid

Log File location

/var/log/ambari-metrics-monitor/ambari-metrics-monitor.out

Configuring Ambari Metrics service in distributed mode

In distributed mode, Metric Collector writes go to HDFS of the cluster. Currently distributed mode does not support multi-mode Metric Collector, however the plan is to allow Metric Collector to scale horizontally to allow a multi-node HBase storage layer.

Following steps need to be performed either at install time or after deploy to configure Metric Collector in distributed mode. Note: If configuring after install, the data will not be automatically copied over to HDFS.

  1. Edit ams-site, Set timeline.metrics.service.operation.mode = distributed
  2. Edit ams-hbase-site,
    1. Set hbase.rootdir = hdfs://<namenode-host>:8020/amshbase (Note: amshbase here is the directory where metric data will be stored in HDFS)
    2. Set hbase.cluster.distributed = true
  3. Restart Metrics Collector

Note: In Ambari 2.0, there is a bug in deploying AMS in distributed mode, if Namenode HA is enabled. Please follow the instruction listed in this JIRA as workaround steps: (AMBARI-10707)

  • No labels