Overview

Ambari SCOM extends the functionality of Microsoft System Center Operations Manager to monitor Apache Hadoop clusters, and leverages Ambari (and the Ambari REST API) to obtain Hadoop metrics. The Ambari SCOM Management Pack will:

  • Automatically discover all nodes within a Hadoop cluster(s).
  • Proactively monitor the availability and capacity.
  • Proactively notify when the health is critical.
  • Intuitively and efficiently visualize the health of Hadoop cluster via dashboards

Architecture

Ambari SCOM is made up of the following components:

Component

Description

Ambari SCOM Management Pack

The Ambari SCOM Management Pack extends the functional of Microsoft System Center Operations Manager to monitor Hadoop clusters.

Ambari SCOM Server

The Ambari SCOM Server component connects to the Hadoop cluster components and exposes a REST API for the Ambari SCOM Management Pack.

ResourceProvider

An Ambari ResourceProvider is a pluggable interface in Ambari enables the customization of the Ambari SCOM Server.

ClusterLayout ResourceProvider

An Ambari ResourceProvider implementation that supplies information on cluster layout (i.e. where Hadoop master and slave components are installed) to the Ambari SCOM Server. This allows Ambari to know how and where to access components of the Hadoop cluster.

Property ResourceProvider

An Ambari ResourceProvider implementation that integrates with the SQL Server database instance for retrieving stored Hadoop metrics.

SQL Server

A SQL Server instance that stores the metrics emitted from Hadoop via the SqlServerSink and the Hadoop Metrics2 interface.

SqlServerSink

This is a Hadoop Metrics2 sink designed to consume metrics emitted from the Hadoop cluster. Ambari SCOM provides a SQL Server implementation.

  • No labels