This section describes the following:
- Prerequisite Software
- Installation Methods
- Package Contents
- Manual Installation
- MSI Installation
- Installing Ambari SCOM Management Pack
Prerequisite Software
Setting up Ambari SCOM assumes the following prerequisite software:
- Apache Hadoop cluster (HDFS and MapReduce) 1.2.0 or later 1
- JDK 1.6
- Microsoft System Center Operations Manager (SCOM) 2012
- Microsoft SQL Server 2012
- Microsoft JDBC Driver 4.0 for SQL Server 2
1 Note: Ambari SCOM has been tested with a Hadoop cluster based on Hortonworks Data Platform 1.3 for Windows
2 Note: Obtain the Microsoft JDBC Driver 4.0 for SQL Server JAR file (sqljdbc4.jar
) at http://technet.microsoft.com/en-us/library/ms378749.aspx
Installation Methods
The following methods are available for installing Ambari SCOM:
- Manual Installation - This installation method requires you to configure the SQL Server database, setup the Ambari SCOM Server and configure the Hadoop Metrics Sink. This optional provides the most flexible install option based on your environment. See Manual Installation for more information.
- MSI Installation - This installation method install the Ambari SCOM Server and configures the Hadoop Metrics Sink automatically using an MSI Installer. After launching the MSI, you provide information about your SQL Server database and the cluster for the installer to handle configuration. See MSI Installation for more information.
Package Contents
├─ ambari-scom-x.y.z
├── README.md
├── LICENSE
├── NOTICE
├── server.zip
├── metrics-sink.zip
├── ambari-scom.msi
└── mp.zip
File |
Name |
Description |
---|---|---|
|
Server Bundle |
Contains the required software for manually configuring the Ambari SCOM Server software. |
|
Metrics Sink Bundle |
Contains the required software for manually configuring SQL Server and the Hadoop Metrics Sink. |
|
MSI Installer |
The Ambari SCOM MSI Installer for configuring the Ambari SCOM Server and Hadoop Metrics Sink |
|
Management Pack Bundle |
Contains the Ambari SCOM Management Pack software. |
Manual Installation
Configuring SQL Server
- Configure you SQL Server instance for "mixed mode" authentication.
- Confirm SQL Server is installed with TCP/IP active and enabled. (default port: 1433)
- Create a user and password. Remember this user and password as this will be the account used by the Hadoop metrics interface for capturing metrics. (default user: sa)
- Extract the contents of the
metrics-sink.zip
package. - Create the Ambari SCOM database schema by running the
Hadoop-Metrics-SQLServer-CREATE.ddl
script.
The Hadoop Metrics DDL script will create a database called "HadoopMetrics". Edit the DDL before running if you would like to change the database name.
Configuring Hadoop Metrics Sink
Preparing the Metrics Sink
- Extract the contents of the
metrics-sink.zip
package to obtain themetrics-sink.jar
file. - Obtain the Microsoft JDBC Driver 4.0 for SQL Server
sqljdbc4.jar
file. - Copy
sqljdbc4.jar
andmetrics-sink.jar
to each host in the cluster.
Setup Hadoop Metrics2 Interface
- On each host in the cluster, setup the Hadoop metrics2 interface to use the
SQLServerSink
. - Edit the
hadoop-metrics2.properties
file:*.sink.sql.class=org.apache.hadoop.metrics2.sink.SqlServerSink namenode.sink.sql.databaseUrl=jdbc:sqlserver://[server]:[port];databaseName=[databaseName];user=[user];password=[password] datanode.sink.sql.databaseUrl=jdbc:sqlserver://[server]:[port];databaseName=[databaseName];user=[user];password=[password] jobtracker.sink.sql.databaseUrl=jdbc:sqlserver://[server]:[port];databaseName=[databaseName];user=[user];password=[password] tasktracker.sink.sql.databaseUrl=jdbc:sqlserver://[server]:[port];databaseName=[databaseName];user=[user];password=[password] maptask.sink.sql.databaseUrl=jdbc:sqlserver://[server]:[port];databaseName=[databaseName];user=[user];password=[password] reducetask.sink.sql.databaseUrl=jdbc:sqlserver://[server]:[port];databaseName=[databaseName];user=[user];password=[password]
where server = SQL Server hostname port = the SQL Server port (for example, 1433) databaseName = the SQL Server database (for example, HadoopMetrics) user = the SQL Server user (for example, sa) password = the SQL Server user (for example, BigData1)
- Set the Hadoop classpath to include the JAR files.
- Restart Hadoop for these changes to take affect.
Verify Metrics Collection
- Confirm metrics are being captured in the SQL Server database by querying the
MetricRecord
table:select * from HadoopMetrics.dbo.MetricRecord
In the above SQL statement,
HadoopMetrics
is the database name.
Installing and Configuring Ambari SCOM Server
Unpacking the Server
TBD
Running the Server
TBD
Verify the Server API
- From a browser access the API
http://[server]:8080/api/v1/clusters
- Verify that metrics are being reported.
http://[server]:8080/api/v1/clusters/ambari/services/HDFS/components/NAMENODE
MSI Installation
Configuring SQL Server
- Configure you SQL Server instance for "mixed mode" authentication.
- Confirm SQL Server is installed with TCP/IP active and enabled. (default port: 1433)
- Create a user and password. (default user: sa)
Running the MSI Installer
- Run the
ambari-scom.msi
installer. The setup dialog appears:
- You are prompted to provide the following information
Field
Description
Ambari Installation Directory
The directory for Ambari SCOM Server
For example:c:\Ambari
SQL Server name
TBD
SQL Server port
TBD
SQL Server login
TBD
SQL Server password
TBD
SQL Server JDBC Driver
TBD
- Click Install
The MSI installer installation log can be found at C:\AmbariInstallFiles\AmbariSetupTools\ambari.winpkg.install.log
Installing Ambari SCOM Management Pack
Import the Management Pack
- Extract the contents of the
mp.zip
package to obtain the management pack (.mpb
) files. - Ensure Windows Server 2012 running SCOM with SQL Server (full text search).
- Open Operations Console
- Go to Administration -> Management Packs and select Import Management Pack Task
- In the Import Management packs dialog select Add -> from disk -> No
- Select the following files:
ambari\mp\Ambari.SCOM.mpb ambari\mp\Ambari.SCOM.Management.mpb ambari\mp\Ambari.SCOM.Presentation.mpb
- Click Install.
- After installation is complete, go to Administration -> Run As Configuration -> Accounts -> Create Account.
- Select the type Basic Authentication. Provide login and password for Ambari REST API (admin, admin).
Configure Management Pack
Perform the following to configure the Ambari SCOM Management Pack to talk to the Ambari SCOM Server.
- Go to Authoring -> Management Pack Templates -> Ambari SCOM -> Add Monitoring Wizard.
- Select Ambari SCOM monitoring type. Provide any name and create a new management pack for it. In the Ambari URI provide address in the format:
http://[server]:8080/api/
- Select the Run As account that you created in the step above.
- After wizard creation is complete you should see data in the Monitoring -> Ambari SCOM.