You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 39 Next »


This section describes the following:

Prerequisite Software

Setting up Ambari SCOM assumes the following prerequisite software:

  • Apache Hadoop cluster (HDFS and MapReduce) 1.2.0 or later 1
  • JDK 1.6
  • Microsoft System Center Operations Manager (SCOM) 2012
  • Microsoft SQL Server 2012
  • Microsoft JDBC Driver 4.0 for SQL Server 2

1 Note: Ambari SCOM has been tested with a Hadoop cluster based on Hortonworks Data Platform 1.3 for Windows
2 Note: Obtain the Microsoft JDBC Driver 4.0 for SQL Server JAR file (sqljdbc4.jar) at http://technet.microsoft.com/en-us/library/ms378749.aspx

Installation Methods

The following methods are available for installing Ambari SCOM:

  • Manual Installation - This installation method requires you to configure the SQL Server database, setup the Ambari SCOM Server and configure the Hadoop Metrics Sink. This optional provides the most flexible install option based on your environment. See Manual Installation for more information.
  • MSI Installation - This installation method install the Ambari SCOM Server and configures the Hadoop Metrics Sink automatically using an MSI Installer. After launching the MSI, you provide information about your SQL Server database and the cluster for the installer to handle configuration. See MSI Installation for more information.

Package Contents

├─ ambari-scom-x.y.z
├── README.md
├── LICENSE
├── NOTICE
├── server.zip
├── metrics-sink.zip
├── ambari-scom.msi
└── mp.zip

File

Name

Description

server.zip

Server Bundle

Contains the required software for manually configuring the Ambari SCOM Server software.

See Installing and Configuring Ambari SCOM Server

metrics-sink.zip

Metrics Sink Bundle

Contains the required software for manually configuring SQL Server and the Hadoop Metrics Sink.

See Configuring SQL Server
See Configuring Hadoop Metrics Sink

ambari-scom.msi

MSI Installer

The Ambari SCOM MSI Installer for configuring the Ambari SCOM Server and Hadoop Metrics Sink

See Running the MSI Installer

mp.zip

Management Pack Bundle

Contains the Ambari SCOM Management Pack software.

See Installing Ambari SCOM Management Pack



Manual Installation

Configuring SQL Server

  1. Configure you SQL Server instance for "mixed mode" authentication.
  2. Confirm SQL Server is installed with TCP/IP active and enabled. (default port: 1433)
  3. Create a user and password. Remember this user and password as this will be the account used by the Hadoop metrics interface for capturing metrics. (default user: sa)
  4. Extract the contents of the metrics-sink.zip package.
  5. Create the Ambari SCOM database schema by running the Hadoop-Metrics-SQLServer-CREATE.ddl script.

The Hadoop Metrics DDL script will create a database called "HadoopMetrics". Edit the DDL before running if you would like to change the database name.

Configuring Hadoop Metrics Sink

Preparing the Metrics Sink

  1. Extract the contents of the metrics-sink.zip package to obtain the metrics-sink.jar file.
  2. Obtain the Microsoft JDBC Driver 4.0 for SQL Server sqljdbc4.jar file.
  3. Copy sqljdbc4.jar and metrics-sink.jar to each host in the cluster.

Setup Hadoop Metrics2 Interface

  1. On each host in the cluster, setup the Hadoop metrics2 interface to use the SQLServerSink.
  2. Edit the hadoop-metrics2.properties file:
    *.sink.sql.class=org.apache.hadoop.metrics2.sink.SqlServerSink
    
    namenode.sink.sql.databaseUrl=jdbc:sqlserver://[server]:[port];databaseName=[databaseName];user=[user];password=[password]
    datanode.sink.sql.databaseUrl=jdbc:sqlserver://[server]:[port];databaseName=[databaseName];user=[user];password=[password]
    jobtracker.sink.sql.databaseUrl=jdbc:sqlserver://[server]:[port];databaseName=[databaseName];user=[user];password=[password]
    tasktracker.sink.sql.databaseUrl=jdbc:sqlserver://[server]:[port];databaseName=[databaseName];user=[user];password=[password]
    maptask.sink.sql.databaseUrl=jdbc:sqlserver://[server]:[port];databaseName=[databaseName];user=[user];password=[password]
    reducetask.sink.sql.databaseUrl=jdbc:sqlserver://[server]:[port];databaseName=[databaseName];user=[user];password=[password]
    
    where
      server = SQL Server hostname
      port = the SQL Server port (for example, 1433)
      databaseName = the SQL Server database (for example, HadoopMetrics)
      user = the SQL Server user (for example, sa)
      password = the SQL Server user (for example, BigData1)
    
  3. Set the Hadoop classpath to include the JAR files.
  4. Restart Hadoop for these changes to take affect.

Verify Metrics Collection

  1. Confirm metrics are being captured in the SQL Server database by querying the MetricRecord table:
    select * from HadoopMetrics.dbo.MetricRecord
    

    In the above SQL statement, HadoopMetrics is the database name.

Installing and Configuring Ambari SCOM Server

Unpacking the Server

TBD

Running the Server

TBD

Verify the Server API

  1. From a browser access the API
    http://[server]:8080/api/v1/clusters
    
  2. Verify that metrics are being reported.
    http://[server]:8080/api/v1/clusters/ambari/services/HDFS/components/NAMENODE
    

MSI Installation

Configuring SQL Server

  1. Configure you SQL Server instance for "mixed mode" authentication.
  2. Confirm SQL Server is installed with TCP/IP active and enabled. (default port: 1433)
  3. Create a user and password. (default user: sa)

Running the MSI Installer

  1. Run the ambari-scom.msi installer. The setup dialog appears:
  2. You are prompted to provide the following information

    Field

    Description

    Ambari Installation Directory

    The directory for Ambari SCOM Server
    For example: c:\Ambari

    SQL Server name

    TBD

    SQL Server port

    TBD

    SQL Server login

    TBD

    SQL Server password

    TBD

    SQL Server JDBC Driver

    TBD

  3. Click Install

Installing Ambari SCOM Management Pack

Import the Management Pack

  1. Extract the contents of the mp.zip package to obtain the management pack (.mpb) files.
  2. Ensure Windows Server 2012 running SCOM with SQL Server (full text search).
  3. Open Operations Console
  4. Go to Administration -> Management Packs and select Import Management Pack Task
  5. In the Import Management packs dialog select Add -> from disk -> No
  6. Select the following files:
    ambari\mp\Ambari.SCOM.mpb
    ambari\mp\Ambari.SCOM.Management.mpb
    ambari\mp\Ambari.SCOM.Presentation.mpb
    
  7. Click Install.
  8. After installation is complete, go to Administration -> Run As Configuration -> Accounts -> Create Account.
  9. Select the type Basic Authentication. Provide login and password for Ambari REST API (admin, admin).

Configure Management Pack

Perform the following to configure the Ambari SCOM Management Pack to talk to the Ambari SCOM Server.

  1. Go to Authoring -> Management Pack Templates -> Ambari SCOM -> Add Monitoring Wizard.
  2. Select Ambari SCOM monitoring type. Provide any name and create a new management pack for it. In the Ambari URI provide address in the format:
    http://[server]:8080/api/
    
  3. Select the Run As account that you created in the step above.
  4. After wizard creation is complete you should see data in the Monitoring -> Ambari SCOM.
  • No labels