Introduction

  • This application collects metrics of Resource Manager in the following aspects:

    • Scheduler Info of the cluster: http://{RM_HTTP_ADDRESS}:{PORT}/ws/v1/cluster/scheduler

    • Applications of the cluster: http://{RM_HTTP_ADDRESS}:{PORT}/ws/v1/cluster/apps

    • Overall metrics of the cluster: http://{RM_HTTP_ADDRESS}:{PORT}/ws/v1/cluster/metrics

      • by version 0.5-incubating, mainly focusing at metrics
 - `appsPending`
 - `allocatedMB`
 - `totalMB`
 - `availableMB`
 - `reservedMB`
 - `allocatedVirtualCores`.

Setup & Installation

  • Make sure already setup a site (here use a demo site named "sandbox").

  • From left-nav list, navigate to application managing page by "Integration" > "Sites", and hit link "sandbox" on right.

  • Install "Hadoop Queue Monitor" by clicking "install" button of the application.


  • In the pop-up layout, select running mode as Local or Cluster.


  • Set the target jar of eagle's topology assembly that has existed in eagle server, indicating the absolute path ot it. As in the following screenshot:


  • Set Resource Manager endpoint urls field, separate values with comma if there are more than 1 url (e.g. a secondary node for HA).


  • Set fields "Storm Worker Number", "Parallel Tasks Per Bolt", and "Fetching Metric Interval in Seconds", or leave them as default if they fit your needs.


  • Finally, hit "Install" button to complete it.

 

Use of the application

  • There is no need to define policies for this applicatoin to work, it could be integrated with "Job Performance Monitoring Web" application and consequently seen on cluster dashboard, as long as the latter application is installed too. See an exmple in the following screenshot:


 


  • No labels