Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • This application collects metrics of Resource Manager in the following aspects:
    • Scheduler Info of the cluster: http://{RM_HTTP_ADDRESS}:{PORT}/ws/v1/cluster/scheduler

    • Applications of the cluster: http://{RM_HTTP_ADDRESS}:{PORT}/ws/v1/cluster/apps

    • Overall metrics of the cluster: http://{RM_HTTP_ADDRESS}:{PORT}/ws/v1/cluster/metrics

...

titleInteresting Metrics
      • by version 0.5-incubating, mainly focusing at metrics
         - `appsPending`
         - `allocatedMB`
         - `totalMB`
         - `availableMB`
         - `reservedMB`
         - `allocatedVirtualCores`.

Setup & Installation

  • Make sure already setup a site (here use a demo site named "sandbox").

  • From left-nav list, navigate to application managing page by "Integration" > "Sites", and hit link "sandbox" on right.

Image Added

  • Install "Hadoop Queue Monitor" by clicking "install" button of the application.

Image Added

  • In the pop-up layout, select running mode as Local or Cluster.

Image Added

  • Set the target jar of eagle's topology assembly that has existed in eagle server, indicating the absolute path ot it. As in the following screenshot:

Image Added

  • Set Resource Manager endpoint urls field, separate values with comma if there are more than 1 url (e.g. a secondary node for HA).

Image Added

  • Set fields "Storm Worker Number", "Parallel Tasks Per Bolt", and "Fetching Metric Interval in Seconds", or leave them as default if they fit your needs.

Image Added

  • Finally, hit "Install" button to complete it.

 

Use of the application

  • There is no need to define policies for this applicatoin to work, it could be integrated with "Job Performance Monitoring Web" application and consequently seen on cluster dashboard, as long as the latter application is installed too. See an exmple in the following screenshot:

Image Added