Versions Compared

Old Version 1

changes.mady.by.user Ruth Harris

Saved on

compared with

New Version Current

changes.mady.by.user Santosh Marella

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The Myriad environment is established by running an initial application for the resource manager. This initial application name is specified in the yarn-site.xml file with the the yarn.resourcemanager.hostname property and the value, <app-ID>.<framework>.mesos.

For example, if the value of  yarn.resourcemanager.hostname property is rm.marathon.mesos:

  • rm - The ID given to the Resource Manager when launched using Marathon. Mesos-DNS constructs the Resource Manager hostname using the ID.

  • marathon - The Mesos framework.

If you are using Marathon, launch Marathon and run an initial Resource Manager application. The Resource Manager can be launched or stopped from either the command line or the Marathon UI. 

 

Table of Contents

Launching from the Command Line

...

Code Block
 cd hadoop-2.7.10/sbin && yarn-daemon.sh start resourcemanager

...

Alternatively, when launching the Resource Manager in an HA environment, specify value for the yarn.resourcemanager.hostname property. The hostname is the ID field specified when launching a Marathon application.

To initially launch the Resource Manager from Marathon:

  1. Launch Marathon with <host>:8080. For example: http://10.10.100.16:8080

  2. Click on New App.

  3. Create a new application for the resource manager and specify:

    1. ID

    2. CPU

    3. Memory

    4. Instances

    5. Command.


For example

ParameterExample ValueDescription

ID

rm

The ID for the Resource Manager when launched using Marathon. Mesos-DNS constructs the Resource Manager hostname using the ID.

CPU

0.2

Amount of CPU allocated.

Memory

2048

Amount of memory allocated

Instances

1

Number of instances to be launched.

Command

env && yarn resourcemanager

Command to launch the resource manager.
Note

If the yarn.resourcemanager.hostname property is not specified in the yarn-site.xml file, then the -DYARN_RESOURCEMANAGER_OPTS option must be specified. When the -Dyarn.resourcemanager.hostname property is specified when launching Resource Manager, Myriad propagates this value to the Node Managers launched via the flexup API. The Node Managers can discover back the Resource Manager using the hostname specified in -Dyarn.resourcemanager.hostname. If that hostname happens to be a Mesos DNS hostname, then when the Resource Manager moves to another node during failover, Node Managerss can still connect to the new Resource Manager using the same hostname. Marathon helps move the Resource Manager to a different node whenever it detects the failure of Resource Manager.

 

For example

Code Block
env && export YARN_RESOURCEMANAGER_OPTS=-Dyarn.resourcemanager.hostname=rmapprm.marathon.mesos && yarn resourcemanager
Note

Some applications might require the yarn.resourcemanager.hostname property to be explicitly specified explicitly as a command line option.

...