...
Note |
---|
All clients that are connected to Resource Manager continue to work as long as the FQDN (for example, rmapprm.marathon.mesos) is used to connect to the Resource Manager. |
...
Configuring Myriad for HA involves adding HA configuration properties to the $YARN_HOME/etc/hadoop/yarn-site.xml file and the $YARN_HOME/etc/hadoop/myriad-config-default.yml file.
To the $YARN_HOME/etc/hadoop/yarn-site.xml file file, add the following properties:
Code Block |
---|
<!-- HA configuration properties --> <property> <name>yarn.resourcemanager.store.class</name> <value>org.apache.hadoop.yarn.server.resourcemanager.recovery.MyriadFileSystemRMStateStore</value> </property> <property> <name>yarn.resourcemanager.fs.state-store.uri</name> <!-- Path on HDFS, MapRFS etc --> <value>/var/mapr/cluster/yarn/rm/system</value> </property> <property> <name>yarn.resourcemanager.recovery.enabled</name> <value>true</value> </property> <!-- If using MapR distro <property> <name>yarn.resourcemanager.ha.custom-ha-enabled</name> <value>false</value> </property> --> |
Launching Resource Manager
Launch the Resource Manager using Marathon. When launching, specify the yarn.resourcemanager.hostname
property. The hostname is the ID field specified when launching a Marathon application.
Code Block |
---|
env && export YARN_RESOURCEMANAGER_OPTS=-Dyarn.resourcemanager.hostname=rmapp.marathon.mesos && yarn resourcemanager |
...
To the $YARN_HOME/etc/hadoop/myriad-config-default.yml file, modify the following values:
Code Block |
---|
frameworkFailoverTimeout: <non-zero value>
haEnabled: true |
Note |
---|
The Myriad Mesos |