THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
A node within a cluster is the location where tasks are run. The tasks are launched with help of a daemon which resides inside the node. This daemon, in the case of Mesos, is Mesos Slave, and in the case of YARN, is Node Manager.
| Note |
|---|
At this time, YARN 's Node Manager only works with the CPU subsystem. |
The Cgroups Linux kernel feature allows aggregating /or partitioning a set of tasks and their future children into hierarchical groups with respect to one or more subsystems. For example: When cgroups , when Cgroups are enabled for the CPU subsystem, and a task is launched by Mesos Slave, it goes under the following hierarchy:
...
Modify the $YARN_HOME/etc/hadoop/yarn-site.xml file by adding the following content:
| Code Block |
|---|
<!-- GroupsCgroups configuration --> <property> <description>who will execute(launch) the containers.</description> <name>yarn.nodemanager.container-executor.class</name> <value>${yarn.nodemanager.container-executor.class}</value> </property> <property> <description>The class which should help the LCE handle resources.</description> <name>yarn.nodemanager.linux-container-executor.resources-handler.class</name> <value>${yarn.nodemanager.linux-container-executor.resources-handler.class}</value> </property> <property> <name>yarn.nodemanager.linux-container-executor.cgroups.hierarchy</name> <value>${yarn.nodemanager.linux-container-executor.cgroups.hierarchy}</value> </property> <property> <name>yarn.nodemanager.linux-container-executor.cgroups.mount</name> <value>${yarn.nodemanager.linux-container-executor.cgroups.mount}</value> </property> <property> <name>yarn.nodemanager.linux-container-executor.cgroups.mount-path</name> <value>${yarn.nodemanager.linux-container-executor.cgroups.mount-path}</value> </property> <property> <name>yarn.nodemanager.linux-container-executor.group</name> <value>${yarn.nodemanager.linux-container-executor.group}</value> </property> <property> <name>yarn.nodemanager.linux-container-executor.path</name> <value>${yarn.home}/bin/container-executor</value> </property> |
...