Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The following diagram shows two resource managers running independently which results in a statically partitioned datacenter:

...

Image Added

 

Advertising Resources: Mesos Slave and YARN’s Node Manager

...

The following diagram showcases a node running YARN NodeManager as a Mesos Slave task:

HTML CommentImage: ![Node](images/node.png)Image Added

 

  • Mesos Slave processes advertises all of a node’s resources (8 CPUs, 16 GB RAM) to Mesos Master.
  • The YARN Node Manager is started as a Mesos Task. This task is allotted (4 CPUs and 8 GB RAM) and the Node Manager is configured to only advertise 3 CPUs and 7 GB RAM.
  • The Node Manager is also configured to mount the YARN containers under the cgroup hierarchy  which stems from a Mesos task.

...

The following diagram shows a scenario where Mesos is used as the resource manager for the datacenter which allows both Mesos and YARN to schedule tasks on any node.

  HTML Comment![Generic Nodes](images/generic-nodes.png)Image Added

 

The following diagram gives an overview of how YARN can run along side Mesos:

HTML Comment![How it works](images/how-it-works.png)Image Added

Each node in the cluster has both daemons, Mesos Slave and YARN Node Manager, installed. By default, the Mesos slave daemon is started on each node and advertises all available resources to the Mesos Master.

...