Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The objective of "Fine Grained Scaling" fine-grained scaling (FGS) is to bring elasticity of resources between Myriad/YARN and other Mesos frameworks. The concept is to allow YARN to take resource offers from Mesos, run enough containers (YARN tasks) that the offers can hold and release the resources back to Mesos once the containers finish.

  • Node Managers that register with RM with (0 memory,0 cpu) are eligible for FGS. i.e. fine-grained scaling, that is, Myriad expands/shrinks the capacity of such NMs with the resources offered by Mesos. Further, Myriad ensures that YARN containers will be launched on such NMs only if Mesos offers enough resources on the slave nodes running those NMs.
  • A new **zero** profile is defined in myriad-config-default.yml file to help admins launch NMs with (0mem,0cpu) capacities using the xxx.
  • Node Managers that register with RM with more than (0 mem, 0 cpu) are **not** eligible for FGS. For example, Myriad will not expand/shrink the capacity of such NMs. These NMs are typically launched with low/medium/high profile.

...