Page History

...

Trying out Fine-grained Scaling

1. Spin up Resource Manager with Myriad Scheduler plugged into it.

2. Flexup a few Node Managers using Myriad Cluster API with zero profile:

   Code Block
   { "instances":3, "profile": "zero" }

...

1. Info
   The zero profile Node Managers advertise zero resources to Resource Manager (the Resource Manager's Nodes UI show this).

2. Submit a MapReduce job to the Resource Manager.

• • The zero profile Node Managers advertise zero resources to Resource Manager (the Resource Manager's Nodes UI show this).
  • When Mesos offers resources to Myriad, the Mesos UI shows placeholder mesos tasks (prefixed with "yarn_") for each yarn container allocated using those offers.
  • The Resource Manager's UI
should show
• • shows these containers allocated to the zero profile Node Manager nodes.
  • The placeholder mesos tasks
should
• • typically finish
as and
• • when the YARN containers finish.
  • The job should finish successfully (although some Node Managers were originally launched with zero (0) capacities).

Sample Mesos Tasks Screenshot

...