Page History

This is the home of the Myriad space.

Apache Myriad enables the co-existence of Apache Hadoop YARN and Apache Mesos together on the same cluster and allows dynamic resource allocations across both Hadoop and other applications running on the same physical data center infrastructurephysical infrastructure. By running Hadoop YARN as a Mesos framework, YARN applications and Mesos frameworks can run side-by-side, dynamically sharing cluster resources. 

With Apache Myriad, you can:

• Run your operational applications (including those running in Docker) side-by-side with your analytic applications.
• Achieve Hadoop multi-tenancy by provisioning logical Hadoop clusters for each user or group.

Key features include:

• Ability to run YARN on Mesos as well as YARN applications within Mesos with other Mesos frameworks and tasks. running as a Mesos Framework, with resource manager and node managers running inside Mesos containers.
• YARN clusters running on Mesos that can allocate resources in one of the following ways:
  • Static - Administrators can use an API or a GUI to add or remove node managers or auxiliary services like the JobHistoryServer.
  • Fine-grained - Administrators can provision thin node managers that are dynamically resized based on application demand.
• High Availability (HA) and graceful restart of YARN daemons.
• Ability to launch multiple YARN clusters on the same set of nodes.Ability to manually scale YARN. For example, to add or removed Mesos resources (CPU and memory) from YARN by increasing or decreasing resources allocated to YARN by a specific amount. Also, to monitor resources currently allocated to YARN. 
• Support for YARN FairScheduler and all functionality such as hierarchical queues with weights. 
• Ability to deploy YARN Resource Manager using Marathon. This feature leverages Marathon's dynamic scheduling, process supervision, and integration with service discovery (Mesos-DNS). 
• Ability to run MapReduce v2 and associated libraries such as Hive, Pig, and Mahout.

...

Incubator Status: https://incubator.apache.org/projects/myriad.html

Source: https://github.com/mesosapache/incubator-myriad

Issue tracking: https://issues.apache.org/jira/browse/MYRIAD

Patch Submission: https://github.com/mesosapache/incubator-myriad/pulls

Mailing list: http://mail-archives.apache.org/mod_mbox/incubator-myriad-dev/