This is the home of the Myriad space.
Apache Myriad enables the co-existence of Apache Hadoop YARN and Apache Mesos together on the same cluster and allows dynamic resource allocations across both Hadoop and other applications running on the same physical data center infrastructure.physical infrastructure. By running Hadoop YARN as a Mesos framework, YARN applications and Mesos frameworks can run side-by-side, dynamically sharing cluster resources.
With Apache Myriad, you can:
- Run your operational applications (including those running in Docker) side-by-side with your analytic applications.
- Achieve Hadoop multi-tenancy by provisioning logical Hadoop clusters for each user or group.
Key features include:
- YARN running as a Mesos Framework, with resource manager and node managers running inside Mesos containers.
- YARN clusters running on Mesos that can allocate resources in one of the following ways:
- Static - Administrators can use an API or a GUI to add or remove node managers or auxiliary services like the JobHistoryServer.
- Fine-grained - Administrators can provision thin node managers that are dynamically resized based on application demand.
- High Availability (HA) and graceful restart of YARN daemons.
- Ability to launch multiple YARN clusters on the same set of nodes.
- Support for YARN FairScheduler and all functionality such as hierarchical queues with weights.
- Ability to deploy YARN Resource Manager using Marathon. This feature leverages Marathon's dynamic scheduling, process supervision, and integration with service discovery (Mesos-DNS).
- Ability to run MapReduce v2 and associated libraries such as Hive, Pig, and Mahout.
Topics
Children Display | ||
---|---|---|
|
Links
https://wiki.apache.org/incubator/MyriadProposal
Incubator Status: https://incubator.apache.org/projects/myriad.html
Source: https://github.com/mesosapache/incubator-myriad
Issue tracking: https://issues.apache.org/jira/browse/MYRIAD
Patch Submission: https://github.com/mesosapache/incubator-myriad/issuespulls
Mailing list: http://mail-archives.apache.org/mod_mbox/incubator-myriad-dev/