myriad-0.1.0-incubating
Major Features
Deployment of a Hadoop YARN cluster as a Mesos framework
Static resource allocation using REST APIs to expand/contract a Hadoop YARN cluster
Dynamic resource allocation to expand/contract a Hadoop YARN cluster
High Availability, with discoverability, restartability, and state recovery
Ability to distribute Hadoop YARN binaries to Mesos nodes at runtime
Provisioning of auxiliary Hadoop services like the Job History Server
Support for constraints based node manager placement
- Management GUI for monitoring and scaling Hadoop YARN clusters
- Configurable Node Manager ports
- API to shutdown Myriad
- Documentation!
JIRAs
Full list of JIRAs fixed in version 0.1.0
Caveats
- Myriad has a compile dependency on Hadoop 2.7.0 and Mesos 0.24.1 versions. It was well tested against these versions. However, binary compatibility against other Hadoop/Mesos versions is not guaranteed.
- The /api/cluster/flexup and /api/cluster/flexdown REST end points support "constraints" parameter. However, the web UI does not yet support specifying this parameter.
- MYRIAD-153: Place holder tasks not getting cleaned up. A work around if this problem is hit is to restart the zero profile NM using flex down and flex up APIs.
Other Important Milestones
- Myriad code base donated to ASF from eBay/PayPal
- Code migrated to ASF git repository (git://git.apache.org/incubator-myriad.git)
- Issues migrated to JIRA (https://issues.apache.org/jira/browse/MYRIAD)
- Documentation on Wiki (cwiki.apache.org/confluence/display/MYRIAD/)
- Podling Website (myriad.incubator.apache.org)
- Two new committers/PPMC members voted in