You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 6 Next »

myriad-0.1.0-incubating

Major Features

  • Deployment of a Hadoop YARN cluster as a Mesos framework

  • Static resource allocation using REST APIs to expand/contract a Hadoop YARN cluster

  • Dynamic resource allocation to expand/contract a Hadoop YARN cluster

  • High Availability, with discoverability, restartability, and state recovery

  • Ability to distribute Hadoop YARN binaries to Mesos nodes at runtime

  • Provisioning of auxiliary Hadoop services like the Job History Server

  • Support for constraints based node manager placement

  • Management GUI for monitoring and scaling Hadoop YARN clusters
  • Configurable Node Manager ports
  • API to shutdown Myriad
  • Documentation!

JIRAs

Full list of JIRAs fixed in version 0.1.0

Caveats

  1. Myriad has a compile dependency on Hadoop 2.7.0 and Mesos 0.24.1 versions. It was well tested against these versions. However, binary compatibility against other Hadoop/Mesos versions is not guaranteed.
  2. The /api/cluster/flexup and /api/cluster/flexdown REST end points support "constraints" parameter. However, the web UI does not yet support specifying this parameter.
  3. MYRIAD-153: Place holder tasks not getting cleaned up. A work around if this problem is hit is to restart the zero profile NM using flex down and flex up APIs.

Other Important Milestones

 

  • No labels