Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents
maxLevel3
absoluteUrltrue
stylesquare

myriad-0.2.0-incubating-rc1 

 

Major Features

    • Deployment of Resource Manager and Node Manager via Docker
    • Enhanced distribution of YARN binaries to Mesos Nodes at Runtime
      • Distribute the JVM Binaries
      • Distribute configuration files
      • Support REST endpoints for distributing configuration and binaries instead of relying on external source
    • Bugfixes
      • Better cgroup support and documentation
      • Better dynamic resource allocation support
 

JIRAs

 Full list of JIRAs fixed in version 0.2.0

Caveats

 

Caveats

  1. Myriad has a compile dependency of Hadoop 2.6.x and Hadoop 2.7.x and Mesos > 0.27.0 version. It was well tested against these versions. However, binary compatibility against other Hadoop/Mesos versions is not guaranteed.
  2. The /api/cluster/flexup and /api/cluster/flexdown REST end points support "constraints" parameter. However, the web UI does not yet support specifying this parameter.
  3. Currently YARN cgroups aren't supported when using Docker to run the Node Managers

Other Important Milestones

  • One new contributor.
  • New inquiries on the mailing list about Myriad.

myriad-0.1.0-incubating

Major Features

  • Deployment of a Hadoop YARN cluster as a Mesos framework

  • Static resource allocation using REST APIs to expand/contract a Hadoop YARN cluster

  • Dynamic resource allocation to expand/contract a Hadoop YARN cluster

  • High Availability, with discoverability, restartability, and state recovery

  • Ability to distribute Hadoop YARN binaries to Mesos nodes at runtime

  • Provisioning of auxiliary Hadoop services like the Job History Server

  • Support for constraints based node manager placement

  • Management GUI for monitoring and scaling Hadoop YARN clusters
  • Configurable Node Manager ports
  • API to shutdown Myriad
  • Documentation!

JIRAs

Full list of JIRAs fixed in version 0.1.0

Caveats

  1. Myriad has a compile dependency on Hadoop 2.7.0 and Mesos 0.24.1 versions. It was well tested against these versions. However, binary compatibility against other Hadoop/Mesos versions is not guaranteed.
  2. The /api/cluster/flexup and /api/cluster/flexdown REST end points support "constraints" parameter. However, the web UI does not yet support specifying this parameter.
  3. MYRIAD-153: Place holder tasks not getting cleaned up. A work around if this problem is hit is to restart the zero profile NM using flex down and flex up APIs.

Other Important Milestones