Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • JDK 1.7+
  • Gradle
  • Hadoop 2.7.10

Operating Systems

  • RedHattRedHat/CentOS 6.x and 7.x
  • Ubuntu 12.04, 14.04, 15.04
  • Debian 8

...

The following is an overview of the general installation and configuration tasks needed for setting up and configuring Myriad are:

  1. Download HDFS binaries on your node(s) and set $JAVA_HOME.
  2. Install Mesos and Marathon (if using Marathon for monitoring) on your master node.
  3. Install zookeeper on your master node and configure mesos-master.
  4. Install Mesos on your slave nodes and create the cluster.
  5. Download Myriad binaries and build Myriad.
  6. Configure HDFS to use Myriad. For example, adding properties to in the Hadoop yarn-site.yml file. The files that you modify depends on the environment that you set up.
  7. Install and configure Mesos-DNS for Myriad High Availability (if using HA).

...

  • Myriad Scheduler - This component plugs into Resource Manager process and negotiates resources from Mesos by implementing Mesos ' Scheduler and SchedulerDriver interfaces. It is responsible to launch Node Manager processes via Mesos.
  • Myriad Executor - This component plugs into the NodeManager process via the YARN 's AuxiliaryService interface.

...