Page History

...

1. Running ./gradlew build.
2. Copying the Myriad Scheduler jar files in to your YARN classpath.
3. Placing the Myriad Executor jar files in HDFS.
4. Modifying the Myriad default configuration file (myriad-config-default.yml).
5. Modifying the YARN XML file (yarn-site.xml).
6. Creating the tarball.

...

./gradlew build

Step 2: Copy

...

Myriad Schedule

...

Files

Copy the jar files and configuration .yml file into your YARN classpath:

cp myriad-scheduler/build/libs/*.jar $YARN_HOME/share/hadoop/yarn/lib/
cp myriad-scheduler/src/main/resources/myriad-config-default.yml $YARN_HOME/share/hadoop/yarn/lib/

Step 3: Put

...

Myriad Executor Jar File

Put the myriad-executor-runnable-x.x.x.jar file in HDFS.

...

Step 4: Configure the Myriad Defaults

Edit the /opt/hadoop/$YARN_HOME/etc/hadoop/myriad-config-default.yml file to configure the default parameters. See the sample Myriad configuration file for more information. To enable remote binary distribution, you must set the following options:

...

Step 5: Configure YARN to use Myriad

Modify the /$YARN_HOME/etc/hadoop/yarn-site.xml file as instructed in Sample: yarn-site.xml file.

...

cd ~
sudo cp -rp /opt/hadoop-2.7.1$YARN_HOME .
sudo rm hadoop-2.7.1$YARN_HOME/etc/hadoop/*yarn-site.xml
sudo tar -zcpf ~/hadoop-2.7.1.tar.gz hadoop-2.7.1
hadoop fs -put ~/hadoop-2.7.1.tar.gz /dist

...