THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
The ./grandlew build command builds the myriad-executor-runnable-xxx.jar (as a self-contained executor jar file) and places it inside the PROJECT_HOME/myriad-executor/build/libs/ directory.
...
Deploying Myriad
To deploy Myriad Scheduler and Executor, copy the Myriad Scheduler and Executor jar files and the Myriad configuration file, myriad-config-default.yml, into your YARN classpath:
- Copy the Myriad Scheduler jar files from $PROJECT_HOME/myriad-scheduler/build/libs/ directory to the YARN ResourceManager's class path on all nodes in your cluster. For example, copy all jars to the $YARN_HOME/share/hadoop/yarn/lib/ directory.
- On each Mesos slave node, create a mesos directory under the /usr/local/libexec directory.
- Copy the Myriad Executor myriad-executor-runnable-xxx.jar file from $PROJECT_HOME/myriad-executor/build/libs/ to each mesos slave's /usr/local/libexec/mesos directory.
...
- /$YARN_HOME/share/hadoop/yarn/lib/s
cp myriad-executor/build/libs/myriad-executor-0.0.1.jar /opt/hadoop-2.7.1/share/hadoop/yarn/lib/directory.
For example:
| Code Block |
|---|
cp myriad-scheduler/build/libs/*.jar /opt/hadoop-2.7.1/share/hadoop/yarn/lib/
cp myriad-executor/build/libs/myriad-executor-0.0.1.jar /opt/hadoop-2.7.1/share/hadoop/yarn/lib/
cp myriad-scheduler/build/src/main/resources/myriad-config-default.yml /opt/hadoop-2.7.1/share/hadoop/yarn/lib/ |
| Note |
|---|
For advanced users, you can also copy myriad-executor-runnable-xxx.jar to any other directory on a slave filesystem or it can be copied to HDFS as well. In either case, you need to update the executor's path property in the myriad-config-default.yml file and prepend the path with either file:// or hdfs://, as appropriate. |
...