Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Code Block
hadoop fs -put myriad-executor/build/libs/myriad-executor-runnable-0.0.1.jar /dist

Step 4: Configure the Myriad

...

Defaults

Edit the /opt/hadoop/etc/hadoop/myriad-config-default.yml file to configure the default parameters. See the sample Myriad configuration file for more information. To enable remote binary distribution, you must set the following options:

HTML Comment

XREF: For a standard configuration, see [myriad-configuration]({{site.baseurl}}/docs/myriad-configuration-properties/myriad-configuration.md).

Code Block
frameworkSuperUser: admin # Must be root or have passwordless sudo on all nodes!
frameworkUser: hduser # Should be the same user running the resource manager.
# Must exist on all nodes and be in the 'hadoop' group
executor: 
nodeManagerUri: hdfs://namenode:port/dist/hadoop-2.7.0.tar.gz 
path: hdfs://namenode:port/dist/myriad-executor-runnable-0.0.1.jar
yarnEnvironment: 
YARN_HOME: hadoop-2.7.0 # This should be relative if nodeManagerUri is set

 

Step 5: Configure

...

YARN

...

to use Myriad

Configure /opt/hadoop-2.7.0/etc/hadoop/yarn-site.xml as instructed in Sample: myriad-config-default.yml.

...

You can now start the resource manager and attempt to flex up flexup or flexdown the cluster! See the Myriad Cluster API for more information.