Versions Compared

Old Version 33

changes.mady.by.user Ruth Harris

Saved on

compared with

New Version 34

changes.mady.by.user Santosh Marella

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • You are using hadoop-2.7.1 0 downloaded from hadoop.apache.org. Specific vendor versions should work but may require additional steps.
Note

The default location for $YARN_HOME is /opt/hadoop-2.7.10.

 

Building the Myriad Remote Distribution Bundle

...

Code Block
cp myriad-scheduler/build/libs/*.jar /opt/hadoop-2.7.10/share/hadoop/yarn/lib/
cp myriad-executor/build/libs/myriad-executor-0.0.1.jar /opt/hadoop-2.7.10/share/hadoop/yarn/lib/
cp myriad-scheduler/build/src/main/resources/myriad-config-default.yml /opt/hadoop-2.7.10/etc/hadoop/


Step 3: Configure the Myriad Defaults

...

Code Block
frameworkSuperUser: admin              # Must be root or have passwordless sudo on all nodes!
frameworkUser: hduser                  # Should be the same user running the resource manager.
                                       # Must exist on all nodes and be in the 'hadoop' group
executor: 
  nodeManagerUri: hdfs://namenode:port/dist/hadoop-2.7.10.tar.gz 
yarnEnvironment: 
YARN_HOME: hadoop-2.7.10                # This should be relative if nodeManagerUri is set

...

Code Block
cd ~
sudo cp -rp /opt/hadoop-2.7.10 .
sudo rm ~/hadoop-2.7.10/etc/hadoop/yarn-site.xml
sudo tar -zcpf ~/hadoop-2.7.10.tar.gz hadoop-2.7.10
hadoop fs -put ~/hadoop-2.7.10.tar.gz /dist

 

Getting Started

...