THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
The process of cutting a release requires a number of tools to be locally installed (maven, jekyll, etc). Ubuntu users can install those tools via apt-get. However, it may be most convenient to use a EC2 instance based on the AMI ami-8e98edbee9eda8d9 (available is US-West, has Scala 2.10.3 and SBT 0.13.1 installed). This has all the necessary tools installed. Mac users are especially recommended to use a EC2 instance instead of attempting to install all the necessary tools. If you want to prepare your own EC2 instance (different version of Scala, SBT, etc.), follow the steps given in the Miscellaneous section (see at the end of this document).
...
| Code Block | ||
|---|---|---|
| ||
# Install necessary tools $ sudo apt-get update —fix-missing $ sudo apt-get install -y git openjdk-7-jdk openjdk-6-jdk maven rubygems python-epydoc gnupg-agent linkchecker libgfortran3 # Install Scala of the same version as that used by Spark $ cd $ wget http://www.scala-lang.org/files/archive/scala-2.10.3.tgz $ tar xvzf scala*.tgz $ ln -s scala-2.10.3 scala # Install SBT of a version compatible with the SBT of Spark (at least 0.13.1) $ cd && mkdir sbt $ cd sbt $ wget http://repo.typesafe.com/typesafe/ivy-releases/org.scala-sbt/sbt-launch/0.13.1/sbt-launch.jar # Create /home/ubuntu/sbt/sbt with the following code SBT_OPTS="-Xms512M -Xmx1536M -Xss1M -XX:+CMSClassUnloadingEnabled -XX:MaxPermSize=256M" java $SBT_OPTS -jar `dirname $0`/sbt-launch.jar "$@" $ chmod u+x /home/ubuntu/sbt/sbt # Add stuff to ~/.bashrc $ echo "export SCALA_HOME=/home/ubuntu/scala/" >> ~/.bashrc $ echo "export JAVA_HOME=/usr/lib/jvm/java-6-openjdk-amd64" >> ~/.bashrc $ echo "export JAVA_7_HOME=/usr/lib/jvm/java-7-openjdk-amd64" >> ~/.bashrc $ echo "export SBT_HOME=/home/ubuntu/sbt/" >> ~/.bashrc $ echo "export MAVEN_OPTS='-Xmx3g -XX:MaxPermSize=1g -XX:ReservedCodeCacheSize=1g'" >> ~/.bashrc $ echo "export PATH='$SCALA_HOME/bin/:$SBT_HOME:$PATH'" >> ~/.bashrc $ source ~/.bashrc # Verify versions java -version # Makeboth sureJava that1.6 yourand javaJava version 1.6!!! Jars built with Java 6 has known problems7 should be installed, but JAVA_HOME should point to Java 1.6. sbt sbt-version # Should force the download of SBT dependencies and finally print SBT version, verify that SBT version is >= 0.13.1 scala -version # Verify that Scala version is same as the one used for Spark |