Page History

...

• Update remaining version numbers in the release branch (see this example commit)
• Update the spark-ec2 scripts
  • Upload the binary packages to the spark-related-packages bucket in S3 and make them public
  • Alter the init scripts in amplab/spark-ec2 repository to pull new binaries (see this example commit)
  • You can audit the ec2 set-up by launching a cluster and running this audit script
• Update the Spark website
  • The website repo is at: https://svn.apache.org/repos/asf/incubator/spark
  • Copy new documentation to /site/docs and update the "latest" link
  • NOTE: For the below items, look at how previous releases are documented on the site
  • Create release notes
  • Update documentation page
  • Update downloads page
  • Update the main page with a news item
• Once everything is working (ec2, website docs, website changes) create an announcement on the website and then send an e-mail to the mailing list
• Enjoy an adult beverage of your choice, congrats on making a Spark release

Miscellaneous

Steps to create the AMI useful for making releases

# Install necessary tools
$ sudo apt-get update —fix-missing 
$ sudo apt-get install -y git openjdk-7-jdk maven rubygems python-epydoc gnupg-agent linkchecker
 
# Install Scala 2.10
$ wget http://www.scala-lang.org/files/archive/scala-2.10.3.tgz
$ tar xvzf scala*.tgz
$ ln -s scala-2.10.3 scala


# Add stuff to ~/.bashrc
$ echo "export SCALA_HOME=/home/ubuntu/scala/" >> ~/.bashrc 
$ echo "alias scala='$SCALA_HOME/bin/scala' " >> ~/.bashrc
$ echo "export MAVEN_OPTS='-Xmx3g -XX:MaxPermSize=1g -XX:ReservedCodeCacheSize=1g'" >> ~/.bashrc