THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
This document covers the process for managing Spark releases.
| Table of Contents |
|---|
Prerequisites for Managing A Release
Create a GPG Key
...
| language | bash |
|---|
...
Moved permanently to http://
...
...
Get Access to Apache Nexus for Publishing Artifacts
- You have this iff you can log into repository.apache.org
- Install LDAP credentials in your ~/.m2/settings.xml file as described here for publishing
Get "Push" Access to Apache Git Repository
git remote add apache https://git-wip-us.apache.org/repos/asf/incubator-spark.git
Preparing the Code for a Release
Ensure Spark is Ready for a Release
...
- Review and merge any blocking features
- Bump other remaining features to subsequent releases
...
...
...
Check for dead links in the docs
| Code Block | ||
|---|---|---|
| ||
$ cd $SPARK_HOME/docs
$ jekyll serve --watch
$ sudo apt-get install linkchecker
$ linkchecker -r 2 http://localhost:4000 --no-status --no-warnings |
Checkout and Run Tests
| Code Block | ||
|---|---|---|
| ||
$ git clone https://git-wip-us.apache.org/repos/asf/incubator-spark.git -b branch-0.8
$ cd incubator-spark
$ sbt/sbt assembly
$ export MAVEN_OPTS="-Xmx3g -XX:MaxPermSize=1g -XX:ReservedCodeCacheSize=1g"
$ mvn test |
Run License Audit Tool
| Code Block | ||
|---|---|---|
| ||
$ java -jar /path/to/apache-rat-0.10.jar --dir . --exclude *.md > rat_results.txt
$ vi rat_results.txt
$ # Look for source files that seem to have missing headers
$ cat rat_results.txt | grep "???" | grep -e \.scala$ -e \.java$ -e \.py$ -e \.sh$
$ # Add missing headers if necessary |