Page History

...

To run the SparkR tests you will need to install the R package 'testthat' (Run `install.packages(testthat)` from R shell).  You can run just the SparkR tests using the command

R/run-tests.sh

Running Different Test Permutations on Jenkins

When running tests for a pull request on Jenkins, you can add special phrases to the title of your pull request to change testing behavior. This includes:

• "[test-maven]" - signals to test the pull request using maven
• "[test-hadoop1.0]" - signals to test using Spark's Hadoop 1.0 profile (other options include Hadoop 2.0, 2.2, and 2.3)

Organizing Imports

You can use a IntelliJ Imports Organizer from Aaron Davidson to help you organize the imports in your code.  It can be configured to match the import ordering from the style guide.

...

• Latest master build: http://people.apache.org/~pwendell/spark-nightly/spark-master-bin/latest
• All nightly builds: http://people.apache.org/~pwendell/spark-nightly/

...