Versions Compared

Old Version 1

changes.mady.by.user Patrick Wendell

Saved on

compared with

New Version Current

changes.mady.by.user Sean Owen

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

 

Reducing Build Times

Spark's default build strategy is to assemble a jar including all of its dependencies. This can be cumbersome when doing iterative development. When developing locally, it is possible to create an assembly jar including all of Spark's dependencies and then re-package only Spark itself when making changes.

 

Code Block
languagebash
titleFast Local Builds
$ sbt/sbt clean assemble deps
$ sbt/sbt package
# ... do some local development ... #
$ sbt/sbt package
# ... do some local development ... #
$ sbt/sbt package
# ...

 

 Moved permanently to http://spark.apache.org/developer-tools.html