Page History

This page tracks software projects that supplement Apache Spark and add to its ecosystem.  To add an item to this page, please send a note to user@spark.apache.org with the name of the project, a brief description, and URL.

Note: the Spark package index provides a more comprehensive list of add-ons for Spark along with installation instructions.

Spark Infrastructure

• Spark Job Server - REST interface for managing and submitting Spark jobs on the same cluster (see blog post for details)
• SparkR - R frontend for Spark
• MLbase - Machine Learning research project on top of Spark
• Apache Mesos - Cluster management system that supports running Spark
• Tachyon - In memory storage system that supports running Spark
• Spark Cassandra Connector - Easily load your Cassandra data into Spark and Spark SQL; from Datastax
• ElasticSearch - Spark SQL Integration
• Spark-Scalding - Easily transition Cascading/Scalding code to Spark
• Zeppelin - an IPython-like notebook for Spark.  There is also ISpark, and the Spark Notebook.

...