You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 18 Next »

This page tracks the users of Spark. Feel free to add yourself to this list (you will need a wiki user account) and explain how you use Spark. Please add a short description (up to three bullet points) and a link to your organization or project.

Organizations

  • UC Berkeley AMPLab - Big data research lab that initially launched Spark
  • Adatao, Inc. - Pervasive Data Science in the Enterprise
    • Team of ex-Googlers & Yahoos with large-scale infrastructure experience (including both flavors of MapReduce at Google & Yahoo) & PhD's in ML/Data Mining
    • Determined that Spark, among the many alternatives, answered the right problem statements with the right design
  • GraphFlow, Inc.

Software Projects

  • MLbase - Machine Learning project on top of Spark
  • Shark - Hive and SQL on top of Spark
  • Apache Mesos - Cluster management system that supports running Spark
  • Tachyon - In memory storage system that supports running Spark
  • BigR - Native R (and other front-ends) for Big-Data-Science/Machine-Learning with open API on top of Spark+Hadoop (soon to be open sourced)
  • No labels