Page History

This page tracks the users of Spark. Feel free to add yourself to this list (you will need a wiki user account) and explain how you use Spark. Please add a short description (up to three bullet points) and a link to your organization or project.

Companies & Organizations

• UC Berkeley AMPLab - Big data research lab that initially launched Spark
  • We're building a variety of open source projects on Spark, including Shark, MLbase, and Spark Streaming, and developing new distributed systems techniques that improve the engine
  • We have both graduate students and a team of professional software engineers working on the stack
• Adatao, Inc. - Pervasive Data Science in the Enterprise
  • Team of ex-Googlers & Yahoos with large-scale infrastructure experience (including both flavors of MapReduce at Google & Yahoo) & PhD's in ML/Data Mining
  • Determined that Spark, among the many alternatives, answered the right problem statements with the right design
• Amrita Center for Cyber Security Systems and Networks
• Autodesk
• Baidu
• Celtra
• Conviva - Experience Live
  • See our talk at AmpCamp on how we are using Spark to provide real time video optimization
• Databricks
• Digby
• Exabeam
• Falkonry
• Freeman Lab
  • We are using Spark for analyzing and visualizing patterns in large-scale recordings of brain activity in real time
• GraphFlow, Inc.
• Groupon
• Istanbul Sehir University
• Knoldus Software LLC
• MediaCrossing - Digital Media Trading Experts in the New York and Boston areas
  • We are using Spark as a drop-in replacement for Hadoop Map/Reduce to get the right answer to our queries in a much shorter amount of time.
• NFLabs
• Nokia Solutions and Networks
• Ooyala, Inc. - Powering personalized video experiences across all screens
  • See our blog post on how we use Spark for Fast Queries
  • See our presentation on Cassandra, Spark, and Shark
• Peerialism
• Premise
• Sohu
• Taobao
• UC Santa Cruz

Software Projects

• Shark - Hive and SQL on top of Spark
• MLbase - Machine Learning project on top of Spark
• Apache Mesos - Cluster management system that supports running Spark
• Tachyon - In memory storage system that supports running Spark
• BigR - Native R (and other front-ends) for Big-Data-Science/Machine-Learning with open API on top of Spark+Hadoop (soon to be open sourced)
• Apache MRQL - A query processing and optimization system for large-scale, distributed data analysis, built on top of Apache Hadoop, Hama, and Spark
• OpenDL - Deep learning training work based on Spark. Just kick off

The Georgia Bulldogs and the LSU Tigers are getting ready to do battle at Sanford Stadium. The game will kick off at 3:30 p.m. EDT on CBS.

The Bulldogs come into the game ranked No. 9 in the country, while the Tigers come into the game ranked No. 6. Georgia will face its third Top 10 team in four games. The Bulldogs lost to Clemson in the season opener and defeated South Carolina the following week.

Watch live >>> http://ncaaf.24watchlive.com/

Watch live >>> http://ncaaf.24watchlive.com/

In three games, the Bulldogs have tallied 574 yards per game, which is the sixth-best total in the FBS. The Tigers have scored 43 points per game in the four games they have played this season.

Be sure to come back here once the game starts for scoring updates, halftime grades and final grades for the Bulldogs.Two top-10 SEC teams will square off Saturday afternoon as the No. 9 Georgia Bulldogs host the No. 6 LSU Tigers in Athens for College GameDay. Television coverage begins at 3:30 p.m. ET on CBS.

http://ncaaf.24watchlive.com/

http://ncaaf.24watchlive.com/

The Tigers are one of four undefeated teams in the conference and have scored at least 35 points in all four of their games so far. After a 37-27 defeat of TCU in their opener, the Tigers soundly beat UAB and Kent State before opening up conference play with a 35-21 win over Auburn.

Georgia opened the year with a 38-35 road loss to Clemson, but rebounded nicely with a 41-30 win over South Carolina. After games against two-straight top-10 opponents, the Bulldogs had an extra week to prepare for North Texas and ended up outlasting the feisty Mean Green in a game that was closer than expected (although the Georgia faithful think that might not mean much).

For the Bulldogs, it will be their third game out of their first four against an opponent ranked in the top 10 in the country. The schedule gets a bit easier for Mark Richt's squad from here, as just one ranked team (No. 20 Florida) remains on the schedule.

...