THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
This section contains documentation on Spark's internals:
Children Display | ||
---|---|---|
|
Spark's Cluster Mode Overview documentation has good descriptions of the various components involved in task scheduling and execution.
The Intro to Spark Internals Meetup talk (Video, PPT slides) is also a good introduction to the internals (the talk is from December 2012, so a few details might have changed since then, but the basics should be the same).