Versions Compared

Old Version 5

changes.mady.by.user Kostas Tzoumas

Saved on

compared with

New Version 6

changes.mady.by.user Kostas Tzoumas

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

ExecutionGraph: The execution graph is a data structure that contains the “ground truth” about the job computation. It consists of vertices (ExecutionVertex) that represent computation tasks, and intermediate results (IntermediateResultPartition), that represent data produced by tasks. Vertices are linked to the intermediate results they consume via ExecutionEdges (EE):

Image Added

These are logical data structures that live in the JobManager. They have their runtime equivalent structures that are responsible for the actual data processing that live at the TaskManagers. The runtime equivalent of the IntermediateResultPartition is called ResultPartition.

...