Versions Compared

Old Version 82

changes.mady.by.user wangwj

Saved on

compared with

New Version 83

changes.mady.by.user wangwj

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

As shown below, for batch job with blocking shuffle(similar to MapReduce). Because of introducing speculative execution, all reduce executions in an ExecutionVertex will consume the resultPartition of map ExecutionVertex's fastest finished execution.

Image RemovedImage Added

  • Once all map ExecutionVertexs finish, all executions in reduce ExecutionVertex should be notified to update its inputChannels from UNKNOW to LOCAL/REMOTE. So there are some modifications in Execution.updatePartitionConsumers().

...