Versions Compared

Old Version 1

changes.mady.by.user Stephan Ewen

Saved on

compared with

New Version 2

changes.mady.by.user Kostas Tzoumas

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Data exchange in Flink is built around the following design principles:

(1) The control flow for data exchange (i.e., the message passing in order to initiate the exchange) is receiver-initiated, much like the original MapReduce.

(2) The data flow for data exchange, i.e., the actual transfer of data over the wire is abstracted by the notion of an IntermediateResult, and is pluggable. This means that the system can support both streaming data transfer and batch data transfer with the same implementation.Dataflow graph with operators and intermediate results as unified abstraction for
batch and streaming. Incremental construction for interactive queries.