Status
...
Page properties | |
---|---|
|
...
...
|
...
...
|
...
Table of Contents | ||
---|---|---|
|
...
We also want to make the shuffle mode configurable because there might be cases where a user wants BATCH execution mode but still want's wants the data to be exchanged in a pipelined fashion. For this we propose a new configuration option execution.shuffle-mode
. We will not expose a dedicated setter in StreamExecutionEnvironment, or ExecutionConfig
...
Test Plan
The new code should, of course, be tested by unti unit tests and integration tests as well as end-to-end tests. The most important acceptance test is whether we can execute a bounded DataStream program with multiple stages (keyBy()) on a single TaskManager with a single task slot. This is semething something that is not possible in STREAMING mode because all tasks/operations need to be online at the same time but is something that will be possible in BATCH execution mode.
...