...

Implementation steps

• Document the the official docker hub image and examples of how to run it (as of now)
• Document examples of how to extend the official extend the official docker hub image (as of now)
• Remove flink-contrib/docker-flink
• Extend entry point script and docs with job cluster mode and user job artefacts, document it
• Remove flink-container/docker

Tentative improvements:

• Modify the log4j-console.properties to also output logs into the files for WebUI
• Make custom logging properties possibleconfigurable
• Split stdout/stderr file container logsRemove the existing docker/compose/swarm/bluemix scripts in flink-contrib/docker-flink and flink-container/docker

Test Plan

Firstly, mostly manual testing. Later we can think of more extensive docker CI tests.

Future road map

We can still do move improvements to the user experience with docker in Flink:

• Investigate how to support developers to build a custom image for a snapshot version, e.g. for a certain commit in Flink repo
• Rewrite Flink options in flink-conf.yaml by environment variables when Flink process starts
• Refactor Flink bash scripts into one thin script which uses a Java bootstrap utility to prepare and configure started Flink process (similar to BashJavaUtils for memory setup)

For more details see also this FLIP discussion thread and more detailed proposal doc.

Rejected Alternatives

None so far.