Status

Current state: In ProgressReleased

Discussion thread: - 

JIRA: 

Released:  - 1.5

This Flink Improvement Proposal outlines improvements in how Flink is used on top of various cluster managers (YARN, Mesos) and deployment technologies (Docker, Kubernetes, etc).

For simplicity, we refer to all those cluster- and deployment frameworks as cluster managers.

Original design draft document: https://docs.google.com/document/d/1zwBP3LKnJ0LI1R4-9hLXBVjOXAkQS5jKrGYYoPz-xRk

...

The biggest user-facing changes are the YARN CLI experience. While this FLIP needs not necessarily change the parameters of the CLI, it will change the responses. For example, jobs will be accepted without first waiting for all TaskManagers to be allocated and available. 

...

Compatibility, Deprecation, and Migration Plan

...

The YARN session mode can still work as a "standalone mode bootstrapped on YARN".

...

Test Plan

• The ResourceManager, JobManager, TaskManager, and SlotPool need strong unit tests for the protocol.
• The YARN and Mesos integration have their regular tests, as they have prior to this proposal

...

...

Rejected Alternatives

(none yet)