Research and development roadmap for Flink Streaming
 

Fault tolerance guarantees for streaming

...

• Identification and implementation of a “lambda architecture” kernel of binary operators between DataSets and DataStreams.

• Create a unique context and environment for such executions

• Unify fault tolerance mechanisms efficiently

API integrations 

Currently we only provide a Java api for Flink streaming. In the near future we would like to make the same functionality accessible through a Scala (and later Python) api like for the batch processing functionality. Implementing the Scala api should be fairly straightforward because most of the features can be reused from the batch api.

...