Important Information

Flink 1.13 .0 has been released.Burndown (blockers and critical bugs): https://issues.apache.org/jira/secure/RapidBoard.jspa?rapidView=445

Features

List of features announced by contributors and committers that are likely to be ready for the feature freeze:Runtime

Distributed Coordination

Feature Name	Proposed by

NoteK8s: Support user-specified pod templatesCanbin ZhengK8s: Support built-in init-ContainerCanbin ZhengSupport accessing secured services via K8s secretsCanbin ZhengK8s: Support configuring replica of JobManager Deployment in ZooKeeper HACanbin ZhengK8s: Support to configure limit for CPU requirementCanbin Zheng

NoteF

Jira

server	ASF JIRA
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

16430Andrey Zagrebin, Zhu Zhu, Till RohrmannReactive-scaling modeTill RohrmannFLIP-138: Declarative Resource managementChesnay Schepler,

10407

Till Rohrmann

Jira

server	ASF JIRA
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

17075

15626

Chesnay Schepler,

Till Rohrmann

Jira

server	ASF JIRA
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

11127

20589

Robert Metzger,

Till Rohrmann

Jira

server	ASF JIRA
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

16866

6042

Robert Metzger,

Till Rohrmann

Jira

server	ASF JIRA

serverId5aa69414-a9e9-3523-82ec-879b028fb15bkeyFLINK-15679Yangze Guo, Xintong Song, Till RohrmannFLIP-76: Unaligned Checkpoints (improvements and follow ups)Arvid Heise / Zhijiang Wang / Piotr Nowojski

columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution

JiraserverASF JIRA


serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

18736Piotr NowojskiSub-second end-to-end exactly-once latenciesPiotr Nowojski / Roman KhachatryanFLIP/Jira issue pendingFLIP-135 Approximate Task-Local RecoveryYuan MeiMilestone OneFLIP-141: Intra-Slot Managed Memory SharingXintong Song

Runtime: various resource manager improvements.

Xintong Song,
Canbin Zheng,

20341

Till Rohrmann

Jira

server	ASF JIRA
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

18620Xintong Song

10052

Till Rohrmann

Jira

server	ASF JIRA
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

17273

21075

Till Rohrmann

Jira

server	ASF JIRA
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

17372

14187

Yangze Guo Xintong Song

FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

Yangze Guo Xintong Song

Jira

server	ASF JIRA
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

13554

20988

Xintong Song

Support ship local/remote files for yarn/k8s integrations.

Jira

server	ASF JIRA
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

18229

20681

Jira

server	ASF JIRA
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

18971Yangze Guo

k8s: Support native k8s for sql client, python client and scala shell

Yang Wang,
Canbin Zheng

20811

Jira

server	ASF JIRA
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

17480

20867

Xintong Song

Yang Wang

Jira

server	ASF JIRA
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

17225Jira issue for sql client pending

15656

Yang Wang

Jira

server	ASF JIRA
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

12884

20417

Yang Wang

,

Shengyang Sha

Jira

server	ASF JIRA
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

15981

20219

Zhijiang

Yang Wang

Improve the performance of batch shuffle

Stephan Ewen,

Zhijiang Wang,

Yingjie Cao

...

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-21110

Zhilong Hong Zhu Zhu

Table API/SQL

19033

Feature Name

Proposed by

Note

FLIP-131: Consolidate the user-facing Dataflow SDKs/APIs (and deprecate the DataSet API)

Aljoscha

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

Dawid

FLIP-134: Batch execution for the DataStream API

Klou / Dawid / Aljoscha

FLIP/Jira issue pending

FLIP-140: Introduce batch-style execution for bounded keyed streams

Dawid

Connector APIs

19604

Jark Wu

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-21617

Leonard Xu

FLIP is currently being prepared

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-21454

Shengkai Fang

FLIP is currently being prepared

Feature Name

Proposed by

Note

Unified Sink Interface

Guowei / Yun

FLIP/Jira issue pending

Extend StreamingFileSink to handle the “small file problem”

Jingsong / Yun Gao

FLIP/Jira issue pending

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-1832321529

Rui Li

Becket Qin

FLIP-33: Standardize Connector Metrics

Becket Qin

Hybrid Source to support switch over between sources in the same job.

Xiaofeng Jiang

136: Improve interoperability between DataStream and Table API

Timo Walther

WebUI

Qingsheng Ren

Feature Name

Proposed by

Note

Connector Testing Framework

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-17688

EFO for Kinesis Consumer

Tzu-Li (Gordon) Tai, Danny Cranmer, Roland

14712

Piotr Nowojski

DataStream API

Feature Name

Proposed by

Note

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-20491

Aljoscha Krettek

Jira

server	ASF JIRA	columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-18858

Table API support for Kinesis Connector

Waldemar Hummer, Alexander Alexandrov, Danny Cranmer

...

19463

Seth Wiesman

Savepoints/Checkpoints

Feature Name	Proposed by	Note

Table/SQL:

Jira

server	ASF JIRA
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

13191Timo WaltherTable/SQL: FLIP-129: Refactor Descriptor APIJark WuTable/SQL: FLIP-132 Temporal Table DDL and Temporal Table JoinLeonard XuTable/SQL: Compiling multi-input operator to reduce unnecessary shuffleGodfrey HeTable/SQL: FLIP-145: Support SQL windowing table-valued functionJark & DannyTable/SQL: Hive query compatibilityRui LiFLIP/Jira issue pendingTable/SQL: CREATE FUNCTION USING JARJark WuFLIP/Jira issue pendingTable/SQL: FLIP-136: Improve interoperability between DataStream and Table API Timo WaltherTable/SQL: FLIP-107: Handling of metadata in SQL connectorsTimo WaltherFLIP-36: Support Interactive Programming in FlinkXuannan Su

...

20976

Tzu-Li Tai Kostas Kloudas Dawid Wysakowicz

FLIP-147: Support Checkpoints After Tasks Finished

Yun Gao Guowei Ma

~~FLIP-158: Generalized incremental checkpoints~~

Roman Khachatryan Stephan Ewen

Yuan Mei

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-19462

Roman Khachatryan Nico Kruber

~~FLIP-151: Incremental snapshots for heap-based state backend~~

Roman Khachatryan

FLIP-76: Unaligned Checkpoints (rescaling and time outing aligned to unaligned checkpoints)

Arvid Heise Piotr Nowojski Roman Khachatryan

State Backends

Feature Name	Proposed by	Note

PyFlink: Improve the usabilities for PyFlinkJincheng SunFLIP-133

PyFlink: PyFlink Table API DSL

Jincheng Sun

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-20496

Yu Li

Proposed by YuFei Liu and reviewed by Yu Li

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-21736

Yun Tang

Yu Li

Python API

Feature Name	Proposed by	Note

19091PyFlink:

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

18761Jincheng SunFLIP-130PyFlink: Support Pandas UDAF in batch GroupBy aggregationJincheng SunFLIP-137PyFlink: PyFlink Table API UDAFJincheng SunFLIP-139: General Python User-Defined Aggregate Function Support on Table APIPyFlink: Support running pyflink jobs on kubernetesJincheng Sun

20479

HuangXingbo

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-19185

HuangXingbo

API/Python: FLIP-153: Support state access in Python DataStream API

Shuiqiang Chen HuangXingbo

Connectors

Feature Name

Proposed by

Note

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	FLINK-

17480

15578

Roman Khachatryan

Usability sprint (2019)

Page tree

Versions Compared

Old Version 2

New Version Current

Key

Important Information

Features

Distributed Coordination

Table API/SQL

Connector APIs

WebUI

DataStream API

Savepoints/Checkpoints

State Backends

Python API

Connectors

Page tree

Page History

Versions Compared

Old Version 2

New Version Current

Key

Important Information

Features

Distributed Coordination

Table API/SQL

Connector APIs

WebUI

DataStream API

Savepoints/Checkpoints

State Backends

Python API

Connectors