Versions Compared

Old Version 1

changes.mady.by.user Till Rohrmann

Saved on

compared with

New Version 2

changes.mady.by.user Till Rohrmann

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Important Information

Flink 1.1213.0 has been released.

Features

List of features announced by contributors and committers that are likely to be ready for the feature freeze:

...

Feature NameProposed byNote
K8s: Support user-specified pod templatesCanbin Zheng
K8s: Support built-in init-ContainerCanbin Zheng
Support accessing secured services via K8s secretsCanbin Zheng
K8s: Support configuring replica of JobManager Deployment in ZooKeeper HACanbin Zheng
K8s: Support to configure limit for CPU requirementCanbin Zheng

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-16430

Andrey Zagrebin, Zhu Zhu, Till Rohrmann
Reactive-scaling modeTill Rohrmann
FLIP-138: Declarative Resource managementChesnay Schepler, Till Rohrmann

Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-17075

Chesnay Schepler, Till Rohrmann

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-11127

Robert Metzger, Till Rohrmann

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-16866

Robert Metzger, Till Rohrmann

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-15679

Yangze Guo, Xintong Song, Till Rohrmann
FLIP-76: Unaligned Checkpoints (improvements and follow ups)Arvid Heise / Zhijiang Wang / Piotr Nowojski

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-18736

Piotr Nowojski
Sub-second end-to-end exactly-once latenciesPiotr Nowojski / Roman KhachatryanFLIP/Jira issue pending
FLIP-135 Approximate Task-Local RecoveryYuan MeiMilestone One
FLIP-141: Intra-Slot Managed Memory SharingXintong Song

Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-18620

Xintong Song

Runtime: various resource manager improvements.

Xintong Song,
Canbin Zheng,
Till Rohrmann

Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-17273

Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-17372

Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-13554

Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-18229

Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-18971

Yangze Guo

k8s: Support native k8s for sql client, python client and scala shell

Yang Wang,
Canbin Zheng

Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-17480

Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-17225

Jira issue for sql client pending

Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-12884

Yang Wang,
Shengyang Sha


Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-15981

Zhijiang Wang
Improve the performance of batch shuffle

Stephan Ewen,

Zhijiang Wang,

Yingjie Cao


Core APIs (DataStream/DataSet)

Feature NameProposed byNote
FLIP-131: Consolidate the user-facing Dataflow SDKs/APIs (and deprecate the DataSet API)Aljoscha

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-19033

Dawid
FLIP-134: Batch execution for the DataStream APIKlou / Dawid / AljoschaFLIP/Jira issue pending
FLIP-140: Introduce batch-style execution for bounded keyed streamsDawid

Connector APIs

Feature NameProposed byNote
Unified Sink InterfaceGuowei / YunFLIP/Jira issue pending
Extend StreamingFileSink to handle the “small file problem”Jingsong / Yun GaoFLIP/Jira issue pending

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-18323
 

Becket Qin
FLIP-33: Standardize Connector MetricsBecket Qin
Hybrid Source to support switch over between sources in the same job.Xiaofeng Jiang
Connector Testing FrameworkQingsheng Ren

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-17688
 EFO for Kinesis Consumer

Tzu-Li (Gordon) Tai, Danny Cranmer, Roland

Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-18858
 Table API support for Kinesis Connector

Waldemar Hummer, Alexander Alexandrov, Danny Cranmer

Table API/SQL

Feature NameProposed byNote

Table/SQL: 

Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-13191

Timo Walther
Table/SQL: FLIP-129: Refactor Descriptor APIJark Wu
Table/SQL: FLIP-132 Temporal Table DDL and Temporal Table JoinLeonard Xu
Table/SQL: Compiling multi-input operator to reduce unnecessary shuffleGodfrey He
Table/SQL: FLIP-145: Support SQL windowing table-valued functionJark & Danny
Table/SQL: Hive query compatibilityRui LiFLIP/Jira issue pending
Table/SQL: CREATE FUNCTION USING JARJark WuFLIP/Jira issue pending
Table/SQL: FLIP-136: Improve interoperability between DataStream and Table API Timo Walther
Table/SQL: FLIP-107: Handling of metadata in SQL connectorsTimo Walther
FLIP-36: Support Interactive Programming in FlinkXuannan Su
Feature NameProposed byNote
PyFlink: Improve the usabilities for PyFlinkJincheng SunFLIP-133

PyFlink: PyFlink Table API DSL

Jincheng Sun

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-19091

PyFlink:

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-18761

Jincheng SunFLIP-130
PyFlink: Support Pandas UDAF in batch GroupBy aggregationJincheng SunFLIP-137
PyFlink: PyFlink Table API UDAFJincheng SunFLIP-139: General Python User-Defined Aggregate Function Support on Table API
PyFlink: Support running pyflink jobs on kubernetesJincheng Sun

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-17480

...