...
...
...
...
Runtime |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
Shuffle | Jira |
---|
server | ASF JIRA |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-29766 |
---|
|
| | Xintong Song | | 40 | 12-08-2022 | Adaptive Batch Scheduler supports hybrid shuffle mode | Weijie Guo | Xintong Song | | Simplify network memory configurations for TaskManager | Yuxin Tan | Xintong Song | | Deployment & Cluster Coordination |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
REST APIcolumnIds | | serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-29801 |
---|
|
| |
|
| FLIP in voting | |
|
|
|
|
|
Shuffle |
|
|
|
|
|
|
|
|
|
|
---|
Jira |
---|
server | ASF JIRA |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee |
---|
|
|
issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution | columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
27060 | | 15-11-2022 | 15-11-2022 | 15-11-2022 | Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
30185 | | | 60% | 10-12-2022 | Reactive Mode |
Scheduler |
|
AdaptiveBatchScheduler should supports early consumption for dynamic graph. | Weijie Guo | Xintong Song |
|
| |
|
|
|
|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29663Lijie Wang | | 50% | 13-12-2022 | Speculative Execution |
Speculative execution for sink | | | PoC done, FLIP in progress | | 10% | 13-12-2022 | Xintong Song |
|
| | 100% | 17-01-2023 | 17-01-2023 | 10-02-2023 | self-test |
Further improvement of production availability of hybrid shuffle | | |
|
| | 100% | 17-01-2023 | 17-01-2023 |
| self-test |
Deployment & Cluster Coordination |
Improve slow task detection | | Zhu Zhu | | 13-12-2022 | Misc |
OLAP |
State backend |
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
FLIP-263: Improve resolving schema compatibilityserverId | 5aa69414-a9e9-3523-82ec-879b028fb15bcolumnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29844Hangxiang YuYuan Mei | 20% | 13-12-2022 | Improve File Management in State Backend
| Yuan Mei
| 5% | 13-12-2022 | Improve the serializer performace of state change of changelog
Jira |
---|
server | ASF JIRA |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution100% | 20-02-2023 | 15-11-2022 | 15-11-2022 | self-test |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-30583 |
---|
|
| | |
| The first stage is finished, and the second stage is improvement, it will be finished in the next version. | | 100% | 09-01-2023 | 05-01-2023 | 09-01-2023 |
|
Reactive Mode
|
n/a
|
Scheduler |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
30345Hangxiang YuRoman Khachatryan Yuan Mei80%1312Allow to configure Changelog Storage per programcolumnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution | serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
26372 | | | 50% | 13-12-2022 | Add a metric for back-pressure from the ChangelogStateBackendcolumnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution | serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
24402Frocksdb cannot run on Apple M1
Jira |
---|
| | | 40% | 13-12-2022 | columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution | serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
24932Yun TangYanfei Lei | | 90% | 13-12-2022 |
|
| | 100% | 31-01-2023 |
|
|
|
Misc |
n/a |
OLAP |
n/a |
State backend |
---|
Checkpoint |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
Benchmark Generic Incremental CP + UC + BD | | Yuan Mei | FLIP-263: Improve resolving schema compatibility Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
26803Rui FanPiotr Nowojski70%101220222023 |
|
|
|
Improve File Management in State Backend
| | |
|
| | 5% | 31-1-2023 |
|
|
|
Improve the serializer performace of state change of changelog |
Benchmark | Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
Improve benchmark stability Jira |
---|
server | ASF JIRA |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29825Yanfei Lei30%13122022API |
---|
|
| self-test |
Allow to configure Changelog Storage per program |
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verifiedserverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-29740 |
---|
| Deprecated | | 100% | 08-11-2022 | 08-11-2022 | 08-11-2022 | Jira |
---|
server | ASF JIRA |
---|
| columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
|
|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
28641 | Removed | | 40% | 08-11-2022 | | |
|
| | 70% | 31-1-2023 |
|
|
|
Add a metric for back-pressure from the ChangelogStateBackend Jira |
---|
server | ASF JIRA |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
24456 Jira |
---|
server | ASF JIRA |
---|
| | |
|
| | 40% | 31-1-2023 |
|
|
|
Frocksdb cannot run on Apple M1 Jira |
---|
server | ASF JIRA |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
|
|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
18647 GaoFLIP Discussion | | 13-12-2022 | Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-29668 |
---|
|
| Martijn Visser | Removed | | 100% | 14-11-2022 | 14-11-2022 | 14-11-2022 | |
|
| | 100% | 30-1-2023 |
|
| |
Release FRocksDB 6.20.3-ververica-2.0
|
serverId | 5aa69414-a9e9-3523columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK |
---|
|
|
-30050 | | | |
|
| | 100% | 31-1-2023 |
|
| |
Checkpoint |
---|
SQL |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
General |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-29942 |
---|
|
| | Benchmark Generic Incremental CP + UC + BD | | Yuan Mei |
|
| |
|
|
|
|
|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
28016 | | | | |
|
| | 100% | |
|
|
|
Benchmark |
|
|
|
|
|
|
|
|
|
|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
Improve benchmark stability |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-29281 |
---|
|
| Chesnay Schepler | | Calcite Update |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-20873 |
---|
|
| | Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-21239 |
---|
| | columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
|
|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29932Sergey Nuyanzin | Flink Dialect |
ALTER TABLE API Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-21634 |
---|
|
| | | 60% | CALL Syntax(PoC) | | | Yuan Mei |
|
| | 50% | 31-1-2023 |
|
|
|
API |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
Hive Dialect |
---|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29635 | | |
| Deprecated |
| | 100% | 08-11-2022 | 08-11-2022 | 08-11-2022 | Self-tested |
60% |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29717 | |
| Removed |
| | 40% | 31-01-2023 |
|
|
|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
26603luoyuxia |
|
|
| | 90% | 31-01-2022 |
SQL Gateway |
|
|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29941 | | 30% | QE |
QO |
Image RemovedFLINK-27591 - Improve the plan for batch queries when statistics is unavailable OPEN | Godfrey He
| |
| FLIP Discussion | Need to be postponed to the next release | |
| 10-01-2023 |
|
|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-29668 |
---|
|
| Martijn Visser |
| Removed |
| | 100% | 14-11-2022 | 14-11-2022 | 14-11-2022 | Self-tested |
API/Python |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29155HuangXingbo 100% | 121201-2022 |
|
| Self-tested |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29833HuangXingbo | | 0% | 12-12-2022 | Ruan Hang | | Coding |
|
|
|
|
|
|
|
SQL |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
General |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
28957HuangXingbo | | 70% | 12-12-2022 | Godfrey He ,@Yunhong Zheng |
|
|
| | 100% | 2023-01-31 |
|
|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29421HuangXingbo0% | 121220222023 |
|
|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
21223HuangXingbo100% | 12122022Machine Learning |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
CEP |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
Web |
---|
|
|
|
Table API |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-30025 |
---|
|
| |
|
|
| |
| 2023-01-20 |
|
|
|
Calcite Update |
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29995 | | | ...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
Google Meet might not be the best choice for the release sync. We need to be able to invite attendees even if the creator of the meeting isn't available (maybe try Zoom or even Jitsi as an OpenSource alternative instead?)
- Release sync every 2 weeks and a switch to weekly after feature freeze felt reasonable
Slack worked well as a collaboration tool to document the monitoring tasks (#builds, #flink-dev-benchmarks) in a team with multiple release managers
The Slack Azure Pipeline bot seems to be buggy. It swallows some build failures. It's not a severe issue, though. We created #builds-debug to monitor whether it's happening consistently. The issue is covered in
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-30733 |
---|
|
We experienced occasional issues in the manual steps of the release creation in the past (e.g. japicmp config was not properly pushed). Creating Jira issues for the release helped to make the release creation more transparent and made the steps more reviewable. Additionally, it helped to distribute subtasks to different people with Jira being the tool for documentation and synchronization. That's especially helpful when there is more than one person in charge of creating the release.
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-31146 |
---|
|
- RCs
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-31154 |
---|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-31578 |
---|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-31583 |
---|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-31562 |
---|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-31567 |
---|
|
We had backports/merges without PRs happening by committers occasionally during the 1.17 release which broke master/release branches (probably, changes were done locally before merging which were not part of the PR to have a faster backport experience). It might make sense to remind everyone that this should be avoided. Not sure whether we want/can restrict that.
We observed a good response on fixing test instabilities by the end of the release cycle but had some long running issues earlier in the cycle which caused extra efforts on the release managers due to reoccurring test failures.
Release testing picked up “slowly”: Initially, we planned 2 weeks for release testing. But there was not really any progress (tickets being created and worked on) in the first week. In the end, we had to extend the phase by another week resulting in 3 instead of 2 weeks of release testing. I guess we could encourage the community to create release testing tasks earlier and label them properly to be able to monitor the effort. That would even enable us to do release testing for a certain feature after the feature is done and not necessarily only at the end of the release cycle.
- Manual test data generation is tedious (
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-31593 |
---|
|
). But this should be fixed in 1.18 with Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-27518 |
---|
|
being almost done. - We started creating documentation for release management. The goal is to collect what tasks are there to help support a Flink release to encourage newcomers to pick up the task.
...