...
...
...
...
Runtime |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
Shuffle | Jira |
---|
server | ASF JIRA |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-29766 |
---|
|
| | Xintong Song | | 40 | 12-08-2022 | Adaptive Batch Scheduler supports hybrid shuffle mode | Weijie Guo | Xintong Song | | Simplify network memory configurations for TaskManager | Yuxin Tan | Xintong Song | | Deployment & Cluster Coordination |
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
REST API |
---|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-29801 |
---|
|
| |
|
| FLIP in voting | |
|
|
|
|
|
Shuffle |
|
|
|
|
|
|
|
|
|
|
---|
Jira |
---|
server | ASF JIRA |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
27060 | | 15-11-2022 | 15-11-2022 | 15-11-2022 | Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
30185 |
AdaptiveBatchScheduler should supports early consumption for dynamic graph. | Weijie Guo |
Rui Fan | 60% | 10-12-2022 | Reactive Mode |
Scheduler |
|
|
|
|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29663Lijie WangZhu Zhu50%13Improve slow task detection | | Zhu Zhu | | 13-12-2022 | Misc |
OLAP |
State backend |
---|
Name/JIRA Issue | 12-2022Speculative Execution |
Speculative execution for sink | | | PoC done, FLIP in progress | | 10% | 13-12-2022 | 01-2023 | 17-01-2023 | 10-02-2023 | self-test |
Further improvement of production availability of hybrid shuffle | | |
|
| | 100% | 17-01-2023 | 17-01-2023 |
| self-test |
Deployment & Cluster Coordination |
Name/JIRA Issue |
---|
Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
FLIP-263: Improve resolving schema compatibilityREST API |
Jira |
---|
server | ASF JIRA |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29844Hangxiang YuYuan Mei | 20% | 13-12-2022 | Improve File Management in State Backend
| Yuan Mei
| 5% | 13-12-2022 | Improve the serializer performace of state change of changelog100% | 20-02-2023 | 15-11-2022 | 15-11-2022 | self-test |
|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-30345 |
---|
Hangxiang Yu
| | 80% | 13-12-2022 | Allow to configure Changelog Storage per program | serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-30583 |
---|
|
| | |
| The first stage is finished, and the second stage is improvement, it will be finished in the next version. | | 100% | 09-01-2023 | 05-01-2023 | 09-01-2023 |
|
Reactive Mode
|
n/a
|
Scheduler |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-29663 |
---|
|
| | |
|
| | 100% | 17-01-2022 |
|
|
|
|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolutionserverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-30725 |
---|
|
| Biao Liu | |
|
| | 100% | 31-01-2022 |
|
| Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
26372 Jira |
---|
server | ASF JIRA |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | | | | 50% | 13-12-2022 | Add a metric for back-pressure from the ChangelogStateBackend
5aa69414-a9e9-3523-82ec-879b028fb15b | key | FLINK- |
---|
|
|
24402Yanfei LeiYuan Mei40%1312-2022Frocksdb cannot run on Apple M1
Jira |
---|
server | ASF JIRA |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution01-2023 |
|
|
|
Misc |
n/a |
OLAP |
n/a |
State backend |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
FLIP-263: Improve resolving schema compatibility Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
24932Yun Tang
Yanfei LeiYun Tang 90% | 13122022Checkpoint |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
Benchmark Generic Incremental CP + UC + BD | | Yuan Mei | 2023 |
|
|
|
Improve File Management in State Backend
| | |
|
| | 5% | 31-1-2023 |
|
|
|
Improve the serializer performace of state change of changelog |
serverId | 5aa69414-a9e9-columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
26803Rui FanPiotr Nowojski70%10122022Benchmark | Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
Improve benchmark stability
|
| self-test |
Allow to configure Changelog Storage per program |
Jira |
---|
server | ASF JIRA |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
2982530%13-12-2022 | 31-1-2023 |
|
|
|
Add a metric for back-pressure from the ChangelogStateBackend Jira |
---|
server | ASF JIRA |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
|
|
API |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
Jira |
---|
server | ASF JIRA | serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29740Martijn VisserDeprecated100%081108-11-2022 | 08-11-2022 | 20222023 |
|
|
|
Frocksdb cannot run on Apple M1 |
Jira |
---|
server | ASF JIRA |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
28641Martijn Visser Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-24456 |
---|
|
| | Removed | | 40% | 08-11-2022 | | |
|
| | 100% | 30-1-2023 |
|
| |
Release FRocksDB 6.20.3-ververica-2.0 |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-18647 |
---|
| FLIP Discussion | | 13-12-2022 | columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
|
|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29668Martijn Visser | Removed | 141114-11-2022 | 14-11-2022 | Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-30050 |
---|
|
| | SQL |
2022Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
GeneralBenchmark Generic Incremental CP + UC + BD | | Yuan Mei |
|
| |
|
|
|
|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29942Godfrey Hejiraserver | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-28016 |
---|
|
| | Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-29281 |
---|
|
| Chesnay Schepler | | Calcite Update |
100% | |
|
|
|
Benchmark |
|
|
|
|
|
|
|
|
|
|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
Improve benchmark stability |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-20873 |
---|
| | columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
|
|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
21239Sergey Nuyanzinjiraserver | ASF JIRA |
---|
50% | 31-1-2023 |
|
|
|
API |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29932Sergey Nuyanzin | | |
| Deprecated |
| | 100% | 08-11-2022 | 08-11-2022 | 08-11-2022 | Self-tested |
Flink Dialect |
ALTER TABLE API |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
21634Shengkai FangHive Dialect
|
60% | CALL Syntax(PoC) | | |
| | 40% | 31-01-2023 |
|
|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29635luoyuxia60% |
|
|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29717 | |
| FLIP Discussion | Need to be postponed to the next release | |
| 10-01-2023 |
|
|
|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
26603luoyuxiaSQL Gateway Jira |
---|
100% | 14-11-2022 | 14-11-2022 | 14-11-2022 | Self-tested |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29941 | | 30% | QE |
QO |
Image RemovedFLINK-27591 - Improve the plan for batch queries when statistics is unavailable OPEN | Godfrey He
| |
|
|
|
| | 90% | 31-01-2022 |
|
| Self-tested |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-25509 |
---|
|
| Ruan Hang | | Coding |
|
|
|
|
|
|
|
SQL |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer |
---|
API/Python |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
General |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29155HuangXingbo 1212202231 |
|
|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29833HuangXingbo0% | 121220222023 |
|
|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
28957HuangXingbo70% | 1212-202201-2023 |
|
|
|
Table API |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29421HuangXingbo0% | 1212-202201-20 |
|
|
|
Calcite Update |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
21223HuangXingbo100% | 12-12-2022 |
|
|
|
|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-21239 |
---|
|
| |
|
|
| |
|
|
|
|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-29932 |
---|
|
| Sergey Nuyanzin |
|
|
| |
| 31-01-2023 |
|
|
|
Flink Dialect |
ALTER TABLE API Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-21634 |
---|
|
| |
|
|
| | 100% | 2023-02-14 |
|
| self-tested |
Machine Learning |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
CEP |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
---|
Web |
---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK- |
---|
|
|
29995 | Yun Tang | ...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
Google Meet might not be the best choice for the release sync. We need to be able to invite attendees even if the creator of the meeting isn't available (maybe try Zoom or even Jitsi as an OpenSource alternative instead?)
- Release sync every 2 weeks and a switch to weekly after feature freeze felt reasonable
Slack worked well as a collaboration tool to document the monitoring tasks (#builds, #flink-dev-benchmarks) in a team with multiple release managers
The Slack Azure Pipeline bot seems to be buggy. It swallows some build failures. It's not a severe issue, though. We created #builds-debug to monitor whether it's happening consistently. The issue is covered in
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-30733 |
---|
|
We experienced occasional issues in the manual steps of the release creation in the past (e.g. japicmp config was not properly pushed). Creating Jira issues for the release helped to make the release creation more transparent and made the steps more reviewable. Additionally, it helped to distribute subtasks to different people with Jira being the tool for documentation and synchronization. That's especially helpful when there is more than one person in charge of creating the release.
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-31146 |
---|
|
- RCs
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-31154 |
---|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-31578 |
---|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-31583 |
---|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-31562 |
---|
|
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-31567 |
---|
|
We had backports/merges without PRs happening by committers occasionally during the 1.17 release which broke master/release branches (probably, changes were done locally before merging which were not part of the PR to have a faster backport experience). It might make sense to remind everyone that this should be avoided. Not sure whether we want/can restrict that.
We observed a good response on fixing test instabilities by the end of the release cycle but had some long running issues earlier in the cycle which caused extra efforts on the release managers due to reoccurring test failures.
Release testing picked up “slowly”: Initially, we planned 2 weeks for release testing. But there was not really any progress (tickets being created and worked on) in the first week. In the end, we had to extend the phase by another week resulting in 3 instead of 2 weeks of release testing. I guess we could encourage the community to create release testing tasks earlier and label them properly to be able to monitor the effort. That would even enable us to do release testing for a certain feature after the feature is done and not necessarily only at the end of the release cycle.
- Manual test data generation is tedious (
Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-31593 |
---|
|
). But this should be fixed in 1.18 with Jira |
---|
server | ASF JIRA |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
key | FLINK-27518 |
---|
|
being almost done. - We started creating documentation for release management. The goal is to collect what tasks are there to help support a Flink release to encourage newcomers to pick up the task.