Table of contents
Jira Boards
Flink 1.17 Burndown: https://issues.apache.org/jira/secure/RapidBoard.jspa?rapidView=572
Sync meeting
The sync meeting is happening every second Tuesday starting on the 1st of November 2022 at 9am CEST / 4pm China Standard Time / 8am UTC.
As we are getting closer to the feature freeze we will do the meeting on a weekly base.
Feel free to join on Google Meet. Local dial-in numbers can be found at https://tel.meet/wcx-fjbt-hhz?pin=1940846765126
Timeline
Feature Freeze
January, 17th of 2023, end of business CEST.
Release
Mid of March 2023
Highlight features
please feel free to add/suggest.
Features
List of features announced by contributors and committers that are likely to be ready for the feature freeze:n
NOTICE: It's preferred if only new features end up there and not all bugs/tasks separately, so that the page is not over bloated. Of course, unless fixing a bug is a really big or important one equivalent to implementing a completely new feature. A good rule of thumb would be that each entry in the page could (but does not have to) be later on included in a release blog post.
Legend
State
symbol | meaning | comment |
---|---|---|
validated | through cross team testing | |
done | well documented with a complete test coverage | |
will make it | there is no reason this effort should not go into 1.17 | |
in danger | there are some concerns the effort could be ready for the feature freeze of 1.17 | |
very unlikely | there are severe concerns the effort could make it to 1.17 | |
won't make it | it was decided against adding this for the 1.17 release. working on the effort has been stopped. | |
state unclear | ||
independent | as the artefact could be released independent of Apache Flink |
X-Team verification
symbol | meaning |
---|---|
done | |
not required |
Feature Stage
Please align with the list on the Apache Flink Roadmap (https://flink.apache.org/roadmap.html).
- MVP: Have a look, consider whether this can help you in the future.
- Beta: You can benefit from this, but you should carefully evaluate the feature.
- Ready and Evolving: Ready to use in production, but be aware you may need to make some adjustments to your application and setup in the future, when you upgrade Flink.
- Stable: Unrestricted use in production
- Reaching End-of-Life: Stable, still feel free to use, but think about alternatives. Not a good match for new long-lived projects.
- Deprecated: Start looking for alternatives now
Summary
Numbers are based on the items in the list below, not on the tickets
∑ | Remaining weeks | ||||||||
2022-11-01 | 11 | ||||||||
2022-11-15 | 09 | ||||||||
2022-11-29 | 07 |
List
Feel free to add categories.
Runtime | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
Shuffle | ||||||||||
Xintong Song | ||||||||||
Adaptive Batch Scheduler supports hybrid shuffle mode | Weijie Guo | Xintong Song | ||||||||
Simplify network memory configurations for TaskManager | Yuxin Tan | Xintong Song | ||||||||
Deployment & Cluster Coordination | ||||||||||
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | Updated | Implemented | Documented | X-team verified | |
REST API | ||||||||||
| ||||||||||
Reactive Mode | ||||||||||
Scheduler | ||||||||||
| ||||||||||
Speculative Execution | ||||||||||
Speculative execution for sink | ||||||||||
Improve slow task detection | Zhu Zhu | |||||||||
Misc | ||||||||||
OLAP | ||||||||||
State backend | ||||||||||
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
FLIP-263: Improve resolving schema compatibility
| Hangxiang Yu | |||||||||
Improve File Management in State Backend | ||||||||||
Allow to configure Changelog Storage per program
| ||||||||||
Add a metric for back-pressure from the ChangelogStateBackend
| ||||||||||
Add a metric for back-pressure from the ChangelogStateBackend
| ||||||||||
Checkpoint | ||||||||||
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
Benchmark Generic Incremental CP + UC + BD | Yuan Mei | |||||||||
Benchmark | ||||||||||
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
Improve benchmark stability
| Yuan Mei | |||||||||
API | ||||||||||
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
| Deprecated | 100% | 08-11-2022 | 08-11-2022 | 08-11-2022 | |||||
| Removed | 40% | 08-11-2022 | |||||||
| ||||||||||
FLIP Discussion | ||||||||||
| Martijn Visser | Removed | 100% | 14-11-2022 | 14-11-2022 | 14-11-2022 | ||||
SQL | ||||||||||
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
General | ||||||||||
| ||||||||||
Calcite Update | ||||||||||
| ||||||||||
| ||||||||||
Flink Dialect | ||||||||||
Supports datalake-related APIs (e.g., ALTER TABLE, UPDATE/DELETE, TimeTravel, Procedure, query metadata) | ||||||||||
Hive Dialect | ||||||||||
| ||||||||||
| ||||||||||
| ||||||||||
SQL Gateway | ||||||||||
| Shengkai Fang , Zelin Yu | |||||||||
QE | ||||||||||
QO | ||||||||||
FLINK-27591 - Improve the plan for batch queries when statistics is unavailable OPEN | ||||||||||
API/Python | ||||||||||
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
| HuangXingbo | |||||||||
| HuangXingbo | |||||||||
| HuangXingbo | |||||||||
| HuangXingbo | |||||||||
| HuangXingbo | |||||||||
Machine Learning | ||||||||||
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
CEP | ||||||||||
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
Web | ||||||||||
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified |
| ||||||||||
Status / Follow-ups
2022-11-01
Agenda
- Kickoff
- Keeping the state of features updated (ideally before the sync)
- Blockers
- Build stability
- Are there any (new) contributors who need a PR reviewed or merged? And if yes, who can help out?
2022-11-15
Agenda
- Kickoff
- Keeping the state of features updated (ideally before the sync)
- Blockers
- Build stability
- Number of growing test stability issues with "Exit code 137 errors"
- Number of growing test stability issues with "Exit code 137 errors"
- Are there any (new) contributors who need a PR reviewed or merged? And if yes, who can help out?