Table of contents
Jira Boards
Flink 1.19 Burndown: 1.19 Burndown - Agile Board - ASF JIRA (apache.org)
Sync meeting
- The release sync will start from Nov 14th, 2023, at 9am (CET, UTC+1) and 4pm (UTC+8). The release sync happens bi-weekly at first, and will be adjusted to weekly as we approaching the feature freeze date.
- Feel free to join on Google Meet, and attendees are encouraged to fill out the topics to be discussed at the bottom of this page a day in advance to make it easier for everyone to understand the background of the topic.
Timeline
- Feature Freeze
- Jan 26, 2024, 00:00 CET(UTC+1)
- Release
- End of Feb 2024
Highlight features
please feel free to add/suggest.
Features
List of features announced by contributors and committers that are likely to be ready for the feature freeze:n
NOTICE: It's preferred if only new features end up there and not all bugs/tasks separately, so that the page is not over bloated. Of course, unless fixing a bug is a really big or important one equivalent to implementing a completely new feature. A good rule of thumb would be that each entry in the page could (but does not have to) be later on included in a release blog post.
Legend
State
symbol | meaning | comment |
---|---|---|
validated | through cross team testing | |
done | well documented with a complete test coverage | |
will make it | there is no reason this effort should not go into 1.19 | |
in danger | there are some concerns the effort could be ready for the feature freeze of 1.19 | |
very unlikely | there are severe concerns the effort could make it to 1.19 | |
won't make it | it was decided against adding this for the 1.19 release. working on the effort has been stopped. | |
state unclear | ||
independent | as the artifact could be released independent of Apache Flink |
X-Team verification
symbol | meaning |
---|---|
done | |
not required |
Feature Stage
Please align with the list on the Apache Flink Roadmap (https://flink.apache.org/roadmap.html).
- MVP: Have a look, consider whether this can help you in the future.
- Beta: You can benefit from this, but you should carefully evaluate the feature.
- Ready and Evolving: Ready to use in production, but be aware you may need to make some adjustments to your application and setup in the future, when you upgrade Flink.
- Stable: Unrestricted use in production
- Reaching End-of-Life: Stable, still feel free to use, but think about alternatives. Not a good match for new long-lived projects.
- Deprecated: Start looking for alternatives now
Summary
Numbers are based on the items in the list below, not on the tickets
∑ | Remaining weeks | |||||||||
2023-11-28 | 2 | 11 | 21 | 9 | ||||||
2023-12-12 | 3 | 11 | 23 | 7 | ||||||
2023-12-26 | 5 | |||||||||
2024-01-09 | 3 | |||||||||
2024-01-23 | 1 |
List
Feel free to add categories.
Runtime | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified | Volunteers for testing |
Shuffle | |||||||||||
Coordination | |||||||||||
FLIP-379: Dynamic source parallelism inference for batch jobs | Accepted | 2023-12-12 | |||||||||
| Accepted | 2023-12-04 | |||||||||
| Accepted | 2023-12-04 | |||||||||
FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces | |||||||||||
FLIP-385: Add OpenTelemetryTraceReporter and OpenTelemetryMetricReporter | Piotr Nowojski | ||||||||||
FLIP-383: Support Job Recovery for Batch Jobs | under discussion | 2023-12-12 | |||||||||
State & Checkpoint | |||||||||||
| |||||||||||
REST | |||||||||||
Configuration | |||||||||||
FLIP-366: Support standard YAML for FLINK configuration | FLIP Accepted | 2023-12-12 | |||||||||
FLINK-33712 - FLIP-391: Deprecate RuntimeContext#getExecutionConfig | FLIP Accepted | 2023-12-12 | |||||||||
FLINK-33581 - FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects | 2023-12-12 | ||||||||||
SQL | |||||||||||
Name/JIRA Issue | Responsible Contributor | Reviewer / committer available | Feature Stage | Note | State | % | Updated | Implemented | Documented | X-team verified | |
| |||||||||||
| @Yangze Guo | ||||||||||
FLIP-376: Add DISTRIBUTED BY clause | |||||||||||
FLIP-392: Deprecate the Legacy Group Window Aggregation | |||||||||||
FLIP-393: Make QueryOperations SQL serializable | |||||||||||
Connectors | |||||||||||
| |||||||||||
| |||||||||||
| |||||||||||
FLIP-371: Provide initialization context for Committer creation in TwoPhaseCommittingSink | Accepted | ||||||||||
| Under discussion | ||||||||||
| |||||||||||
Resource Management | |||||||||||
Runtime | |||||||||||
| Rui Fan | RocMarshal | Done | 2023-12-04 | |||||||
A series of optimizations to reduce the memory and cpu usage for large StreamOperator | Rui Fan | 2023-11-23 | |||||||||
Misc | |||||||||||
| Accepted | ||||||||||
(will create a FLIP) | Under discussion |
Status / Follow-ups
11/14/2023
- Is Google Meet OK for everyone? - ok
- The release sync meeting time, currently Europe has gone into winter time(CET, UTC+1), is 9am ok? - ok
- Daily work divisions
- JIRA ticket (Mainly focus on new blockers, progress of existing blockers each week) lincoln lee
- CI (Failures reported in #build channel and not reported) Martijn Visser
- Benchmark (Check if there's regression in the #flink-dev-benchmarks channel) Yun Tang
- Mailing list monitoring Jing Ge
- This division doesn't mean that other RMs are now allowed to do the work. All RMs should take responsibilities on all of these daily issues if they are available.
- Feature freezing date. - Jan 26, 2024, 00:00 CET(UTC+1)
- Retrospective of 1.18
11/28/2023
- Blockers
- discuss thread - back to ml discussion
- documentation build failures - closed
- GitHub Actions Migration discussion in dev ML (FLIP-396)
- flink-shaded driven by Sergey Nuyanzin
- As suggested by Xintong Song, we encourage attendees to fill out the topics a day in advance to make it easier for everyone to understand the background of the topic.
12/12/2023
- Current status of 1.19 Features lincoln lee - updated
- Existing blocker issues lincoln lee
- discuss thread - pr ready