You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 56 Next »

Table of contents

Jira Boards

Flink 1.17 Burndown: https://issues.apache.org/jira/secure/RapidBoard.jspa?rapidView=572

Sync meeting

The sync meeting is happening every second Tuesday starting on the 1st of November 2022 at 9am CEST / 4pm China Standard Time / 8am UTC. 
As we are getting closer to the feature freeze we will do the meeting on a weekly base.


Feel free to join on Google Meet. Local dial-in numbers can be found at https://tel.meet/wcx-fjbt-hhz?pin=1940846765126

Timeline

Feature Freeze
January, 17th of 2023, end of business CEST. 

Release
Mid of March 2023

Highlight features

please feel free to add/suggest.

Features

List of features announced by contributors and committers that are likely to be ready for the feature freeze:n

NOTICE: It's preferred if only new features end up there and not all bugs/tasks separately, so that the page is not over bloated. Of course, unless fixing a bug is a really big or important one equivalent to implementing a completely new feature. A good rule of thumb would be that each entry in the page could (but does not have to) be later on included in a release blog post.

Legend

State

symbolmeaningcomment
(big grin)validatedthrough cross team testing
(tick)donewell documented with a complete test coverage
(green star)will make itthere is no reason this effort should not go into 1.17
(star)in dangerthere are some concerns the effort could be ready for the feature freeze of 1.17
(red star)very unlikelythere are severe concerns the effort could make it to 1.17
(minus)won't make itit was decided against adding this for the 1.17 release. working on the effort has been stopped.
(question)state unclear
(blue star)independentas the artefact could be released independent of Apache Flink

X-Team verification

symbolmeaning
(tick)done
(blue star)not required

Feature Stage

Please align with the list on the Apache Flink Roadmap (https://flink.apache.org/roadmap.html).

  • MVP: Have a look, consider whether this can help you in the future.
  • Beta: You can benefit from this, but you should carefully evaluate the feature.
  • Ready and Evolving: Ready to use in production, but be aware you may need to make some adjustments to your application and setup in the future, when you upgrade Flink.
  • Stable: Unrestricted use in production
  • Reaching End-of-Life: Stable, still feel free to use, but think about alternatives. Not a good match for new long-lived projects.
  • Deprecated: Start looking for alternatives now 

Summary

Numbers are based on the items in the list below, not on the tickets 


(tick) (green star) (star)(red star)(minus)(question)(blue star)∑Remaining weeks
2022-11-01







11
2022-11-15







0
2022-11-29410000230377
2022-12-13







5
2022-12-27







3
2023-01-03







2
2023-01-10







1
2023-01-17







0

List

Feel free to add categories.

Runtime
Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verified

































Shuffle









Unable to render Jira issues macro, execution error.

Weijie Guo 

Xintong Song 

(green star)4012-08-2022


Adaptive Batch Scheduler supports hybrid shuffle modeWeijie Guo Xintong Song 

(minus)




Simplify network memory configurations for TaskManagerYuxin Tan Xintong Song 

(green star)















Deployment & Cluster Coordination
Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verified
REST API

Unable to render Jira issues macro, execution error.

ConradJam 




(tick)
15-11-202215-11-202215-11-2022

Unable to render Jira issues macro, execution error.

Rui Fan 

Xintong Song



(green star)60%10-12-2022


Reactive Mode











Scheduler

Unable to render Jira issues macro, execution error.

Lijie Wang 

Zhu Zhu 



(question)




Speculative Execution
Speculative execution for sink

Lijie Wang 

Zhu Zhu 



(question)




Improve slow task detection 

Lijie Wang 

Zhu Zhu 

(question)


























Misc

































OLAP






















State backend
Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verified

FLIP-263: Improve resolving schema compatibility

Unable to render Jira issues macro, execution error.

Hangxiang Yu 

Yuan Mei 



(question)




Improve File Management in State Backend

Zakelly Lan 

Yanfei Lei 

Han Yin

Yuan Mei




(question)




Allow to configure Changelog Storage per program

Unable to render Jira issues macro, execution error.

Roman Khachatryan

Yanfei Lei  

Hangxiang Yu 

Yuan Mei 



(question)




Add a metric for back-pressure from the ChangelogStateBackend

Unable to render Jira issues macro, execution error.

Yanfei Lei 

Yuan Mei 



(question)




Add a metric for back-pressure from the ChangelogStateBackend

Unable to render Jira issues macro, execution error.

Yun Tang 

Yanfei Lei 

Yuan Mei 

Yun Tang 



(question)




Checkpoint
Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verified
Benchmark Generic Incremental CP + UC + BD

Rui xia

Yanfei Lei 

Hangxiang Yu 

Yuan Mei 

(question)




Unable to render Jira issues macro, execution error.

Rui Fan 

Piotr Nowojski 



(green star)70%10-12-2022


Benchmark









Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verified

Improve benchmark stability

Unable to render Jira issues macro, execution error.

Yanfei Lei 

Yuan Mei 

(question)

















































































API
Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verified

Unable to render Jira issues macro, execution error.

Martijn Visser 


Deprecated
(tick)100%08-11-202208-11-202208-11-2022

Unable to render Jira issues macro, execution error.

Martijn Visser 


Removed
(green star)40%08-11-2022


Unable to render Jira issues macro, execution error.





(question)




Unable to render Jira issues macro, execution error.

Yun Gao 


FLIP Discussion
(question)




Unable to render Jira issues macro, execution error.

Martijn Visser 
Removed
(tick)100%14-11-202214-11-202214-11-2022

Unable to render Jira issues macro, execution error.





(question)




SQL
Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verified
General

Unable to render Jira issues macro, execution error.

Godfrey He Jark Wu 




(question)




Unable to render Jira issues macro, execution error.

Chesnay Schepler 




(green star)




Unable to render Jira issues macro, execution error.

Chesnay Schepler 


(green star)




Calcite Update

Unable to render Jira issues macro, execution error.

Sergey Nuyanzin 




(tick)




Unable to render Jira issues macro, execution error.

Sergey Nuyanzin 




(green star)















Flink Dialect
Supports datalake-related APIs (e.g., ALTER TABLE, UPDATE/DELETE, TimeTravel, Procedure, query metadata)

Shengkai Fang 




(question)















Hive Dialect

Unable to render Jira issues macro, execution error.

luoyuxia 




(question)




Unable to render Jira issues macro, execution error.

ron liu 




(question)




Unable to render Jira issues macro, execution error.

luoyuxia 




(question)




SQL Gateway

Unable to render Jira issues macro, execution error.

Shengkai Fang  , Zelin Yu




(question)















QE



































































































QO

FLINK-27591 - Improve the plan for batch queries when statistics is unavailable OPEN

Godfrey He 





(green star)







































































































API/Python
Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verified

Unable to render Jira issues macro, execution error.

HuangXingbo 


(tick)100%12-12-2022


Unable to render Jira issues macro, execution error.

HuangXingbo 


(green star)0%12-12-2022


Unable to render Jira issues macro, execution error.

HuangXingbo 


(green star)70%12-12-2022


Unable to render Jira issues macro, execution error.

HuangXingbo 


(green star)0%12-12-2022


Unable to render Jira issues macro, execution error.

HuangXingbo 


(tick)100%12-12-2022


Machine Learning
Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verified











CEP
Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verified












































Web
Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verified

Unable to render Jira issues macro, execution error.

Yu Chen

Yun Tang 



(question)
















































Status / Follow-ups

2022-11-01

Agenda

  • Kickoff
  • Keeping the state of features updated (ideally before the sync)
  • Blockers
    • Unable to render Jira issues macro, execution error.
  • Build stability
  • Are there any (new) contributors who need a PR reviewed or merged? And if yes, who can help out?

2022-11-15

Agenda

  • Kickoff
  • Keeping the state of features updated (ideally before the sync)
  • Blockers
    • Unable to render Jira issues macro, execution error.
    • Unable to render Jira issues macro, execution error.
    • Unable to render Jira issues macro, execution error.
  • Build stability
    • Number of growing test stability issues with "Exit code 137 errors"
      • Unable to render Jira issues macro, execution error.
      • Unable to render Jira issues macro, execution error.
      • Unable to render Jira issues macro, execution error.
  • Are there any (new) contributors who need a PR reviewed or merged? And if yes, who can help out?

2022-11-29

  • Build instabilities
    • Unable to render Jira issues macro, execution error. : Anton has some new findings on that issue and will get back on it
    • Pulsar-related issues:
      • Unable to render Jira issues macro, execution error.
      • Unable to render Jira issues macro, execution error.
      • Unable to render Jira issues macro, execution error.
    • Python-related issues:
    • Unable to render Jira issues macro, execution error. : OOM errors are most likely being caused by flink-table-planner (Godfrey He might be a person to reach out to about it)
    • Unable to render Jira issues macro, execution error. : Qingsheng Ren will look into the PR
    • Unable to render Jira issues macro, execution error. Matthias Pohl will ping contributors on the issue - but it's not that urgent since it's not failing that frequently 
  • Other topics:
    • Externalizing Pulsar connector (test instabilities): Martijn Visser  is working on externalizing the code base
    • Performance test monitoring: Discussion is happening on the mailing list
    • Externalizing connectors in general is work-in-progress but looks good
    • Public CI documentation can be improved
  • No labels