Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Numbers are based on the items in the list below, not on the tickets 


(big grin)(tick) (green star)(star)(red star)(minus)(question)(blue star)Remaining weeks
2023-11-28
211




219
2023-12-12
311
22





237
2023-12-26
415




275
2024-01-09
415

1

273
2024-01-23
157214

291
2024-01-30
240214

310
2024-02-06









List

Feel free to add categories.

Runtime
Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verifiedVolunteers for testing
Shuffle


































Coordination










FLIP-379: Dynamic source parallelism inference for batch jobs
under discussion


(tick)
2023

2024-
11
01-
14Rui Fan
23



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-31757

 
Accepted
(green star)

(minus)
2023

2024-
12
01-
04
22



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33735

Accepted(green star)

DoneAll features are merge, it only left a little test and doc, so marking it done first.(tick)
2024-01-22
2023-12-04




FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces
(green star)


Done
(tick)
2024-01-18(tick)


FLIP-385: Add OpenTelemetryTraceReporter and OpenTelemetryMetricReporter

Piotr Nowojski 
Done


(tick)
2024-01-24(tick)


FLIP-386: Support adding custom metrics in Recovery Spans

(green star)


Done


(tick)
2024-01-24(tick)


FLIP-383: Support Job Recovery for Batch JobsAccepted
under discussion

(minus)
2023

2024-
11
01-
14
22



State & Checkpoint










Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-

29844

30613




(tick)
2024-1-15



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-34190




(tick)
2024-1-24



REST




































Configuration










FLIP-366: Support standard YAML for FLINK configuration



(tick)
2024-01-26



FLINK-33712 - FLIP-391: Deprecate RuntimeContext#getExecutionConfig



(tick)
2024-01-16



FLINK-33581 - FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

 In development(green star)

 



(tick)
2024-01-16



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-34079


Done
(tick)
2024-01-22
2023-11-14




SQL

Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verified

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33397

(green star)



(tick)
2024-01-30



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33203

@Yangze Guo




(tick)





FLIP-376: Add DISTRIBUTED BY clause
(green star)



(minus)
2024-01-30



FLIP-392: Deprecate the Legacy Group Window Aggregation

FLINK-24024 & FLINK-20281

(green star)


no new flip needed, continue the work on FLINK-24024 & FLINK-20281(tick)
2024-01-26

FLINK-24024: (tick)

FLINK-20281:  N/A



FLIP-393: Make QueryOperations SQL serializable
Done
(tick)
2024-01-18(tick)N/A

FLIP-387: Support named parameters for functions and call procedures

@Feng Jin

xuyang 
(green star)

need documentation(tick)
2024-01-30



Jira
serverASF JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-31830



Under discussion(minus)
2024-01-18




need documentation(tick)
2024-01-30

(tick)
Timo Walther 
Needs documentation(tick)
2024-02-05(tick)


Connectors










Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-31275




(minus)
2024-01-22



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-26203



Pulsar connector has formal release already(tick)
2024-01-23



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33261

(green star)


only left for changes in kafka connector(tick)
2024-01-22



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-25857

FLIP-371: Provide initialization context for Committer creation in TwoPhaseCommittingSink

Accepted
Done
(tick)
2024-01-18



Jira
serverASF JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-

33328

33972

FLIP-372:

Allow TwoPhaseCommittingSink WithPreCommitTopology to alter the type of the Committable

Enhance and synchronize Sink API to match the Source API

 Under discussion

 

Mark it done since main part of the new api been merged (remaining tests and doc)
(tick)
2024-01-23



Jira
serverASF JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33528



(minus)





Resource Management


































Runtime


Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33625

Rui Fan RocMarshal Done
(tick)
2023-12-04



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33315

A series of optimizations to reduce the memory and cpu usage for large StreamOperator

Rui Fan 

(tick)
2023-11-23















Misc












Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33325

Accepted

DONE, only docs left
(tick)
2024-01-23
(green star)




Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33230

(will create a FLIP)

Under discussion



(minus)
2024-01-23



Status / Follow-ups

11/14/2023

...

  • Blockers
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-25857
        discuss thread - back to ml discussion
    • documentation build failures
      Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-33544
      - closed
  • GitHub Actions Migration discussion in dev ML (FLIP-396)
  • flink-shaded driven by Sergey Nuyanzin 
  • As suggested by Xintong Song, we encourage attendees to fill out the topics a day in advance  to make it easier for everyone to understand the background of the topic. 

12/12/2023

  • Current status of 1.19 Features lincoln lee - updated
  • Existing blocker issues lincoln lee 
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-25857
        discuss thread - closed
    • Jira
      serverASF JIRA
      columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolution
      columnskey,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-33641
      (potential blocker) 

12/26/2023

  • Current status of 1.19 Features lincoln lee - updated
    • 5 weeks remaining, total 27, done 4, will make it 15
  • Existing blocker issues lincoln lee
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-33641
      has been fixed
  • Skip this sync meeting? - no response until 12/25, skipped finally

01/09/2024

  • Current status of 1.19 Features lincoln lee - updated
    • 3 weeks remaining, total 27, done 4, will make it 15, won't make it 1
  • Existing blocker issues lincoln lee
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-32978
      sergy reported a breaking change, will be fixed soon Wencong Liu
       

01/23/2024

  • Current status of 1.19 Features lincoln lee
    • Jan 26th is the planned feature freeze day, total 28, done 15, will make it 6, won't make it 4;
  • Existing blocker issues lincoln lee
  • Whether to delay feature freeze day? Yun Tang
  • Build pipeline stability
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34202
      : python stage reaches 4h timeout
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-31472
      : AsyncSinkWriterThrottlingTest  quite unstable recently
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34069
      : macos wheels build seems to be unstable (multiple open issues)
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34200
      /
      Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-33919
      : new feature

01/30/2024

  • Current status of 1.19 Features lincoln lee
  • Existing blocker issues lincoln lee
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34148
      Sergey Nuyanzin Zakelly Lan 
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34007
      Matthias Pohl
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34225
      &
      Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34233
      @yunfengzhou
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34272
  • When to cut release-1.19 branch?
  • Cross-team release testing work

02/06/2024

  • Blockers:
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34148
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34007
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34225
      &
      Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34233
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34272
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34337
      pr reviewing jiabao.sun 
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-33958
      not yet clarified whether it's a production code or test issue
  • Cut release-1.19 branch
  • fyi:
    Jira
    serverASF JIRA
    serverId5aa69414-a9e9-3523-82ec-879b028fb15b
    keyFLINK-34360
    GitHub Actions e2e tests seem to have disk space issues causing multiple test failure (not present in Azure) 
  • Cross-team release testing
    Jira
    serverASF JIRA
    serverId5aa69414-a9e9-3523-82ec-879b028fb15b
    keyFLINK-34285
     
    • total 26 flip/features, 15 confirmed,  7 not required,  4 wait for response(authors: Dawid Wysakowicz, Peter Vary, Alan Sheinberg)
    • testing instructions ready: 11  (1 completed, 3 assigned,  7 unassigned),  wait for doc ready:  2
    • more completed flips found, will update the testing ticket (done, 6 Instructions tickets added)

02/13/2024

  • Not verified Jira issues:
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34404
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34424
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34425
      Matthias Pohl 
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34427
      Matthias Pohl
  • CI instability issues:
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34273
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34202
    • Nightly build for 1.19 doesn't seem to be picked
  • Cross-team release testing
    Jira
    serverASF JIRA
    serverId5aa69414-a9e9-3523-82ec-879b028fb15b
    keyFLINK-34285
     
    • wait for response:  there's some authentication problem in current kanban dashboard,  use filter on Jira search 'project = FLINK AND type = Sub-task AND parent = FLINK-34285 AND labels is EMPTY AND status = OPEN ORDER BY updatedDate'  
    • wait for doc ready:  
      • Jira
        serverASF JIRA
        serverId5aa69414-a9e9-3523-82ec-879b028fb15b
        keyFLINK-34310
      • Jira
        serverASF JIRA
        serverId5aa69414-a9e9-3523-82ec-879b028fb15b
        keyFLINK-34305
    • testing tickets: Jira filter condition 'project = FLINK AND type = Sub-task AND parent = FLINK-34285 AND labels = release-testing ORDER BY updatedDate'

02/20/2024

  • Not verified Jira issues:
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34404
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34424
       Yunfeng Zhou 
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34425
      Matthias Pohl 
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34427
      Matthias Pohl
  • CI instability issues:
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34273
       
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34202
      @Xingbo Huang
  • Cross-team release testing
    Jira
    serverASF JIRA
    serverId5aa69414-a9e9-3523-82ec-879b028fb15b
    keyFLINK-34285
     
    • wait for response:  there's some authentication problem in current kanban dashboard,  use filter on Jira search 'project = FLINK AND type = Sub-task AND parent = FLINK-34285 AND labels is EMPTY AND status = OPEN ORDER BY updatedDate'  
    • wait for doc ready:  
      • Jira
        serverASF JIRA
        serverId5aa69414-a9e9-3523-82ec-879b028fb15b
        keyFLINK-34305
    • testing tickets: Jira filter condition 'project = FLINK AND type = Sub-task AND parent = FLINK-34285 AND labels = release-testing ORDER BY updatedDate'
      • 15 total, 8 closed, 4 unassigned, 3 testing
  • When to create rc? –- after release testing finished and no blockers