Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Numbers are based on the items in the list below, not on the tickets 


(big grin)(tick) (green star)(star)(red star)(minus)(question)(blue star)Remaining weeks
2023-11-28
211




219
2023-12-12
311




237
2023-12-26
415




275
2024-01-09
415

1

273
2024-01-23
157214

291
2024-01-30
240214

310
2024-02-06









List

Feel free to add categories.

Runtime
Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verifiedVolunteers for testing
Shuffle


































Coordination










FLIP-379: Dynamic source parallelism inference for batch jobs
Accepted2023


(tick)
(green star)

2024-
12
01-
12
23



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-31757

 Rui Fan

 

Accepted
(green star)

(minus)
2023

2024-
12
01-
04
22



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33735

Accepted(green star)

DoneAll features are merge, it only left a little test and doc, so marking it done first.(tick)
2024-01-22
2023-12-04




FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces
(green star)

Done
(tick)
2024-01-18(tick)


FLIP-385: Add OpenTelemetryTraceReporter and OpenTelemetryMetricReporter

Piotr Nowojski 
Done


(tick)
2024-01-24(tick)


FLIP-386: Support adding custom metrics in Recovery Spans

FLIP-385: Add OpenTelemetryTraceReporter and OpenTelemetryMetricReporter

(green star)

Done


(tick)
2024-01-24(tick)


FLIP-383: Support Job Recovery for Batch Jobs
under discussion
Accepted
(minus)
2024-01-22
2023-12-12




State & Checkpoint










Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-

29844

30613




(tick)
2024-1-15



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-34190




(tick)
2024-1-24



REST




































Configuration










FLIP-366: Support standard YAML for FLINK configuration

FLIP Accepted(green star)


(tick)
2024-01-26
2023-12-12




FLINK-33712 - FLIP-391: Deprecate RuntimeContext#getExecutionConfig

FLIP Accepted(green star)


(tick)
2024-01-16
2023-12-12




FLINK-33581 - FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects



(tick)
2023Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verified

2024-
12-12SQL
01-16



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-

33397

34079


Done
(tick)
2024-01-22



SQL

Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verified
(green star)

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-

33203@Yangze

33397




(tick)
2024-01-30



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33203

@Yangze Guo




(tick)





FLIP-376: Add DISTRIBUTED BY clause
(green star)



(minus)
2024-01-30



FLIP-392: Deprecate the Legacy Group Window Aggregation

(green star)

FLINK-24024 & FLINK-20281



no new flip needed, continue the work on FLINK-24024 & FLINK-20281(tick)
2024-01-26

FLINK-24024: (tick)

FLINK-20281:  N/A



FLIP-
FLIP-
393: Make QueryOperations SQL serializable
(green star)

Done
Connectors

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-31275


(tick)
2024-01-18(tick)N/A

FLIP-387: Support named parameters for functions and call procedures

@Feng Jin

xuyang 
need documentation(tick)
2024-01-30

Fang Yong

Qingsheng Ren JiraserverASF JIRA




Jira
serverASF JIRA

serverId5aa69414-a9e9-3523-82ec-879b028fb15bkeyFLINK-26203

Leonard Xu

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33261

(green star)

columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution

serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-

25857

FLIP-371: Provide initialization context for Committer creation in TwoPhaseCommittingSink

Accepted

31830



Under discussion(minus)
2024-01-18




need documentation(tick)
2024-01-30

(tick)
Timo Walther 
Needs documentation(tick)
2024-02-05(tick)


Connectors










Jira
serverASF JIRA
serverId5aa69414

JiraserverASF JIRAserverId5aa69414

-a9e9-3523-82ec-879b028fb15b
keyFLINK-

33328FLIP-372: Allow TwoPhaseCommittingSink WithPreCommitTopology to alter the type of the Committable

31275




(minus)
2024-01-22
Under discussion




Jira
serverASF JIRA

columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolutioncolumnskey,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolutionserverId5aa69414-a9e9-3523-82ec-879b028fb15bkeyFLINK-33528

serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-26203



Pulsar connector has formal release already(tick)
2024-01-23



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33261


only left for changes in kafka connector(tick)
2024-01-22
Resource ManagementRuntime




Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-

33625Rui Fan 

25857

FLIP-371: Provide initialization context for Committer creation in TwoPhaseCommittingSink

RocMarshal

 

Done
(tick)
2023

2024-
12
01-
04Rui Fan (tick)2023-11-23

Misc

JiraserverASF JIRA
18



Jira
serverASF JIRA

serverId5aa69414-a9e9-3523-82ec-879b028fb15bkeyFLINK-33315

A series of optimizations to reduce the memory and cpu usage for large StreamOperator

columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution

serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-

33325Accepted

33972

FLIP-372: Enhance and synchronize Sink API to match the Source API

Mark it done since main part of the new api been merged (remaining tests and doc)
(tick)
2024-01-23
(green star)




Jira
serverASF JIRA

serverId5aa69414-a9e9-3523-82ec-879b028fb15bkeyFLINK-33230

(will create a FLIP)

Under discussion

Status / Follow-ups

11/14/2023

  • Is Google Meet OK for everyone?  - ok
  • The release sync meeting time, currently Europe has gone into winter time(CET, UTC+1), is 9am ok? - ok
  • Daily work divisions
    • JIRA ticket (Mainly focus on new blockers, progress of existing blockers each week) lincoln lee 
    • CI (Failures reported in #build channel and not reported) Martijn Visser 
    • Benchmark (Check if there's regression in the #flink-dev-benchmarks channel) Yun Tang 
    • Mailing list monitoring Jing Ge 
    • This division doesn't mean that other RMs are now allowed to do the work. All RMs should take responsibilities on all of these daily issues if they are available. 
  • Feature freezing date. - Jan 26, 2024, 00:00 CET(UTC+1) 
  • Retrospective of 1.18

11/28/2023

...

columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33528



(minus)





Resource Management


































Runtime


Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33625

Rui Fan RocMarshal Done
(tick)
2023-12-04



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33315

A series of optimizations to reduce the memory and cpu usage for large StreamOperator

Rui Fan 

(tick)
2023-11-23















Misc












Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-

...

33325

DONE, only docs left
(tick)
2024-01-23



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-

...

33230

(will create a FLIP)



(minus)
2024-01-23



Status / Follow-ups

11/14/2023

  • Is Google Meet OK for everyone?  - ok
  • The release sync meeting time, currently Europe has gone into winter time(CET, UTC+1), is 9am ok? - ok
  • Daily work divisions
    • JIRA ticket (Mainly focus on new blockers, progress of existing blockers each week) lincoln lee 
    • CI (Failures reported in #build channel and not reported) Martijn Visser 
    • Benchmark (Check if there's regression in the #flink-dev-benchmarks channel) Yun Tang 
    • Mailing list monitoring Jing Ge 
    • This division doesn't mean that other RMs are now allowed to do the work. All RMs should take responsibilities on all of these daily issues if they are available. 
  • Feature freezing date. - Jan 26, 2024, 00:00 CET(UTC+1) 
  • Retrospective of 1.18

11/28/2023

  • Blockers
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-25857
        discuss thread - back to ml discussion
    • documentation build failures
      Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-33544
      - closed
  • GitHub Actions Migration discussion in dev ML (FLIP-396)
  • flink-shaded driven by Sergey Nuyanzin 
  • As suggested by Xintong Song, we encourage attendees to fill out the topics a day in advance  to make it easier for everyone to understand the background of the topic. 

12/12/2023

  • Current status of 1.19 Features lincoln lee - updated
  • Existing blocker issues lincoln lee 
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-25857
        discuss thread - closed
    • Jira
      serverASF JIRA
      columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolution
      columnskey,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-33641
      (potential blocker) 

12/26/2023

  • Current status of 1.19 Features lincoln lee - updated
    • 5 weeks remaining, total 27, done 4, will make it 15
  • Existing blocker issues lincoln lee
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-33641
      has been fixed
  • Skip this sync meeting? - no response until 12/25, skipped finally

01/09/2024

  • Current status of 1.19 Features lincoln lee - updated
    • 3 weeks remaining, total 27, done 4, will make it 15, won't make it 1
  • Existing blocker issues lincoln lee
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-32978
      sergy reported a breaking change, will be fixed soon Wencong Liu
       

01/23/2024

  • Current status of 1.19 Features lincoln lee
    • Jan 26th is the planned feature freeze day, total 28, done 15, will make it 6, won't make it 4;
  • Existing blocker issues lincoln lee
  • Whether to delay feature freeze day? Yun Tang
  • Build pipeline stability
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34202
      : python stage reaches 4h timeout
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-31472
      : AsyncSinkWriterThrottlingTest  quite unstable recently
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34069
      : macos wheels build seems to be unstable (multiple open issues)
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34200
      /
      Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-33919
      : new feature

01/30/2024

  • Current status of 1.19 Features lincoln lee
  • Existing blocker issues lincoln lee
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34148
      Sergey Nuyanzin Zakelly Lan 
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34007
      Matthias Pohl
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34225
      &
      Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34233
      @yunfengzhou
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34272
  • When to cut release-1.19 branch?
  • Cross-team release testing work

02/06/2024

  • Blockers:
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34148
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34007
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34225
      &
      Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34233
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34272
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34337
      pr reviewing jiabao.sun 
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-33958
      not yet clarified whether it's a production code or test issue
  • Cut release-1.19 branch
  • fyi:
    Jira
    serverASF JIRA
    serverId5aa69414-a9e9-3523-82ec-879b028fb15b
    keyFLINK-34360
    GitHub Actions e2e tests seem to have disk space issues causing multiple test failure (not present in Azure) 
  • Cross-team release testing
    Jira
    serverASF JIRA
    serverId5aa69414-a9e9-3523-82ec-879b028fb15b
    keyFLINK-34285
     
    • total 26 flip/features, 15 confirmed,  7 not required,  4 wait for response(authors: Dawid Wysakowicz, Peter Vary, Alan Sheinberg)
    • testing instructions ready: 11  (1 completed, 3 assigned,  7 unassigned),  wait for doc ready:  2
    • more completed flips found, will update the testing ticket (done, 6 Instructions tickets added)

02/13/2024

  • Not verified Jira issues:
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34404
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34424
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34425
      Matthias Pohl 
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34427
      Matthias Pohl
  • CI instability issues:
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34273
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34202
    • Nightly build for 1.19 doesn't seem to be picked
  • Cross-team release testing
    Jira
    serverASF JIRA
    serverId5aa69414-a9e9-3523-82ec-879b028fb15b
    keyFLINK-34285
     
    • wait for response:  there's some authentication problem in current kanban dashboard,  use filter on Jira search 'project = FLINK AND type = Sub-task AND parent = FLINK-34285 AND labels is EMPTY AND status = OPEN ORDER BY updatedDate'  
    • wait for doc ready:  
      • Jira
        serverASF JIRA
        serverId5aa69414-a9e9-3523-82ec-879b028fb15b
        keyFLINK-34310
      • Jira
        serverASF JIRA
        serverId5aa69414-a9e9-3523-82ec-879b028fb15b
        keyFLINK-34305
    • testing tickets: Jira filter condition 'project = FLINK AND type = Sub-task AND parent = FLINK-34285 AND labels = release-testing ORDER BY updatedDate'

02/20/2024

  • Not verified Jira issues:
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34404
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34424
       Yunfeng Zhou 
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34425
      Matthias Pohl 
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34427
      Matthias Pohl
  • CI instability issues:
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34273
       
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34202
      @Xingbo Huang
  • Cross-team release testing
    Jira
    serverASF JIRA
    serverId5aa69414-a9e9-3523-82ec-879b028fb15b
    keyFLINK-34285
     
    • wait for response:  there's some authentication problem in current kanban dashboard,  use filter on Jira search 'project = FLINK AND type = Sub-task AND parent = FLINK-34285 AND labels is EMPTY AND status = OPEN ORDER BY updatedDate'  
    • wait for doc ready:  
      • Jira
        serverASF JIRA

12/12/2023

  • Current status of 1.19 Features lincoln lee - updated
  • Existing blocker issues lincoln lee 
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-25857
        discuss thread - closed
    • JiraserverASF JIRAcolumnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolutioncolumnskey,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution
      • serverId5aa69414-a9e9-3523-82ec-879b028fb15b
        keyFLINK-
      33641 (potential blocker) 

12/26/2023

      • 34305
    • testing tickets: Jira filter condition 'project = FLINK AND type = Sub-task AND parent = FLINK-34285 AND labels = release-testing ORDER BY updatedDate'
      • 15 total, 8 closed, 4 unassigned, 3 testing
  • When to create rc? –- after release testing finished and no blockers
  • Current status of 1.19 Features lincoln lee - updated
  • Existing blocker issues lincoln lee
  • Skip this sync meeting? - wait for response