Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...


(big grin)(tick) (green star)(star)(red star)(minus)(question)(blue star)Remaining weeks
2023-11-28
211




219
2023-12-12
311




237
2023-12-26
415




275
2024-01-09
415

1

273
2024-01-23
157214

291
2024-01-30
240214

310
2024-02-06









List

Feel free to add categories.

RESTLeonard XuRuntime2023-12-04
Runtime
Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verifiedVolunteers for testing
Shuffle


































Coordination










FLIP-379: Dynamic source parallelism inference for batch jobs

(green star)(tick)
2024-01-1623



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-31757

Accepted
(green star)(minus)
20232024-1201-0422



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33735

Accepted(green star)DoneAll features are merge, it only left a little test and doc, so marking it done first.(tick)
2024-01-222023-12-04



FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces
AcceptedDone
(green star)(tick)
20232024-1201-2618(tick)


FLIP-385: Add OpenTelemetryTraceReporter and OpenTelemetryMetricReporter

Piotr Nowojski 
AcceptedDone


(green star)(tick)
20232024-1201-2624(tick)


FLIP-

383

386: Support adding custom metrics in Recovery Spans


Done


(tick)
2024-01-24(tick)


FLIP-383: Support Job Recovery for Job Recovery for Batch JobsAccepted
(star)(minus)
2024-01-1622



State & Checkpoint










Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-30613




(tick)
2024-1-15



Jira

Configuration

serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-34190




(tick)
2024-1-24



REST




































Configuration










FLIP-366: Support standard YAML for FLINK configuration



(tick)
2024-01-26

FLIP-366: Support standard YAML for FLINK configuration

(green star)2024-01-16



FLINK-33712 - FLIP-391: Deprecate RuntimeContext#getExecutionConfig



(tick)
2024-01-16



FLINK-33581 - FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects



(tick)
2024-01-16



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-34079


FLIP AcceptedDone
(green star)(tick)
2024-101-1522



SQL

Name/JIRA IssueResponsible ContributorReviewer / committer availableFeature StageNoteState%UpdatedImplementedDocumentedX-team verified

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33397

(green star)




(tick)
2024-01-30



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33203

@Yangze Guo




(tick)





FLIP-376: Add DISTRIBUTED BY clause(green star)


(minus)
2024-01-30



FLIP-392: Deprecate the Legacy Group Window Aggregation

FLINK-24024 & FLINK-20281



 no no new flip needed, continue the work on on FLINK-24024 & FLINK-20281(green star)(tick)
2024-1-9-01-26

FLINK-24024: (tick)

FLINK-20281:  N/A



FLIP-393: Make QueryOperations SQL serializable
Done
(tick)
2024-01-18(tick)N/A

FLIP-387: Support named parameters for functions and call procedures

@Feng Jin

xuyang 
Reviewingneed documentation(green star)(tick)
2024-01-1830



Jira
serverASF JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-31830



Under discussion(minus)
2024-01-18




need documentation(tick)
2024-01-30

(tick)
Timo Walther 
Needs documentation(tick)
2024-02-05(tick)


ConnectorsConnectors

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-31275

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-26203












Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33261

31275




(minus)
2024-01-22(green star)



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-25857

FLIP-371: Provide initialization context for Committer creation in TwoPhaseCommittingSink

Done

26203



Pulsar connector has formal release already(tick)
2024-01-1823



Jira
serverASF JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33261


only left for changes in kafka connector(tick)
2024-01-22



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-3397225857

FLIP-372: Enhance and synchronize Sink API to match the Source API371: Provide initialization context for Committer creation in TwoPhaseCommittingSink

FLIP AcceptedDone
(tick)
2024-01-18



Jira
Jira
serverASF JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-3352833972

FLIP-372: Enhance and synchronize Sink API to match the Source API

Resource ManagementMark it done since main part of the new api been merged (remaining tests and doc)
(tick)
2024-01-23



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33625

Rui Fan RocMarshal Done(tick)

columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33528



(minus)





Resource Management


































Runtime


Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-3331533625

Rui Fan RocMarshal Done
(tick)
2023-12-04



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33315

A series of optimizations to reduce the memory and cpu usage for large StreamOperator

Rui Fan 

(tick)
2023-11-23















Misc












Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33325

Accepted

DONE, only docs left
(tick)
2024-01-23(green star)



Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-33230

(will create a FLIP)



(minus)
2024-01-23



Status / Follow-Status / Follow-ups

11/14/2023

  • Is Google Meet OK for everyone?  - ok
  • The release sync meeting time, currently Europe has gone into winter time(CET, UTC+1), is 9am ok? - ok
  • Daily work divisions
    • JIRA ticket (Mainly focus on new blockers, progress of existing blockers each week) lincoln lee 
    • CI (Failures reported in #build channel and not reported) Martijn Visser 
    • Benchmark (Check if there's regression in the #flink-dev-benchmarks channel) Yun Tang 
    • Mailing list monitoring Jing Ge 
    • This division doesn't mean that other RMs are now allowed to do the work. All RMs should take responsibilities on all of these daily issues if they are available. 
  • Feature freezing date. - Jan 26, 2024, 00:00 CET(UTC+1) 
  • Retrospective of 1.18

11/28/2023

  •  
  • Retrospective of 1.18

11/28/2023

  • Blockers
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-25857
        discuss thread - back to ml discussion
    • documentation build failures
      Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-33544
      - closed
  • GitHub Actions Migration discussion in dev ML (FLIP-396)
  • flink-shaded driven by Sergey Nuyanzin 
  • As suggested by Xintong Song, we encourage attendees to fill out the topics a day in advance  to make it easier for everyone to understand the background of the topic. 

12/12/2023

  • Current status of 1.19 Features lincoln lee - updated
  • Existing blocker issues lincoln lee 
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-25857
        discuss thread - closed
    • Jira
      serverASF JIRA
      columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolution
      columnskey,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-33641
      (potential blocker) 

12/26/2023

  • Current status of 1.19 Features lincoln lee - updated
    • 5 weeks remaining, total 27, done 4, will make it 15
  • Existing blocker issues lincoln lee
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-33641
      has been fixed
  • Skip this sync meeting? - no response until 12/25, skipped finally

01/09/2024

  • Current status of 1.19 Features lincoln lee - updated
    • 3 weeks remaining, total 27, done 4, will make it 15, won't make it 1
  • Existing blocker issues lincoln lee
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-32978
      sergy reported a breaking change, will be fixed soon Wencong Liu
       

01/23/2024

  • Current status of 1.19 Features lincoln lee
    • Jan 26th is the planned feature freeze day, total 28, done 15, will make it 6, won't make it 4;
  • Existing blocker issues lincoln lee
  • Whether to delay feature freeze day? Yun Tang
  • Build pipeline stability
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34202
      : python stage reaches 4h timeout
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-31472
      : AsyncSinkWriterThrottlingTest  quite unstable recently
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34069
      : macos wheels build seems to be unstable (multiple open issues)
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34200
      /
      Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-33919
      : new feature

01/30/2024

  • Current status of 1.19 Features lincoln lee
  • Existing blocker issues lincoln lee
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34148
      Sergey Nuyanzin Zakelly Lan 
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34007
      Matthias Pohl
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34225
      &
      Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34233
      @yunfengzhou
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34272
  • When to cut release-1.19 branch?
  • Cross-team release testing work

02/06/2024

  • Blockers:
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34148
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34007
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34225
      &
      Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34233
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34272
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34337
      pr reviewing jiabao.sun 
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-33958
      not yet clarified whether it's a production code or test issue
  • Cut release-1.19 branch
  • fyi:
    Jira
    serverASF JIRA
    serverId5aa69414-a9e9-3523-82ec-879b028fb15b
    keyFLINK-34360
    GitHub Actions e2e tests seem to have disk space issues causing multiple test failure (not present in Azure) 
  • Cross-team release testing
    Jira
    serverASF JIRA
    serverId5aa69414-a9e9-3523-82ec-879b028fb15b
    keyFLINK-34285
     
    • total 26 flip/features, 15 confirmed,  7 not required,  4 wait for response(authors: Dawid Wysakowicz, Peter Vary, Alan Sheinberg)
    • testing instructions ready: 11  (1 completed, 3 assigned,  7 unassigned),  wait for doc ready:  2
    • more completed flips found, will update the testing ticket (done, 6 Instructions tickets added)

02/13/2024

  • Not verified Jira issues:
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34404
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34424
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34425
      Matthias Pohl 
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34427
      Matthias Pohl
  • CI instability issues:
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34273
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34202
    • Nightly build for 1.19 doesn't seem to be picked
  • Cross-team release testing
    Jira
    serverASF JIRA
    serverId5aa69414-a9e9-3523-82ec-879b028fb15b
    keyFLINK-34285
     
    • wait for response:  there's some authentication problem in current kanban dashboard,  use filter on Jira search 'project = FLINK AND type = Sub-task AND parent = FLINK-34285 AND labels is EMPTY AND status = OPEN ORDER BY updatedDate'  
    Blockers
    • wait for doc ready:  
      •   discuss thread - back to ml discussiondocumentation build failures
        • Jira
          serverASF JIRA
          serverId5aa69414-a9e9-3523-82ec-879b028fb15b
          keyFLINK-
        25857
        • 34310
        • Jira
          serverASF JIRA
          serverId5aa69414-a9e9-3523-82ec-879b028fb15b
        keyFLINK-33544 - closed
    • GitHub Actions Migration discussion in dev ML (FLIP-396)
    • flink-shaded driven by Sergey Nuyanzin 
    • As suggested by Xintong Song, we encourage attendees to fill out the topics a day in advance  to make it easier for everyone to understand the background of the topic. 

    12/12/2023

        • keyFLINK-34305
      • testing tickets: Jira filter condition 'project = FLINK AND type = Sub-task AND parent = FLINK-34285 AND labels = release-testing ORDER BY updatedDate'

    02/20/2024

    • Not verified Jira issues:
      • Jira
        serverASF JIRA
        serverId5aa69414-a9e9-3523-82ec-879b028fb15b
        keyFLINK-34404
    • Current status of 1.19 Features lincoln lee - updated
    • Existing blocker issues lincoln lee 
      • Jira
        serverASF JIRA
        serverId5aa69414-a9e9-3523-82ec-879b028fb15b
        keyFLINK-
        25857
        34424
         
        discuss thread - closedYunfeng Zhou 
      • Jira
        serverASF JIRA
        columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolutioncolumnskey,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution
        serverId5aa69414-a9e9-3523-82ec-879b028fb15b
        keyFLINK-34425
        Matthias Pohl 
      • Jira
        serverASF JIRA
        serverId5aa69414-a9e9-3523-82ec-879b028fb15b
        keyFLINK-34427
        Matthias Pohl
    • CI instability issues:
      • Jira
        serverASF JIRA
        serverId5aa69414-a9e9-3523-82ec-879b028fb15b
        keyFLINK
        -33641 (potential blocker) 

    12/26/2023

      • -34273
         
    • Current status of 1.19 Features lincoln lee - updated
      • 5 weeks remaining, total 27, done 4, will make it 15
    • Existing blocker issues lincoln lee
      • Jira
        serverASF JIRA
        serverId5aa69414-a9e9-3523-82ec-879b028fb15b
        keyFLINK-33641
        has been fixed
    • Skip this sync meeting? - no response until 12/25, skipped finally

    01/09/2024

    • Cross-team release testing
      Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyFLINK-34285
       
    • Current status of 1.19 Features lincoln lee - updated
      • 3 weeks remaining, total 27, done 4, will make it 15, won't make it 1
    • Existing blocker issues lincoln lee
      • wait for response:  there's some authentication problem in current kanban dashboard,  use filter on Jira search 'project = FLINK AND type = Sub-task AND parent = FLINK-34285 AND labels is EMPTY AND status = OPEN ORDER BY updatedDate'  
      • wait for doc ready:  
        • Jira
          serverASF JIRA
          serverId5aa69414
        -a9e9-3523-82ec-879b028fb15bkeyFLINK-32978 sergy reported a breaking change, will be fixed soon Wencong Liu  
        • -a9e9-3523-82ec-879b028fb15b
          keyFLINK-34305
      • testing tickets: Jira filter condition 'project = FLINK AND type = Sub-task AND parent = FLINK-34285 AND labels = release-testing ORDER BY updatedDate'
        • 15 total, 8 closed, 4 unassigned, 3 testing
    • When to create rc? –- after release testing finished and no blockers