Versions Compared

Old Version 20

changes.mady.by.user Vinoth Chandar

Saved on

compared with

New Version 21

changes.mady.by.user Nishith Agarwal

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Once the proposed solution is implemented, users will be able to run jobs in parallel by simply launching multiple writers. Upgrading to the latest Hudi release providing this feature will automatically upgrade your timeline layout. 

Test Plan


Code Block
For TableTypes in (COW, MOR)
	For ConcurencyMode in (SingleWriter, OCC (with non-overlapping & overlapping file ids))
		Test Plan 1:  EAGER cleaning, without metadata (validate no regression)
		Test Plan 2:  EAGER cleaning, with metadata (validate no regression)
		Test Plan 3:  EAGER cleaning, with metadata, with async cleaning (validate no regression)
		Test Plan 4:  LAZY cleaning, without metadata
		Test Plan 5:  LAZY cleaning, with metadata
		Test Plan 6:  LAZY cleaning, with metadata, with async cleaning


Failures & Build rollback

...

By default, the scheduling of operations will be enabled for any job for backwards compatibility for current users. The users need to ensure they turn off scheduling and then turn it on only for the dedicated job.

Test Plan

Unit tests and Test suite integration

...