Versions Compared

Old Version 12

changes.mady.by.user Jacky Li

Saved on

compared with

New Version 13

changes.mady.by.user Jacky Li

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

By employing data prefetching and various improvement in vectorized reader during compaction, compaction operation on CarbonData table is improved up to 5 times compare to last version. In one of the production environment, application can support 5 minutes data loading (100s of GB) while maintaining second level query performance by automatic compaction for every 30 and 60 minutes (configured with "carbon.compaction.level.threshold" set to "6,2") to reduce number of segments.

DataMap Management Enhancement

...