Versions Compared

Old Version 24

changes.mady.by.user Xinli Shang

Saved on

compared with

New Version 25

changes.mady.by.user Xinli Shang

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. The consumer gets the segment from the broker. 
  2. If the segment is in Parquet format, it uses the Parquet library to decode and optionally decompress.
  3. The record in the in-memory format is then sent to the application.

Ingestion Consumer

  1. The consumer gets the segment with Parquet format from the broker and sends it directly to the data lake.

...