THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
- The consumer gets the segment from the broker.
- If the segment is in Parquet format, it uses the Parquet library to decode and optionally decompress.
- The record in the in-memory format is then sent to the application.
Ingestion Consumer
- The consumer gets the segment with Parquet format from the broker and sends it directly to the data lake.
...