Page History

...

We divide consumers into two categories. Minimum change is needed for messaging consumer consumers for reading the Parquet segment, and a new consuming method is proposed to add for ingestion consumers.  The way to divide into the two categories and these terms are used solely for the purpose of this proposal.

Messaging Consumer

In this scenario, the application expects one or more records with each poll. When the Kafka consumer client encounters the Parquet format, it invokes the Parquet reader library to unwrap the segment into records. The required change is similar to the producer side, as discussed above.

...

We refer to the first type of use case as a messaging consumer and the second one as an ingestion consumer. These terms are used solely for the purpose of this proposal. 

Current Data Format Transformation 

...