...

Hoodie uses parquet as its default storage format for Copy on Write and Merge On Read operations where users are forced to store and query data in parquet. Introduce Orc as an underlying storage format for Hoodie to expose ORC Read Optimized views.

Implementation

Schema Compatibility

Hudi use avro schema for input record and store the schema infomation to commit meta, and parquet writer will use the avro schema. But the schema of orc  incompatible with avro schema.

Image Added

Key Steps

• Implement a HoodieOrcWriter just like HoodieParquetWriter to write data in ORC:

...