DUE TO SPAM, SIGN-UP IS DISABLED. Goto Selfserve wiki signup and request an account.
...
Hudi use avro schema for input record, and parquet writes record by using avro schema. But orc cann't support avro natively, need to do some transform work job.
Implementation Steps
Add storage type option(e.g "hoodie.table.storage.type=ORC") to hoodie.properties.
- Impement a HoodieOrcWriter just like HoodieParquetWriter to write data in ORC.
- Impement a OrcReaderIterator just like ParquetReaderIterator to write data in ORC.
- Change or create new implementation of HoodieInputFormat to support ORC writing (As of now it strictly writes Parquet)
- Rework HoodieBloomIndex to work with ORC.
...