DUE TO SPAM, SIGN-UP IS DISABLED. Goto Selfserve wiki signup and request an account.
...
Hudi use avro schema for input record and store the schema infomation to commit meta, and parquet writer will use the avro schema.
But the schema of orc orc incompatible with avro schema, so we need to store StructType( spark provides ) infomation to commit meta.
Key Steps
- Implement a HoodieOrcWriter just like HoodieParquetWriter to write data in ORC:
...
