Page History

...

Hudi use avro schema for input record and store the schema infomation to commit meta, and parquet writer will use the writes record by using avro schema. But the schema of orc incompatible with avro schema, so we need to store StructType( spark provides ) infomation to commit meta.

Image Removed

orc cann't support avro directly, need to do some wrapper work.

HoodieOrcWriter

Image Modified

Key Steps

• Implement a HoodieOrcWriter just like HoodieParquetWriter to write data in ORC:

...

<Describe in few sentences how the HIP will be tested. How will we know that the implementation works as expected? How will we know nothing broke?>

TODO (Dataframe)

Hudi use avro schema for input record and store the schema infomation to commit meta, and parquet writer will use the avro schema.

But the schema of orc incompatible with avro schema, so we should store StructType( spark provides ) infomation to commit meta.

Image Added