Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Hudi use avro schema for input record and store the schema infomation to commit meta, and parquet writer will use the avro schema.

But the schema of orc orc incompatible with avro schema, so we need to store StructType( spark provides ) infomation to commit meta.

Key Steps

  • Implement a HoodieOrcWriter just like HoodieParquetWriter to write data in ORC:

...