Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Maintain an internal Hudi table named `errors` within `.hoodie/` directory
  • Partition based on `ts` field in daily interval

Write path

Start with

  • org.apache.hudi.client.HoodieWriteClient#postWrite

  • org.apache.hudi.client.HoodieWriteClient#completeCompaction

CLI support

  • Consider adding CLI support for easy inspection

Metrics

  • Emit a count metric for the number of failed records

...