Page History

...

Some of these may lead to `Hudi` HIPs, some to extensions and others to more broad solutions, beyond `Hudi` itself but where `Hudi` plays a part.

Use cases

(UC) Ability to support deletes

• Application to GDPR "right to be forgotten" requirement.
• Context : https://databricks.com/blog/2019/03/19/efficient-upserts-into-data-lakes-databricks-delta.html
• Status : wip https://github.com/apache/incubator-hudi/pull/635

(UC) Integrate Hudi with Apache Beam so that the sliding data window abstractions of beam can run on top of Parquet files incrementally updated through `Hudi`

...

1. "Evaluating End-to-End Optimization for Data Analytics Applications in Weld"
   
   1. http://www.vldb.org/pvldb/vol11/p1002-palkar.pdf
   2. 
2. "Bridging the Gap: Towards Optimization Across Linear and Relational Algebra"
   1. https://h2020-streamline-project.eu/wp-content/uploads/2017/11/lara.pdf
   2. 
3. "Accessible Machine Learning through Data Workflow Management"
   1. https://eng.uber.com/machine-learning-data-workflow-management/
   2. Image Modified