THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
- Apache Hudi (incubating) - Release Guide
- Apache Hudi Community Weekly Sync
- Committer On-boarding Guide
Roadmap
This is a rough roadmap (non exhaustive list) of what's to come in each of the areas for Hudi.
Below is a WIP depiction of what's to come . and how its sequenced
draw.io Diagram | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
This is a rough roadmap (non exhaustive list) of what's to come in each of the areas for Hudi.
Writing data & Indexing
- Improving indexing speed for time-ordered keys/small updates
- leverage parquet record indexes,
- serving bloom filters/ranges from timeline server/consolidate metadata
- Indexing the log file, moving closer to scalable 1-min ingests
- Improving indexing speed for uuid-keys/large update spreads
- global/hash based index to faster point-in-time lookup
- Incrementalize & standardize all metadata operations e.g cleaning based on timeline metadata
- Auto tuning
- Auto tune bloom filter entries based on records
- Partitioning based on historical workload trend
- Determination of compression ratio
...