...
- "Particle physics, 10,000 times faster" by Jim Pivarski
- "Our data is deeply nested and cross linked"
- https://youtu.be/jvt4v2LTGK0?t=455
Tip | ||
---|---|---|
| ||
This is where `Hudi` comes into the picture by allowing data to be kept in files, not just input data but also output data. : the ability to keep data in the basic files is key to building the above vision . |
Activity
This page about Uber #Michelangelo https://eng.uber.com/michelangelo/ suggests there is still a distinction in the architecture and implementation (and programming model) between "batch" and "streaming" and the data is placed in distinct kinds of physical repositories between batch and continuous analyses.
...
Here we will list a growing list of use cases that we find useful in the above context.
...