Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Putting this data in kafka, separate databases, etc breaks not just the logical cohesion of the analysis but also leaves no room for global optimization.
See the premise of Weld : https://www.weld.rs/assets/weld-strata.pdf


Hypothesis : We need "continuous" analytics in both the time dimension and , in the physical dimension.data dimension and in terms of programming model

  • relational algebra
  • linear algebra
  • differential programming
  • probabilistic programming
  • computational graphs
  • differential dataflow
  • etc

Why "deep"

  • In terms of algos we have deep learning, ofc.
  • But also in terms of "data fabric" we need to handle multi-dimensional, heterogeneous, business rich meaning data and abstractions over data.

...