Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

This KIP adds the cache.max.bytes.buffering configuration to the streams configuration as described above. 

...

Proposed implementation outline

  1. Change the RocksDB implementation for KStream windowed aggregations, to not use “range queries” but multiple gets, so that we can leverage caches for it as well.

  2. Extract the LRU cache out of RocksDBStore, as a separate store for KGroupedStream.aggregate() / reduce(), and KStream.aggregateByKey() / reduceByKey().

  3. Add the LRU cache for KTable.to() operator.

  4. Add the above config into StreamsConfig

     

...