Title: Kafka Streams KIP Overview  
Author: Matthias Sax Jan 15, 2020
Last Changed by: Matthias Sax Nov 22, 2023
Tiny Link: (useful for email) https://cwiki-test.apache.org/confluence/x/9oqvC
Export As: Word · PDF  
Incoming Links
Apache Kafka (1)
    Page: Kafka Streams
Hierarchy
Parent Page
    Page: Kafka Streams
Labels
There are no labels assigned to this page.
Recent Changes
Time Editor  
Nov 22, 2023 01:34 Matthias Sax View Changes
Nov 21, 2023 21:46 Almog Gavra View Changes
Nov 08, 2023 16:39 Matthias Sax View Changes
Oct 18, 2023 19:17 Matthias Sax View Changes
Sep 11, 2023 23:40 Matthias Sax  
Outgoing Links
External Links (33)
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-744%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-472%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-732%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-67%3A…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-149%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-741%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-695%3…
    https://cwiki.apache.org/confluence/pages/viewpage.action?p…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-345%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-62%3A…
    https://cwiki.apache.org/confluence/x/KZvkCw
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-165%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-245%3…
    https://cwiki.apache.org/confluence/pages/viewpage.action?p…
    https://cwiki.apache.org/confluence/pages/viewpage.action?p…
    https://cwiki.apache.org/confluence/pages/viewpage.action?p…
    https://cwiki.apache.org/confluence/pages/viewpage.action?p…
    https://cwiki.apache.org/confluence/pages/viewpage.action?p…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-295%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-71%3A…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-715%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-312%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-689%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-393%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-904%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-613%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-292%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-743%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-733%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-616%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-364%3…
    https://cwiki.apache.org/confluence/display/KAFKA/KIP-622%3…
Apache Kafka (144)     Page: KIP-259: Improve Streams DSL Timestamp Propagation Semantics
    Page: KIP-594: Expose output topic names from TopologyTestDriver
    Page: KIP-680: TopologyTestDriver should not require a Properties argument
    Page: KIP-470: TopologyTestDriver test input and output usability improvements
    Page: KIP-775: Custom partitioners in foreign key joins
    Page: KIP-478 - Strongly typed Processor API
    Page: Kafka Streams
    Page: KIP-662: Throw Exception when Source Topics of a Streams App are Deleted
    Page: KIP-442: Return to default max poll interval in Streams
    Page: KIP-94 Session Windows
    Page: KIP-446: Add changelog topic configuration to KTable suppress
    Page: KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde
    Page: KIP-121: Add KStream peek method
    Page: KIP-63: Unify store and downstream caching in streams
    Page: KIP-761: Add Total Blocked Time Metric to Streams
    Page: KIP-663: API to Start and Shut Down Stream Threads
    Page: KIP-796: Interactive Query v2
    Page: KIP-414: Expose Embedded ClientIds in Kafka Streams
    Page: KIP-428: Add in-memory window store
    Page: KIP-265: Make Windowed Serde to public APIs
    Page: KIP-648: Renaming getter method for Interactive Queries
    Page: KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines
    Page: KIP-485: Make topic optional when using through() operations in DSL
    Page: KIP-221: Enhance DSL with Connecting Topic Creation and Repartition Hint
    Page: KIP-93: Improve invalid timestamp handling in Kafka Streams
    Page: KIP-617: Allow Kafka Streams State Stores to be iterated backwards
    Page: KIP 156 Add option "dry run" to Streams application reset tool
    Page: KIP-366: Make FunctionConversions deprecated
    Page: KIP-206: Add support for UUID serialization and deserialization
    Page: KIP-104: Granular Sensors for Streams
    Page: KIP-906: Tools migration guidelines
    Page: KIP-591: Add Kafka Streams config to set default state store
    Page: KIP-268: Simplify Kafka Streams Rebalance Metadata Upgrade
    Page: KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils
    Page: KIP-376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement
    Page: KIP-116: Add State Store Checkpoint Interval Configuration
    Page: KIP-378: Enable Dependency Injection for Kafka Streams handlers
    Page: KIP-77: Improve Kafka Streams Join Semantics
    Page: KIP-97: Improved Kafka Client RPC Compatibility Policy
    Page: KIP-330: Add retentionPeriod in SessionBytesStoreSupplier
    Page: KIP-444: Augment metrics for Kafka Streams
    Page: KIP-783: Add TaskId field to StreamsException
    Page: KIP-138: Change punctuate semantics
    Page: KIP-220: Add AdminClient into Kafka Streams' ClientSupplier
    Page: KIP-756: Move StreamsResetter tool outside of core
    Page: KIP-244: Add Record Header support to Kafka Streams Processor API
    Page: KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size
    Page: KIP-535: Allow state stores to serve stale reads during rebalance
    Page: KIP-528: Deprecate PartitionGrouper configuration and interface
    Page: KIP-205: Add all() and range() API to ReadOnlyWindowStore
    Page: KIP-666: Add Instant-based methods to ReadOnlySessionStore
    Page: KIP-557: Add emit on change support for Kafka Streams
    Page: KIP-319: Replace segments with segmentInterval in WindowBytesStoreSupplier
    Page: KIP-134: Delay initial consumer group rebalance
    Page: KIP-303: Add Dynamic Routing in Streams Sink
    Page: KIP-358: Migrate Streams API to Duration instead of long ms times
    Page: KIP-353: Improve Kafka Streams Timestamp Synchronization
    Page: KIP-356: Add withCachingDisabled() to StoreBuilder
    Page: KIP-869: Improve Streams State Restoration Visibility
    Page: KIP-160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string
    Page: KIP-132: Augment KStream.print to allow extra parameters in the printed string
    Page: KIP-941: Range queries to accept null lower and upper bounds
    Page: KIP-763: Range queries with open endpoints
    Page: KIP-213 Support non-key joining in KTable
    Page: KIP-372: Naming Repartition Topics for Joins and Grouping
    Page: KIP 155 - Add range scan for windowed state stores
    Page: KIP-820: Extend KStream process with new Processor API
    Page: KIP 157 - Add consumer config options to streams reset tool
    Page: KIP-923: Add A Grace Period to Stream Table Join
    Page: KIP-198: Remove ZK dependency from Streams Reset Tool
    Page: KIP-865: Support --bootstrap-server in kafka-streams-application-reset
    Page: KIP-239 Add queryableStoreName() to GlobalKTable
    Page: KIP-571: Add option to force remove members in StreamsResetter
    Page: KIP-462: Use local thread id for KStreams
    Page: KIP-429: Kafka Consumer Incremental Rebalance Protocol
    Page: KIP-114: KTable state stores and improved semantics
    Page: KIP-28 - Add a processor client
    Page: KIP-825: introduce a new API to control when aggregated results are produced
    Page: KIP-274: Kafka Streams Skipped Records Metrics
    Page: KIP 130: Expose states of active tasks to KafkaStreams public API
    Page: KIP-633: Deprecate 24-hour Default Grace Period for Windowed Operations in Streams
    Page: KIP-120: Cleanup Kafka Streams builder API
    Page: KIP-443: Return to default segment.ms and segment.index.bytes in Streams repartition topics
    Page: KIP-167: Add interface for the state store restoration process
    Page: KIP-328: Ability to suppress updates for KTables
    Page: KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions
    Page: KIP-530: Consider renaming 'UsePreviousTimeOnInvalidTimeStamp' class to 'UsePartitionTimeOnInvalidTimeStamp'
    Page: KIP-95: Incremental Batch Processing for Kafka Streams
    Page: KIP-479: Add StreamJoined config object to Join
    Page: KIP-276 Add StreamsConfig prefix for different consumers
    Page: KIP-270 - A Scala Wrapper Library for Kafka Streams
    Page: KIP-32 - Add timestamps to Kafka message
    Page: KIP-671: Introduce Kafka Streams Specific Uncaught Exception Handler
    Page: KIP-251: Allow timestamp manipulation in Processor API
    Page: KIP-418: A method-chaining way to branch KStream
    Page: KIP-471: Expose RocksDB Metrics in Kafka Streams
    Page: KIP-262: Metadata should include number of state stores for task
    Page: KIP-806: Add session and window query over kv-store in IQv2
    Page: KIP-527: Add VoidSerde to Serdes
    Page: KIP-224: Add configuration parameter `retries` to Streams API
    Page: KIP-453: Add close() method to RocksDBConfigSetter
    Page: KIP-450: Sliding Window Aggregations in the DSL
    Page: KIP-202 Move merge() from StreamsBuilder to KStream
    Page: KIP-889: Versioned State Stores
    Page: KIP-708: Rack aware StandbyTask assignment for Kafka Streams
    Page: KIP-447: Producer scalability for exactly once semantics
    Page: KIP-161: streams deserialization exception handlers
    Page: KIP-307: Allow to define custom processor names with KStreams DSL
    Page: KIP-90 - Remove zkClient dependency from Streams
    Page: KIP-791: Add Record Metadata to State Store Context
    Page: KIP-572: Improve timeouts and retries in Kafka Streams
    Page: KIP-258: Allow to Store Record Timestamps in RocksDB
    Page: KIP-324: Add method to get metrics() in AdminClient
    Page: KIP-451: Make TopologyTestDriver output iterable
    Page: KIP-884: Add config to configure KafkaClientSupplier in Kafka Streams
    Page: KIP-313: Add KStream.flatTransform and KStream.flatTransformValues
    Page: KIP-210 - Provide for custom error handling when Kafka Streams fails to produce
    Page: KIP-247: Add public test utils for Kafka Streams
    Page: KIP-173: Add prefix to StreamsConfig to enable setting default internal topic configs
    Page: KIP-805: Add range and scan query over kv-store in IQv2
    Page: KIP-626: Rename StreamsConfig config variable name
    Page: KIP-614: Add Prefix Scan support for State Stores
    Page: KIP-441: Smooth Scaling Out for Kafka Streams
    Page: KIP-129: Streams Exactly-Once Semantics
    Page: KIP-321: Update TopologyDescription to better represent Source and Sink Nodes
    Page: KIP-100 - Relax Type constraints in Kafka Streams API
    Page: KIP-420: Add Single Value Fetch in Session Stores
    Page: KIP-811: Add config repartition.purge.interval.ms to Kafka Streams
    Page: KIP-607: Add Metrics to Kafka Streams to Report Properties of RocksDB
    Page: KIP-925: Rack aware task assignment in Kafka Streams
    Page: KIP-445: In-memory Session Store
    Page: KIP-907: Add Boolean Serde to public interface
    Page: KIP-261: Add Single Value Fetch in Window Stores
    Page: KIP-456: Helper classes to make it simpler to write test logic with TopologyTestDriver
    Page: KIP-914: DSL Processor Semantics for Versioned Stores
    Page: KIP-562: Allow fetching a key from a single partition rather than iterating over all the stores on an instance
    Page: KIP-284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE
    Page: KIP-696: Update Streams FSM to clarify ERROR state meaning
    Page: KIP 230: Name Windowing Joins
    Page: KIP-150 - Kafka-Streams Cogroup
    Page: KIP-365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde
    Page: KIP-171 - Extend Consumer Group Reset Offset for Stream Application
    Page: KIP-862: Self-join optimization for stream-stream joins
    Page: KIP-99: Add Global Tables to Kafka Streams