This guide shows how to implement custom data streamer and describes basic concepts and implementation details.
The purpose of streamers is data ingesting from various sources (e.g. TCP socket or Kafka) and streaming them into Ignite cache for further processing. The Ignite provides IgniteDataStreamer
API that allows stream data into cache . In order to implemand convenient StreamAdapter
that wraps data streamer instance and provides basis for custom streamer implementation.
Usually data in stream represents messages of some type that should be converted to cache entries (key-value pairs or tuples). StreamTupleExtractor
is responsible for such conversion.
...