Streamers Implementation Guidelines

Overview

This guide shows how to implement custom data streamer and describes basic concepts and implementation details.

Basic Concepts

The purpose of streamers is data ingesting from various sources (e.g. TCP socket or Kafka) and streaming them into Ignite cache for further processing. The Ignite provides IgniteDataStreamer API that allows stream data into cache and convenient StreamAdapter that wraps data streamer instance and provides basis for custom streamer implementation.

Usually data in stream represents messages of some type that should be converted to cache entries (key-value pairs or tuples). StreamTupleExtractor is responsible for such conversion.

Streamer Lifecycle

Implementation Tips