You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 8 Next »

Here is a list of tools we have been told about that integrate with Kafka outside the main distribution. We haven't tried them all, so they may not work!

Clients, of course, are listed separately here.

Stream Processing

  • Storm - A stream-processing framework.
  • Samza - A YARN-based stream processing framework.
  • Storm Spout - Consume messages from Kafka and emit as Storm tuples

Hadoop Integration

  • Camus - LinkedIn's Kafka=>HDFS pipeline. This one is used for all data at LinkedIn, and works great.
  • Kafka Hadoop Loader A different take on Hadoop loading functionality from what is included in the main distribution.

Web Management Consoles

  • Kafka Web Console - Displays information about your Kafka cluster including which nodes are up and what topics they host data for.

AWS Integration

Logging

Flume - Kafka plugins

Metrics

Packing and Deployment

Misc.

  • No labels