Page History

https://developer.ibm.com/messaging/message-hub/Here is a list of tools we have been told about that integrate with Kafka outside the main distribution. We haven't tried them all, so they may not work!

...

• Confluent Platform 1.0 - http://confluent.io/product/. Downloads - http://confluent.io/downloads/.
• Cloudera Kafka source https://github.com/cloudera-labs/kafka/tree/cdh5-0.8.2_1.1.0 and release http://www.cloudera.com/content/cloudera/en/developers/home/cloudera-labs/apache-kafka.html
• Hortonworks Kafka source ??? and release http://hortonworks.com/hadoop/kafka/ 
• Stratio Kafka source ???  for ubuntu http://repository.stratio.com/sds/1.1/ubuntu/13.10/binary/ and for RHEL http://repository.stratio.com/sds/1.1/RHEL/
• IBM Message Hub - https://developer.ibm.com/messaging/message-hub/ - Kafka as-a-service in a IBM's Bluemix PaaS

Stream Processing

• Storm - A stream-processing framework.
• Samza - A YARN-based stream processing framework.
• Storm Spout - Consume messages from Kafka and emit as Storm tuples
• Kafka-Storm - Kafka 0.8, Storm 0.9, Avro integration
• SparkStreaming - Kafka reciever supports Kafka 0.8 and above 
• IBM Streams - A stream processing framework with Kafka source and sink to consume and produce Kafka messages 

...

• Kafka Manager - A tool for managing Apache Kafka.
• kafkat - Simplified command-line administration for Kafka brokers.
• Kafka Web Console- Displays information about your Kafka cluster including which nodes are up and what topics they host data for.
• Kafka Offset Monitor - Displays the state of all consumers and how far behind the head of the stream they are.
• Capillary – Displays the state and deltas of Kafka-based Apache Storm topologies. Supports Kafka >= 0.8. It also provides an API for fetching this information for monitoring purposes.
  

AWS Integration

• Automated AWS deployment
• Kafka -> S3 Mirroring tool from Pinterest.
• Alternative Kafka->S3 Mirroring tool

...