Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Camus - LinkedIn's Kafka=>HDFS pipeline. This one is used for all data at LinkedIn, and works great.
  • Kafka Hadoop Loader A different take on Hadoop loading functionality from what is included in the main distribution.
  • Flume - Contains Kafka Source (consumer) and Sink (producer)
  • KaBoom - A high-performance HDFS data loader
  • ElasticSearchThis project, Kafka Standalone Consumer will read the messages from Kafka, processes and index them in ElasticSearch.

...

Flume - Kafka plugins

...