You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Next »

HDFS Component

The hdfs component enables you to read and write messages from/to an HDFS file system. HDFS is the distributed file system at the heart of Hadoop.

URI format

hdfs://path[?options]

You can append query options to the URI in the following format, ?option=value&option=value&...

Options

Name

Default Value

Description

AAAA

1000

BBBB

Writing/Reading messages to an HDFS filesystem

Message Headers

Header

Description

HDFS Producer

HDFS Consumer

HDFS Usage Samples

Example 1:

 

Example 2:

 
  • No labels