Page History

This is a FAQ for common questions that occur when debugging the operations of a running Flume cluster.

How can I tell if data is arriving at the collector?

Data in hdfs doesn't "arrive" until the file is closed or certain size thresholds are met. To see progress, you can look at the status web page on the collector node on port 35862. (http://<collector>:35862). If data is arriving if the the ...Collector.GunzipDecorator.UnbatchingDecorator.AckChecksumChecker.InsistentAppend.appendSuccessses metric should be incrementing.

I am getting a lot of duplicated event data. Why is this happening and what can I do to make this go away?

...