Debugging Flume

Flume's web applications

As of v0.9.4, the default setup for Flume is to run its servlets from .WAR files that include precompiled jsps.

On One can have the node or master start specfic servlets .WARs, by pointing the following properties in the system's flume-site.conf file, like below.

  <property>
    <name>flume.master.webapps.root</name>
    <value>webapps/flumemaster.war</value>
    <description>
    Path where Flume master war lives.  If a file it will load the
    war, if a dir it will load all *.war in that dir.
    </description>
  </property>

  <property>
    <name>flume.node.webapps.root</name>
    <value>webapps/flumemaster.war</value>
    <description>
    Path where Flume node war lives.  If a file it will load the
    war, if a dir it will load all *.war in that dir.
    </description>
  </property>

How do I get the webapps to show up when I am in debugging in eclipse?

You need to build the webapp WAR files and then set configuration values in your flume-site.xml file to point to the appropriate files.

...

$ cd flume-core
$ ln -s ../conf

Tests

Certain tests always fail on my system. (RHEL6)

Some concurrency tests spawn many threads (on the order of 1000), which may be higher than the ulimit for processes on your system. Make sure to up that number or disable that test.

...

java.lang.OutOfMemoryError: unable to create new native thread
	at java.lang.Thread.start0(Native Method)
	at java.lang.Thread.start(Thread.java:597)
...

Microbenchmark suite.