A Flume hackathon is happening 2011/12/16 at Cloudera's Palo Alto office!

Registration: http://www.meetup.com/Flume-User-Meetup/events/43451842/
SVN: http://svn.apache.org/repos/asf/incubator/flume/branches/flume-728
JIRA: https://issues.apache.org/jira/browse/FLUME (filter by "Affects Flume NG ..." for NG JIRAs)
ReviewBoard: https://reviews.apache.org/dashboard/

Potential Projects

The following are some potential fun projects to hack on for Flume NG. They should be divided up by category and tagged with some estimate of complexity. Feel free to add more!

Channels

Description

Complexity

JIRA

Support for WAL style FileChanngel

MID

https://issues.apache.org/jira/browse/FLUME-896

Sinks and Sources

Description

Complexity

JIRA

Write (or port from OG) an HBase sink

HIGH

 

Write a thrift source similar to Flume NG's AvroSource

HIGH

 

Write (or port from OG) a Scribe compatibility source to allow Scribe or Scribe libraries to talk to NG.

HIGH

 

Write (or port from OG) a syslog source.

MID

 

Write a sink to send data to LogStash -

http://logstash.net/

MID

 

Write a JMS source and / or sink

MID

 

Write an ElasticSearch sink

?

 

Write a Solr sink

?

 

Documentation

Description

Complexity

JIRA

Create and explain common Flume NG deployment scenarios

LOW

 

Improve the NG getting started guide

LOW

 

Create example configurations for common deployments

LOW

 

Update the How to Contribute guide

LOW

 

Build and Testing

Description

Complexity

JIRA

Expand any of the existing unit tests

LOW - HIGH

 

Write additional unit tests for things not yet covered

LOW - HIGH

 

Add cobertura support to the build

MID

 

Add jcarder support to the build

MID

 

Make the build generate javadoc

LOW

 

It's also more than fine to just join us for the day to learn more about Flume NG, how to become a committer, talk about potential features and design, or build Flume integration into your project!

Results

This will get filled in after the hackathon.

  • No labels