Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

...

We

...

have

...

seen

...

an

...

increasing

...

interest

...

to

...

get

...

Flume

...

natively

...

running

...

on

...

®

...

Windows

...

Warning

Note that Flume 1.x is not officially supported on Windows and the following instructions are only meant to help interested parties - it does not mean that Flume is supported by the community on Windows. Please note that YMMV.

Prerequisites

Build system
maven 3x, git, jdk1.6.x,

...

WinRAR

...

(or

...

similar

...

program)

...

Apache

...

Flume

...

agent

...

node

...


jdk1.6.x,

...

WinRAR

...

(or

...

similar

...

program),

...

Ultraedit+

...

+

...

or

...

similar

...

texteditor

...

Prepare

...

the

...

Windows

...

Build

...

Box

...

  1. Download

...

  1. and

...

  1. install

...

  1. JDK

...

  1. 1.6x

...

  1. Set

...

  1. the

...

  1. environment

...

  1. variables

...

    1. =>

...

    1. Start

...

    1. -

...

    1. type

...

    1. "

...

    1. env

...

    1. "

...

    1. into

...

    1. the

...

    1. search

...

    1. box,

...

    1. select

...

    1. "

...

    1. Edit

...

    1. system

...

    1. environment

...

    1. variables

...

    1. ",

...

    1. click

...

    1. Environment

...

    1. Variables,

...

    1. Select

...

    1. "

...

    1. New

...

    1. "

...

    1. from

...

    1. the

...

    1. "

...

    1. Systems

...

    1. variables

...

    1. "

...

    1. box,

...

    1. type

...

    1. "

...

    1. JAVA_HOME

...

    1. "

...

    1. into

...

    1. "

...

    1. Variable

...

    1. name

...

    1. "

...

    1. and

...

    1. the

...

    1. path

...

    1. to

...

    1. your

...

    1. JDK

...

    1. installation

...

    1. into

...

    1. "

...

    1. Variable

...

    1. value

...

    1. "

...

    1. (Example:

...

    1. C:\Program

...

    1. Files

...

    1. (x86)\Java\jdk1.6.0_33

...

    1. )

...

  1. Download

...

  1. and

...

  1. install

...

  1. maven

...

  1. 3

...

  1. Set

...

  1. the

...

  1. environment

...

  1. variables

...

    1. =>

...

    1. from

...

    1. the

...

    1. field

...

    1. "

...

    1. System

...

    1. variables

...

    1. "

...

    1. select

...

    1. New

...

    1. ,

...

    1. Variable

...

    1. name

...

    1. "

...

    1. M2_HOME

...

    1. ",

...

    1. value

...

    1. Path

...

    1. to

...

    1. your

...

    1. maven

...

    1. installation

...

    1. (Example:

...

    1. D:\Maven\apache-maven-3.0.4

...

    1. )

...

    1. =>

...

    1. from

...

    1. the

...

    1. field

...

    1. "

...

    1. User

...

    1. variables

...

    1. for

...

    1. (your

...

    1. username)

...

    1. "

...

    1. select

...

    1. New

...

    1. ,

...

    1. Variable

...

    1. name

...

    1. "

...

    1. M2

...

    1. ",

...

    1. value

...

    1. "

...

    1. %M2_HOME%\bin

...

    1. "

...

    1. =>

...

    1. from

...

    1. the

...

    1. field

...

    1. "

...

    1. User

...

    1. variables

...

    1. for

...

    1. (your

...

    1. username)

...

    1. "

...

    1. select

...

    1. New

...

    1. ,

...

    1. Variable

...

    1. name

...

    1. "

...

    1. MAVEN_OPTS

...

    1. ",

...

    1. value

...

    1. "

...

    1. -XX:MaxPermSize=1024M

...

    1. "

...

  1. Close

...

  1. the

...

  1. CMD

...

  1. if

...

  1. you

...

  1. have

...

  1. running

...

  1. one

...

  1. Download

...

  1. and

...

  1. install

...

  1. msysgit

...

  1. or

...

  1. use

...

  1. a

...

  1. similar

...

  1. program

...

  1. to

...

  1. checkout

...

  1. a

...

  1. git

...

  1. repo

...

  1. Change

...

  1. into

...

  1. the

...

  1. previously

...

  1. outchecked

...

  1. directory

...

  1. Build

...

  1. with

...

  1. "

...

  1. mvn

...

  1. clean

...

  1. "

...

  1. and

...

  1. "

...

  1. mvn

...

  1. package

...

  1. -DskipTests

...

  1. "

Start a flume agent

  1. Edit the log4j.properties

...

  1. file

...

  1. too,

...

  1. simple

...

  1. change

...

  1. the

...

  1. logger

...

  1. facility

...

  1. from

...


  1. flume.root.logger=INFO,LOGFILE

...


  1. into
    flume.root.logger=DEBUG,CONSOLE

...

  1. Start

...

  1. Flume:

...


  1. flume-1.3.0-SNAPSHOT>"c:\Program

...

  1. Files

...

  1. (x86)\Java\jdk1.6.0_33\bin\java.exe"

...

  1. -Xmx20m

...

  1. -Dlog4j.configuration=

...

  1. file:///%CD%\conf\log4j.properties

...

  1. -cp

...

  1. "lib*"

...

  1. org.apache.flume.node.Application

...

  1. -f

...

  1. conf\test1.conf

...

  1. -n

...

  1. syslog-agent

...


  1. Explanation:

...


  1. Path

...

  1. to

...

  1. java.exe

...

  1. +

...

  1. Java

...

  1. related

...

  1. options

...

  1. +

...

  1. log4j

...

  1. config

...

  1. in

...

  1. Windows

...

  1. Uri

...

  1. style

...

  1. +

...

  1. Flume

...

  1. libs

...

  1. +

...

  1. application

...

  1. +

...

  1. config

Available sinks

This section will be extend from time to time. These sinks where reported in from users as working:

  1. Syslog TCP
  2. Syslog UDP
  3. Exec
  4. Avro
  5. HDFS
    1. When a cygwin installed HDFS node is available on the same host as the agent runs