How to set up Eclipse environment

Install Eclipse

Eclipse is an open source development community. If you have not already done so, download and install Eclipse on your development machine. For more information, see Eclipse and Eclipse IDE for Java Developers.

Download and Install the Eclipse Plugins

For Pig, you need the JavaCC plugin and theSubclipse Subversion plugin.

To download and install the plugins:

Open Eclipse
Select Help > Software Updates... > Available Software
Add the two plugin sites by pressing Add Site... Button
http://eclipse-javacc.sourceforge.net
http://subclipse.tigris.org/update_1.4.x
Select the plugins that appear under these sites
Press Install - and follow the prompts to download and install the plugins

Add the Pig Trunk Repository

To add the Pig trunk repository:

Open Eclipse
Select file > New > Other...
Choose SVN, Repository Location > Next
Under the General tab:
URL: http://svn.apache.org/repos/asf/pig/trunk
Use a custom label: Pig
Click Finish

To view the results:

Window > Open Perspective > Other... > SVN Repository Exploring
Window > Show View > SVN Repositories

Create a Java Project

First, create a directory on your development machine (for example "mypig") and checkout the Pig source from SVN: http://svn.apache.org/repos/asf/pig/trunk

Note: Windows users need to download and install TortoiseSVN (http://tortoiseSVN.tigris.org/)

To create a Java project:

Open Eclipse
Select file > New > Other ...
Select Java Project
On the New Java Project dialog:
Project name: PigProject
Select: Create project from existing source
Directory: browse to the "mypig" directory on your development machine and select the Trunk directory
Click Next
Click Finish

To view the results:

Window > Open Perspective > Java
Window > Show View > ''see the various options ...''

Update the Build Configuration

run 'ant eclipse-files' in trunk/ dir.
Refresh the project in eclipse
You are all set now!

The 'ant eclipse-files' target that generates eclipse configuration does not exist in revisions before r938733. So if you checked out an earlier version, you have to follow the steps below -

After the Java project is created, update the build configuration.

To update the build configuration:

Open Eclipse
Select Window > Open Perspective > Java (to open the !MyPig project)
Select Project > Properties
For the Java Build Path, check the settings as shown below.

Source

lib-src/bzip2
lib-src/shock
src -> Make sure nothing is excluded
src-gen -> To get this do "ant clean jar" externally which will create this dir (refresh in eclipse to see it)
test -> Make sure nothing is excluded

The default output folder should be bin.

Libraries

lib/hadoopXXX.jar
lib/hbaseXXX-test.jar
lib/hbaseXXX.jar
lib/Pig/zookeeper-hbase-xxx.jar
build/ivy/lib/Pig/javacc.jar
build/ivy/lib/Pig/jline-XXX.jar
build/ivy/lib/Pig/jsch-xxx.jar
build/ivy/lib/Pig/junit-xxx.jar

NOTE:

For pig sources checked out from Apache before revision r771273, replace "build/ivy/lib/Pig" with "lib". Revision r771273 and above in apache svn use ivy to resolve dependencies need to build pig.
If you are building piggybank you will need few extra jars. You can find all of those in build/ivy/lib/Pig/ once you run jar target of ant successfully.

Order and Export

Should have be the following order:

test
lib-src/bzip2
lib-src/shock
src-gen
src
JRE System Library
all the jars from the "Libraries" tab

Troubleshooting

Build problems: Check if eclipse is using JDK version 1.6, pig needs it (Under Preferences/Java/Compiler).

Tips

To build using eclipse , open the ant window (Windows/Show View/Ant) , then drag and drop build.xml under your project to this window. Double click on jar in that will build pig.jar, on test will run unit tests.

Child pages