...

Jenkins

Qpid uses the Apache Infrastructure CI service, which is a Hudson Jenkins installation. See here for more details.

Implementation

The implementation of CI for Qpid is being tracked as QPID-3149 and will be completed during the 0.11 development streamMore details are available from the Apache wiki. Builds can run on any operating system instance available, or be locked to a particular type. It may be necessary to restrict some build types to Unix instances only, but using Jenkins will give access to Solaris and Windows Server build environments which will be useful for interoperability testing. If a build tool such as Maven is used, even tighter integration with the build process is available, including better test access and the ability to use the Apache Maven repository for publishing artefacts.

Operation

All builds are prefixed with either qpidQpid- to allow grouping together, the Qpid view shows all jobs matching this pattern.

The proposed build entries are as follows:

• qpid-java-build - triggered by check-ins to subversion
• qpid-java-system-tests - nightly
• qpid-java-network - nightly, from branch with network layer changes
• qpid-cpp-build - triggered by check-ins to subversion
• qpid-cpp-system-tests - nightly
• qpid-python-tests - nightly, full run of python test kit
• qpid-release-build - nightly or weekly, full release
• qpid-interop-tests - nightly or weekly

The initial testing of the CI configuration is being carried out under Qpid Java Build until any issues are sorted out.

Note that it is possible to add builds from branches, to give increased visibility to proposed changes, and greater confidence in their reliability due to increased testing.

At present, these tests run a single profile, such as default or java.0.10. As the number of profiles increases, it may be better to use the Hudson matrix project feature to paramaterise the system test build around the test profile names.

following builds are configured:

A timeout of 60 minutes is set for all jobs.

Job Configuration Notes

Qpid Java Build/Release Configuration

The Java builds use the latest 1.6 release of the JDK, and the latest available Ant version, which are both dependent on the versions available on the Jenkins instance running the job.

Only JUnit test results are reported on currently.

The release job archives the following files:

• */release/.zip
• */release/.tar.gz
• */release/maven//.*

Qpid Cpp Build Configuration

The following commands are used to perform the Cpp build.

cd trunk/qpid/cpp

./bootstrap; ./configure CXXFLAGS="-Wno-unused-result";make clean;make -j4

(As of February 2013, the packages dependencies for Ubuntu 12.04 were: automake, g+, libboost, libboost1.46-dev, libboost-filesystem-dev, libboost-program-options-dev, libicu48, libstdc+6-4.4-dev, libtool, pkg-config, python2.7-dev , python-dev , ruby, sasl2-bin, subversion, uuid-dev, cmake, swig).

Qpid Python Test Configuration

The following commands are used to run the Python tests:

cd trunk/qpid/python
ulimit -n 1024 # Workaround QPID-3237 - reduce open filehandles
ant -file qpid-python-test-ant.xml -Dqpid.executable=../java/build/bin/qpid-server -Dpython.test.ignore=-I../java/test-profiles/python_tests/Java010PythonExcludes "-Dpython.test.modules=-mqpid_tests.broker_0_10 -m qmf.console" -Dqpid.port=25672 -Dqpid.executable.args="-p 25672 -m 25000" test

Proton-C

The build of proton-c required the addition of Ubuntu packages cmake, swig.

Future

Jenkins Hudson can be configured to provide many more features with its built-in plugins. These include:

• JUnit test FIXME/TODO task reporting
• Javadoc publishingRelease artifact publishing
• Coverage reports

The use of these plugins will be investigated once the basic build and test cycle is satisfactorily configured.

Issues

Currently, failover seems to be a problem.

• https://builds.apache.org/hudson/job/Qpid%20Java%20Build/ws/trunk/qpid/java/build/results/systests/TEST-org.apache.qpid.test.unit.ack.AcknowledgeAfterFailoverOnMessageTest.testAutoAck.err

Monitoring

Future functionality proposed includes:

• Switch CPP Build to use cmake
• Integrate Windows build for Java and CPP Brokers
• Publishing SNAPSHOT versions of Maven artefacts to the Apache repository after a successful nightly build

Notifications

All jobs are configured to send email to notifications@qpid.apache.org when a build fails, becomes unstable or returns to stableI propose creation of a new mailing list, qpid-build@apache.org which would receive a copy of all output from every CI build. Additionally, the results of failing builds should be mailed to committers that checked in the breaking changes, and a nightly (or weekly) summary from the release and/or interop test builds should be sent to the qpid-dev list.

Currently Andrew, Rajith, Robbie and Robbie Keith have access to the build configurations.

Sonar

quid-java-build (the Qpid Broker for Java and the AMQP 0-8..0-10 JMS Client) are set up in Sonar:

https://analysis.apache.org/dashboard/index?id=org.apache.qpid%3Aqpid-java-build