Page History

...

The rough plan to move forward is as follows:

• Pick a new framework, or develop one (see further one 

• We chose to use ducktape (https://github.com/confluentinc/ducktape   - see notes below)

• Identify “MVP” tests - i.e. a set of high priority tests to fill in major gaps in our existing system test coverage (see further notes below)

• Identify “long tail” of less urgent tests.

• Stabilize and prune existing system tests so they can be run regularly until they are ported(?)

Framework Choice

We are currently evaluating evaluated Zopkio (https://github.com/linkedin/Zopkio) which is used internally at LinkedIn for Samza and other projects, and Confluent’s ducttape ducktape (https://github.com/confluentinc/ducktape) which is used in system tests for the Confluent Platform (https://github.com/confluentinc/ducttape)muckrake)

 and concluded that ducktape better matched our use case (see comparison table below). Continued development on ducktape is needed, but it is far enough along to be a useful tool for a wide variety of system testsBoth options require further development effort but represent improvement over the existing framework.

...