Regression

Single-Server Regression

Used to check all the features work correct after any changes.

Multi-Server Regression

Used to check important features behaviour

• on a real cluster (with different hardware, software, environment settings)
• with plugins (eg. GridGain, SberEdition, etc).

Checks

Integration Checks

Used to check integrations with other projects (eg. Zookeeper, Kafka, Spark, etc).

Rolling Upgrade Checks

Used to check migrations from one version/vendor to another.

PoC Checks

Used to check some concept or to automate MVP demonstration.

Consistency Checks

Used to check data consistency during the typical load.

Fuzzy Checks

Used to check results correctness during mixed load.

Crash Recovery Checks

Used to check system behaviour on crashes.

Benchmarks

Process Benchmarks

Used to check measure duration of important precesses (eg. PME, Snapshot, Rebalance, Node start, etc)

Profile Benchmarks

Used to check customer's profile performance on some environment.

Synthetic Benchmarks

Used to compare overall performance from version to version and from commit to commit