Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

This page specifies the rules and guidelines for developers and QA when dealing with CloudStack's BVT and automated regression tests.

Why BVT and

...

Regression Tests

CloudStack deals with a wide range of hardware resources physical and virtual resources.  It is impossible for anyone any one developer/QA to test if their feature/functionality works across all of the supported resources.  CloudStackCloudStack's BVT and automated regression tests provide a method for developers to submit their changes to be tested across the supported infrastructure.  It also allows support for  Physical/Virtual resource providers can also donate their resources and tests to the BVT and regression test systems.  

Principles
  • BVT and Regression Tests must be fully automated.  This means it is automated in all phases: deployment, setup, execution, reporting, and bug filing.
  • Any code that breaks BVT and Regression Tests on master and all release branches must be reverted.
  • Any code that breaks BVT and Regression Tests on feature branches will be marked as P0 bug for that feature.
  • All tests are maintained by developers and QA.  If a feature changes CloudStack behavior to cause a breakage in the tests, it is the feature developer/s responsibility to fix the tests 
How to donate hardware/software for integration testing
Rules and Guidelines for Developers and QA
Principles behind