Page History

...

As future work, we can consider automation that generates a Pull Request with these changes.

Long Tail Failures

As with most statistical phenomena, there is a relatively high number of tests which will have a very occasional failure. These failures are extremely hard to diagnose due to their rare nature. Quarantining these tests would likely be ineffective because they would end up staying in the quarantine for too long. Instead, we can use the Develocity test retry feature to help with these. Rather than our permissive and broad application of the retries, we can use a stricter and more targeted approach.

References

1. https://testing.googleblog.com/2016/05/flaky-tests-at-google-and-how-we.html
2. https://junit.org/junit5/docs/current/user-guide/#extensions-conditions

...