Do Test and Environmental Complexity Increase Flakiness? An Empirical Study of SAP HANA
Alexander Berndt, Thomas Bach, Sebastian Baltes · 2024
Background: Test flakiness is a major problem in the software industry. Flaky tests fail seemingly at random without changes to the code and thus impede continuous integration (CI). Some researchers argue that all tests can be considered flaky and that tests only differ in their frequency of flaky failures. This position implies that the definition of test flakiness includes failures caused by interruptions in the testing environment.