An Emperical Study on the Test Adequacy Criterion Based on Coincidental Correctness Probability
Linzhang Wang, Xuandong Li, Jianhua Zhao, Xiaoli Zhou · Software Engineering and Knowledge Engineering · 2014
Coincidental correctness occurs when a fault is executed but no failure is detected. Coincident correctness is prevalent and adversely affects the effective of testing. In this paper, we improve the test adequacy criterion based on coincidental correctness probability which is proposed in our previous work and make an empirical study comparing our test adequacy criterion with two coverage-based test criteria. We take the Pearson Correlation Coefficient between the adequacy level and the capability of the test suite to find errors as a metric of the effectiveness. Our experiment involved 20 seeded versions of the programs from SIR. The results consistently approve that our test adequacy can effectively quantizes the capability of test suite to find errors.