Summary of Combinatorial methods for testing Internet of Things smart home systems
Bernhard Garn, Dominik‐Philip Schreiber, Dimitris E. Simos, Rick Kuhn, Jeffrey Voas, Raghu N. Kacker · 2023
In our recent work (https://doi.org/10.1002/stvr.1805), we reported on applying combinatorial testing to Internet of Things (IoT) home automation hub systems. We detailed the creation of a dedicated input parameter model (IPM) for such systems, which was then used with combinatorial test case generation strategies; and also presented our developed automated test execution framework containing two test oracles. We applied and evaluated our proposed methodological approach to a real-world IoT system and analyzed the obtained results from various combinatorial test sets having different properties. Additionally, we compared these results to those from a random testing approach. The empirical testing results pointed to multiple errors and observations in the tested real-world IoT system and all considered approaches performed nearly equally well.