Automated Functional Testing of Search Engines using Metamorphic Testing
Xinyi Wang, Gaolei Yi, Yichen Wang · 2021 IEEE 21st International Conference on Software Quality, Reliability and Security Companion (QRS-C) · 2021
Search engine refers to a system that collectsinformation on the Internet according to a certain strategy and provides users with search services. Faced with a large amount of information, the testers lack an oracle to verify whether the results returned are correct. The vertical search engine is established in a specific scenario. Its search query are limited. Further verification of vertical search data can greatly improve the quality of product to users. We apply the metamorphic testing (MT) tovertical search engines testing with metamorphic relationships(MRs), which replace the traditional oracle. We divide the MRs into explicit requirements and implicit requirements and develop tools. The tools is based on the Selenium framework, driven by search-engine-data to realize automated testing. We conduct experiments on the Baidu search engine, and the results proved that this method can achieve further verification of vertical data, greatly improve the badcase-rate and timeout-rates and error-rate.