Automated Testing of Android Applications Integrating Residual Network and Deep Reinforcement Learning
Lizhi Cai, Jilong Wang, Mingang Cheng, Jin Wang · 2021 IEEE 21st International Conference on Software Quality, Reliability and Security (QRS) · 2021
With the improvements of Deep Reinforcement Learning (DRL), there have been tremendous interests in utilizing DRL for automated application testing. However, most automated testing methods based on reinforcement learning have the problem of interacting with invalid UI areas and invalid interactions with controls. To solve this problem, this paper extracts the page features, constructs the Interactive Control Feature Diagram(ICCD); improves the DDQN network structure, adds the residual network, makes the algorithm take the picture as the input, and splits the original single output action(n*w*h) into two successive outputs: the interaction(1,n) and the position(1,w*h); a new reward function which combines the interaction times and the image similarity of ICCD is proposed to explore different UIs and ensure that there will be more than one action will be executed under the same UI. Experiments are carried out on five open source applications. The experimental results show that the proposed method is superior to other methods in code coverage and branch coverage.