AI Test Modeling and Analysis for Intelligent Chatbot Mobile App - A Case Study on Wysa
Jerry Zeyu Gao, Prerna Garsole, Radhika Agarwal, Shengqiang Liu · 2024
The functionalities of AI-powered mobile apps or systems heavily depend on the given training dataset. The challenge, in this case, is that a learning system will change its behavior due to a slight change in the dataset. Current alternative approaches for evaluating these apps either focus on individual performance measurements such as accuracy, etc. Inspired by principles of the decision tree test method in software engineering, this paper provides a tutorial discussion on intelligent AI test modeling chat systems including basic concepts, validation process, testing scopes, approaches, and needs. The report is about an intelligent AI test modeling chatbot system that is built and implemented based on an innovative 3D AI test model for AI-powered functions in intelligent mobile apps to support model-based AI function testing, test data generation, auto test scripting and execution, and adequate test coverage analysis.