CGGI-CM: Combining Gesture and Gaze Interface for CAD Modeling Based on Context Model

Hongwei Niu, Yuekang Wang, Jun He, Jia Hao, Hui Long, Qing Xue · International Journal of Human-Computer Interaction · 2025

Existing “gesture + gaze” multimodal interfaces for Computer-aided design (CAD) still suffer from fixed mapping relationships between interactive operations and CAD commands. In this paper, we proposed a multimodal interface CGGI-CM: Combining Gesture and Gaze Interface for CAD Modeling Based on Context Model. By introducing a context model that can describe human-computer interaction scenarios in CAD modeling, a flexible one-to-multi mapping of interactive operations to CAD commands was achieved and the number of CAD commands mapped by gesture increased by 100%. To verify the performance of CGGI-CM, a user experiment was conducted and the results were compared with those of a conventional “mouse + keyboard” interface (MKI). The experiment results showed that CGGI-CM posted superior performance in task completion time compared with MKI. For task operation accuracy, there is little difference between CGGI-CM and MKI. Moreover, users found that CGGI-CM is more intuitive and natural than MKI in CAD modeling.

Read the paper · More papers on PaperTik