User-Defined Gestures for Touchless Interaction in Sterile Operating Room
Huiyue Wu, Haiqi Pei, Zhitong Ma, Yu Wang · International Journal of Human-Computer Interaction · 2025
Traditional methods of viewing medical images (e.g., the PACS system), typically require surgeons to interact with a computer through physical devices such as keyboards and mice, which may violate the sterile principles of the operating room. To address this issue, this study introduces an augmented reality (AR) technology paired with a user-defined gesture set that aligns with surgeons' mental models, allowing surgeons to access and manipulate the PACS system on AR glasses while maintaining sterile conditions. This study represents a beneficial attempt at participatory design for professional users (surgeons) in a constrained space (sterile interaction zone), offering significant theoretical implications and practical value for sterile interaction of other smart medical devices and future Spatial Computing applications.