A comprehensive review of interaction methods for mixed reality sandbox applications
Guowei Wang, Zemin Li, Yifei Li, Cong Liu, Junjie Shen · 2024
Mixed reality (MR) technology is a combination of computer technologies that introduce real-world information into virtual environments and enable interaction between the two within a unified visual space. As a typical application form of MR technology, mixed reality sandbox applications significantly enhance the ability for three-dimensional situational awareness. Human-computer interaction (HCI), as an essential component of MR technology, directly affects the user experience of MR technology and has been a hot topic of research both domestically and internationally in recent years. Introducing gesture interaction into mixed reality sandbox systems can well meet users' needs for continuous observation and editing of three-dimensional objects, providing a real-time and natural interaction experience for users. This paper focuses on mixed reality sandbox applications, discusses the design principles and evaluation methods for human-computer interaction oriented towards mixed reality sandboxes, proposes a set of general non-contact gesture interaction rules, investigates the cross-critical technologies relied upon in interaction methods within mixed reality, summarizes the issues that need to be addressed in the next phase of research for mixed reality sandbox applications, and finally provides a conclusion and outlook for the study of interaction methods in mixed reality sandbox applications.