Hybrid Cross-Reality Collaborative System
Hyunwoo Cho, Eunhee Chang, Zhuang Chang, Jiashuo Cao, Bowen Yuan, Jonathon Derek Hart, Gun Lee, Thammathip Piumsomboon, Mark Billinghurst · 2023
This work introduces a Mixed Reality (MR)-based hybrid cross-reality collaborative system that enables recording and playback of user actions in a large task space over time. An expert records their actions, such as virtual object placement, that others can view in Augmented Reality (AR) or Virtual Reality (VR) later to complete a task. VR offers a pre-scanned 3D workspace for spatial understanding, while AR gives real-scale information for manipulating real objects. Users can easily switch between AR and VR views, enhancing task performance and co-presence during asynchronous collaboration. The system is showcased in an object assembly scenario with parts retrieved from a storehouse. A pilot study showed that this cross-reality system improved task completion speed with lower workload.