An Interaction System Using Mobile Devices in an Intelligent Space
Jiashuai CHEN, Yasuyuki Fujii, Dinh Tuan Tran, Joo-Ho LEE · The Proceedings of JSME annual Conference on Robotics and Mechatronics (Robomec) · 2025
Intelligent Space (iSpace) requires an interface to help users interact with surrounding devices. Previous research proposed R-Fii (Real-world Flexible Interaction Interface), which uses mobile devices as the main interface. However, it requires pre-collected training data for object recognition and struggles to distinguish identical objects. This paper proposes an improved system that integrates YOLO-World to eliminate the need for training data collection. It also uses the mobile device’s position and orientation data to enhance object recognition and differentiation. Experiments under different conditions confirm that the proposed system improves object recognition and interaction in iSpace.