Enhancing AR/VR Experiences with a Pinch-Gesture Multi-Layer Virtual Keyboard System

Dong-Gyu Kim, Viduranga Munasinghe, Tae-Ho Lee, Hyun-Jun Jin, Tae Sung Kim, Jin-Sung Kim, Hyuk-Jae Lee · 2025

Advancements in augmented reality (AR) and virtual reality (VR) technologies suggest that AR/VR devices will soon become widely accessible. Despite this growth, there remains a lack of specialized virtual keyboard systems optimized for AR/VR interactions. To address this, we propose a multi-layer virtual keyboard system utilizing pinch-based gesture recognition, specifically designed for AR/VR applications. Our simulation model demonstrates that the proposed system achieves significantly faster typing speeds due to its layered structure and gesture-based interface, resulting in substantial gains in user input efficiency and experience compared to traditional keyboard solutions.

Read the paper · More papers on PaperTik