Distant Mid-Air Interaction via Accurate Gaze and Hand Posture Estimation with an Ultrafast Pan-Tilt Camera
Yuta Abe, Taishi Iriyama, Takashi Komuro, Kohei Shimasaki, Idaku Ishii · 2025
Ultrafast Pan-Tilt Camera 5m Figure 1: Distant mid-air interaction.(a) The user gazes at the screen and moves their hands 5 m away from the camera system.(b) The ultrafast pan-tilt camera simultaneously captures high-resolution images of the user's face, left hand, and right hand individually, enabling accurate estimation of gaze direction and hand posture.(c) While switching the region of interest (ROI) to the upper-right area of the large display using their gaze, the user is performing multi-touch interactions within the ROI, maintaining a natural posture without large arm movements.