A Study of Followable User Interface to Hand Behavior
Yamaguchi Takuya, Kozo Mizutani, Masayuki Arai · International Journal of Knowledge Engineering · 2015
In this work we study a followable user interface (FUI): a user interface that tracks the motion of the user's hand.In an FUI, the system provides a UI screen that tracks the motion of the user's palm.As a means of implementing such a system, we study a method involving an LCD projector and a depth sensor.In this paper we discuss methods for using the depth sensor to detect the position of the user's hand and for controlling the projection of the UI screen.Moreover, we discuss a method for detecting gestures in which the user places one hand on top of the other hand and makes sliding motions.As the result of constructing the prototype system with our methods, it is shown that the system was capable of properly projecting the UI to match the motion of the user's hand, to identify gestures, and to switch the UI based on this input.