A Gaze Tracking Based, Multi Modal Human Computer Interaction Concept for Efficient Input
Leon Strapper, Robert George Mertens, Sebastian Pospiech, Florian Bussmann, Arthur Grah, Marius Mamsch · 2017
The computer mouse is the main interaction device for graphical user interfaces. Many attempts have been made to replace it or render it obsolete, ranging from more ergonomically shaped designs to pen-like devices or touch screens. While the latter have opened up the way for completely new interaction designs mainly on mobile devices, PC and laptop users still prefer the computer mouse as a pointing device, especially when used in conjunction with a keyboard. This paper provides an analysis on how users interact with different pointing devices and identifies factors for efficient pointing-based human-computer-interaction in standard working scenarios. Based on this analysis a concept for minimally distracting pointing based human computer interaction is introduced. The concept is based on a multimodal combination of gaze tracking and keyboard, enabling users to interact with a keyboard alone in scenarios that usually require a keyboard in conjunction with a pointing device. The paper also presents a prototype and discusses its conceptual and implementation details.