A Multi Modal Interaction Paradigm Combining Gaze Tracking and Keyboard
Luisa Brinkschulte, Robert George Mertens, Leon Strapper, Sebastian Pospiech, Lars Knipping · 2017
Most modern keyboard-based computer systems cannot be operated without pointing devices such as mice, trackballs or touch interfaces. They hence have two input modes: keyboard and pointing. A pointing device's purpose is to convey the user's focus of attention to the computer in order to connect actions like clicking or moving the mousepointer to specific areas of the display such as buttons or input fields. This demo paper introduces a multi modal approach (keyboard and eyetracking) that retains all functionalities of a pointing device while eliminating the need for an actual device. This goal is achieved by combining eyetracking with keyboard interaction. Initial informal user studies have suggested that the proposed interaction paradigm makes interaction that combines textual and pointing input (such as most work related tasks) more intuitive as it eliminates the need to switch input devices during interaction. The demo presents a working prototype implementation of the approach.