Intelligent sketching interfaces for richer mid-air drawing interactions

Paul Taele · 2014

Intelligent user interfaces that can understand the content of what we draw in mid-air can enable for exciting novel sketching applications, and for creating more creative designs and engaging content. Currently, existing interaction techniques have primarily focused on raw sketching interactions, while related sketch and gesture recognition techniques remain largely unexplored beyond surface spaces and constrained by limited symbolic gesture input vocabularies, respectively. The current dissertation work focuses on developing intelligent sketching user interfaces for enabling richer mid-air drawing interaction spaces. The goals of this work thus involve investigating recognition techniques for better understanding sketches made in the air, and interaction techniques for more optimal interaction cues to sketch more intuitively in the air. Preliminary work shows the potential of adapting existing surface recognition techniques for mid-air interaction spaces with low-level primitive shapes.

Read the paper · More papers on PaperTik