First Impressions: A Visual Catalogue for Understanding Interactions with Novel Interfaces in Augmented Reality
Steven Alan Scott, Awais Hameed Khan, Ben Matthews · 2022
Although Augmented Reality (AR) has become increasingly common, the design of AR interfaces has predominantly relied on importing traditional 2D digital GUI interface elements. These do not always translate successfully to novel, three-dimensional, AR interfaces. To understand how users develop a folk understanding of AR interfaces, we conducted six workshops with participants to investigate their initial interactions with off-the-shelf puzzle interfaces, across three modes: tangible, handheld tablet, and head-mounted display (HMD) AR systems. We captured multiple points-of-view video data and co-analyzed it with participants. Our study (1) presents a catalogue of interactional gestures across the three modes; (2) highlights how errors are perceived as features in AR systems; (3) analyzes the evolution of gestures; and (4) identifies implications of occlusion and spatial judgement errors.