Sketching Over Props: Understanding and Interpreting 3D Sketch Input Relative to Rapid Prototype Props
Bret Jackson, Daniel F. Keefe · 2011
We present a discussion of our recent work to understand and interpret 3D sketch input made relative to rapid proto-type props. 3D printing technology has now matured to the point where it is readily available for use in creating rapid prototypes of scientific and other datasets to support physi-cal visualization of complex 3D geometries. We believe that the utility of these physical printouts can be dramatically in-creased if we can better understand how to use them as in-teractive tools rather than simply static physical displays. To this end, we have been exploring the potential of combining 3D sketch-based interfaces with physical rapid prototypes for accomplishing tasks such as linking the physical print-out with complementary stereoscopic visualizations of data inside the bounding surface of the 3D geometry. This re-search trajectory raises several interesting discussion points related to understanding how best to bring sketch recognition to this new 3D application. In this paper, we describe the research context and initial insights that we have obtained through a formative design critique of our current sketching interface. We conclude by identifying four specific research challenges that we believe are critical for better understand-ing how sketch-based input can be used to turn rapid proto-type props into highly-interactive visualization tools. Author Keywords Gesture recognition, pen-based interfaces, sketch-based in-