DrawTalking: Towards Building Interactive Worlds by Sketching and Speaking
Karl Rosenberg, Rubaiat Habib Kazi, Li‐Yi Wei, Haijun Xia, Ken Perlin · 2024
We introduce DrawTalking, a prototype system enabling an approach that empowers users to build interactive worlds by sketching and speaking. The approach emphasizes user control and flexibility, and gives programming-like capability without requiring code. An early open-ended study shows the mechanics resonate and are applicable to many creative-exploratory use cases, with the potential to inspire and inform research in future natural interfaces for creative exploration and authoring.