Supporting UI design by sketch and speech recognition
Roman Ženka, Pavel Slavı́k · 2004
We present a tool for rapid UI design using sketch and speech recognition. Our tool is designed to support conversation between a user and a designer within one room. Participants of the conversation discuss the UI orally while sketching UI layouts, storyboards and diagrams. A TabletPC is used to record and recognize both the speech and sketches created during discussion. The recognition is used for beautification of the sketches. The recording allows fast skimming through the results of the entire UI design session, freeing the designer from the tedious task of taking detailed notes.