Affordance in mobile speech-based user interaction
Lars Bo Larsen, Kasper Løvborg Jensen, S.L. Larsen, Morten Højfeldt Rasmussen · 2007
We discuss the design of speech-based interaction systems from the perspective of affordance. It is our claim that many of the problems associated with speech interaction stems from a lack of a deeper understanding of the communicative nature of speech in combination with graphical interfaces. Today's graphical interfaces are almost universally based on the Direct Manipulation (DM) interaction paradigm, whereas speech interaction is in nature conversational. However, most multi modal systems accepting spoken input are designed with the DM paradigm as the underlying interaction model, often forcing the spoken input to correspond to simple commands, which are replicated in the GUI anyway. We will discuss how speech-based interfaces can be designed, taking into account that the DM paradigm is not supported by speech. We demonstrate this through the design of a concrete application for a portable device (PDA), and show how an underlying architecture can be built to support both spoken input and DM interfaces.