Speech Interaction with Graphical User Interfaces.
Dan R. Olsen, Scott E. Hudson, Roger C. Tam, Genevieve Conaty, Matthew Phelps, Jeremy M. Heiner · 2001
This paper describes ICIE-Voice, a prototype system for supporting speech-only access to graphical user interfaces. This system is intended to work with a wide range of existing applications, but require only a minimal set of "hooks" into those applications. To achieve this, the system operates primarily by extracting information from the drawing pipeline of the user interface. This information is then mapped to speech utterances using a translation schema that is external to the application.