Integration of audio/visual information for use in human-computer intelligent interaction
Vladimir Pavlović, G.A. Berry, Thomas S. Huang · 2002
Human-computer intelligent interaction (HCII) in virtual environments is a rapidly developing field. Natural human communication is multi-modal, however, most modern computer interfaces rely exclusively on one mode of interaction. We employ a novel approach to integrating multiple modes of human-computer communication. By using auditory and visual features at different levels of integration we explore optimal ways of combining these modalities.