Integrated audiovisual processing for object localization and tracking
Gopal Sarma Pingali · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 1997
This paper presents a system that combines audio and visual cues for locating and tracking an object, typically a person, in real time. It is shown that combining a speech source localization algorithm with a video-based head tracking algorithm results in a more accurate and robust tracker than that obtained using any one of the audio or visual modalities. Performance evaluation results are presented with a system that runs in real time on a general purpose processor. The multimodal tracker has several applications such as teleconferencing, multimedia kiosks and interactive games.