Multimodal surrogates for video browsing
Wei Ding, Gary Marchionini, Dagobert Soergel · 1999
Three types of video surrogates visual (keyframes) , verbal (keywords/phrases), and visual and verbal were designed and studied in a qualitative investigation of user cognitive processes. The results favor the combined surrogates in which verbal information and images reinforce each other, lead to better comprehension, and may actually require less processing time. The results also highlight image features users found most helpful. These findings will inform the interface design and video representation for video retrieval and browsing Keywords Multimedia information systems, abstracting methods, multimodal video surrogates, browsing, cognitive processes 1. INTRODUCTION Use of digital videos on the Web is becoming more common for education and academic communication as well as for entertainment. As video collections grow, users must be provided with effective searching and browsing tools to facilitate quick and easy access. This requires appropriate surrogates to represent original ...