Improving the Flexibility of Video Events Retrieval Through Dynamic Conditional Refinement With Multilingual Capabilities
Thang-Long Nguyen-Ho, Van-Tu Ninh, Minh–Triet Tran, Graham F. Healy, Cathal G. Gurrin · 2024
Our paper introduces a novel middleware designed to enhance the user experience of novice users of video event retrieval systems. The middleware simplifies the search process while maintaining advanced semantic information-seeking features. It achieves this by refining sentence representation, rewriting the original query based on user intent and dataset metadata knowledge, reducing ambiguities, and increasing relevance with domain-specific terms. Our approach allows users to provide simplified descriptions, while the system automates query refinement and parameterizes these for different search functions. This reduces the difficulty of navigating complex user interfaces and selecting from available functionalities. Additionally, the multilingual feature supports non-native English speakers by helping them describe their queries more effectively. In general, our system is suitable for people who are not experienced in advanced retrieval tasks, specifically focusing on its applicability in the special session Interactive Video Retrieval for Beginners (IVR4B).