Natural Language Access to Video Databases

Danny Francis, Paul Pidou, Bernard Mérialdo, Benoît Huet · 2017

This paper deals with natural language access to video databases. Two approaches are proposed: in the first one we use queries to find images similar to video keyframes, and in the second one we generate text descriptions from keyframes and compare them with queries. We propose four implementations of these approaches: one implementation of the first approach, two implementations of the second one and one implementation mixing both approaches. The results of our implementations are discussed, in particular regarding the visual content of natural language queries.

Read the paper · More papers on PaperTik