Modeling semantic concepts to support query by keywords in video
Milind Ramesh Naphade, Sukanta Basu, J. R. Smith, Ching‐Yung Lin, Belle L. Tseng · Proceedings - International Conference on Image Processing · 2003
Supporting semantic queries is a challenging problem in video retrieval. We propose the use of a lexicon of semantic concepts for handling the queries. We also propose automatic modeling of lexicon items using probabilistic techniques. We use Gaussian mixture models to build computational representations for a variety of semantic concepts including rocket-launch, outdoor greenery, sky etc. Training requires a large amount of annotated (labeled) data. Using the TREC Video test bed we compare the performance of this system supporting query by keywords with the conventional approach of query by example. Results demonstrate significant gains in performance using the automatically learnt models of semantic concepts.