Snapscreen: TV-stream frame search with projectively distorted and noisy query
Natalya S. Skoryukina, Timofey S. Chernov, Konstantin B. Bulatov, Dmitry Nikolaev, Vladimir V. Arlazarov · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2017
In this work we describe an approach to real-time image search in large databases robust to variety of query distortions such as lighting alterations, projective distortions or digital noise. The approach is based on the extraction of keypoints and their descriptors, random hierarchical clustering trees for preliminary search and RANSAC for refining search and result scoring. The algorithm is implemented in Snapscreen system which allows determining a TV-channel and a TV-show from a picture acquired with mobile device. The implementation is enhanced using preceding localization of screen region. Results for the real-world data with different modifications of the system are presented.