A Retrieval System for Images and Videos based on Aesthetic Assessment of Visuals

Daniel Vera Nieto, Saikishore Kalloori, Fabio Zünd, Clara Fernandez-Labrador, Marc Willhaus, Severin Klingler, Markus H. Groß · 2023

Attractive images or videos are the visual backbones of journalism and social media to gain the user's attention. From trailers to teaser images to image galleries, appealing visuals have only grown in importance over the years. However, selecting eye-catching shots from a video or the perfect image from large image collections is a challenging and time-consuming task. We present our tool that can assess image and video content from an aesthetic standpoint. We discovered that it is possible to perform such an assessment by combining expert knowledge with data-driven information. We combine the relevant aesthetic features and machine learning algorithms into an aesthetics retrieval system, which enables users to sort uploaded visuals based on an aesthetic score and interact with additional photographic, cinematic, and person-specific features.

Read the paper · More papers on PaperTik