Video coding for machines using region-of-interest-based retargeting
Sławomir Różek, Olgierd Stankiewicz, Sławomir Maćkowiak, Tomasz Grajek, Jakub Stankowski, Maciej Wawrzyniak, Mateusz Lorkiewicz, Ding Ding, Shan Ting Liu, Marek Domański · EURASIP Journal on Image and Video Processing · 2025
Abstract The work is focused on video compression for the scenarios, where the decoded video serves not only human viewers but also as input for systems implementing various machine vision tasks, such as object detection and tracking. The proposed innovative tool is based on retargeting video frames processed based on Regions of Interest (RoI), corresponding to the individual objects detected in the frames. Experimental evaluation demonstrates significant average bitrate reduction while maintaining the same quality, ranging from 3 to 57% depending on the machine vision task and encoding scenario. The proposal underwent thorough consideration within the MPEG group and was adopted for the upcoming Video Coding for Machines (VCM) technology.