Deep learning-based feature compression for video coding for machine

Jihoon Do, Jooyoung Lee, Younhee Kim, Seyoon Jeong, Jin Soo Choi · International Workshop on Advanced Imaging Technology (IWAIT) 2022 · 2022

We previously trained the compression network via optimization of bit-rate and distortion (feature domain MSE) [1]. In this paper, we propose feature map compression method for video coding for machine (VCM) based on deep learning-based compression network that joint training for optimizing both compressed bit rate and machine vision task performance. We use bmshij2018-hyperporior model in the CompressAI [2] as the compression network, and compress the feature map which is the output of stem layer in the Faster R-CNN X101-FPN network of Detectron2 [3]. We evaluated the proposed method by evaluation framework for MPEG VCM. The proposed method shows the better results than VVC of MPEG VCM anchor.

Read the paper · More papers on PaperTik