An Enhanced Video Coding Technique Leveraging on Edge Aware Motion Modeling and Frame Super Resolution
Ashek Ahmmed, Mark R. Pickering, Andrew J. Lambert · 2022 IEEE 24th International Workshop on Multimedia Signal Processing (MMSP) · 2022
To capture motion homogeneity between successive frames, the edge position difference (EPD) measure based motion modeling (EPD-MM) has shown good motion compensation capabilities. The EPD-MM technique is underpinned by the fact that from one frame to next, edges map to edges and such mapping can be captured by an appropriate motion model. However, for higher resolution video sequences, the baseline EPD-MM approach, may fail to approximate the underlying motion field accurately. This is due to the difficulty in fitting motion model parameters by incorporating significantly large number of moving edge pixels. Observing the fact that in lower resolution version of the current frame$C$, the same scene structure is present although scaled down moving objects contain smaller number of edge pixels; in this paper we propose to carry out the EPD-MM over lower resolution form of$C$. The resultant edge motion compensated prediction is then upsampled back to the original resolution of$C$employing single image super resolution (SISR) technique. Experimental results show an improved prediction PSNR of 1.71 dB from the proposed approach compared to that of the baseline EPD-MM. Moreover, if this predicted frame is employed as an additional reference frame to encode$C$, bit rate savings of up to 8.48% is achievable over a HEVC reference and 0.2% is achievable over a VVC reference.