A Long-Short Term Memory Neural Network Based Rate Control Method for Video Coding
Zheng-Teng Zhang, Jucai Lin, Ruidong Fang, Juan Lu, Yao Chen · 2018
In industrial and practical application, the robust rate control method is highly required in field of video coding. In this paper, a Long-Short Term Memory (LSTM)-based method is proposed to optimize x264 rate control. The bitrate and distortion information are used to construct the LSTM recurrent neural network to predict a quantization parameter (QP) at inter frame level. Then a QP refinement strategy is utilized to further improve the relationship between the QP and bitrate. Finally, the average bitrate control (ABR) method is optimized to provide more accurate bitrate while encoding. Experimental results show that the proposed method achieves 1.2% BD-rate reduction in HM test sequence, and 1.0% in surveillance video. Meanwhile, the target bit matching rate is up to 98.9% and 99.7%, respectively.