Minimum mean square error linear predictor with rounding
Fu Yuan Tsai, Huei Peng · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 1995
Many digital signal processing and image coding systems implement the linear predictor with rounding. Usually, people will obtain the linear predictors by solving the Yule-Walker equations or doing something equivalent. The predictors obtained in this way will not necessarily be the true minimum mean square error predictor considering the effect of rounding. In this paper, we address the issue of finding the true optimum mean square error rounded linear predictor. Experiment results show that when the prediction results are rounded, this true MMSE linear predictor could outperform the conventional one without considering the effect of rounding very significantly for data of low prediction errors.