On the fixed-point-error analysis of several fast DCT algorithms
Il Dong Yun, Sang Uk Lee · IEEE Transactions on Circuits and Systems for Video Technology · 1993
A fixed-point-error analysis for several 1D fast DCT algorithms is presented. For comparison, a direct-form approach is also included in the investigation. A statistical model is used as the basis for predicting the fixed-point error in implementing the algorithms, and a suitable scaling scheme is selected to avoid overflow. Closed-form expressions for both the mean and variance for fixed-point error are derived and compared with experimental results. Simulation results show close agreement between theory and experiment, validating the analysis. The results show that one of the algorithms is better than others in terms of average SNR performance. Based on the 1D analysis, attempts are made to investigate the fixed-point-error analysis of the two-column approach for 2D DCT. It is found that the fixed-point-error characteristics of the row-column approach for 2D DCTs is very similar to that of their 1D counterparts.>