Minimizing Quantization Effects in Digital Filtering
Arulalan Rajan, H. S. Jamadagni, Ashok Rao · 2009
Quantization errors and errors due to finite word-length registers in processors result in undesirable responses in many cases. Along with these two errors, in some cases, data samples may not have exact representations in binary form. Hence it is very important to mitigate the effects of these errors. In this paper, we discuss the various errors arising in digital filters and the effect of using integer sequences for windowing techniques in FIR filtering to minimize these errors. We find that using integer sequences as window functions, the error in filter coefficients reduce by at least 30% in case of lower magnitude coefficients.