Roundoff noise minimization for 2-D separable-denominator digital filters using jointly optimal high-order error feedback and realization
Takao Hinamoto, Akimitsu Doi, Wu-Sheng Lu · 2017
The joint optimization problem of high-order error feedback and realization for minimizing roundoff noise at the filter output subject to-scaling constraints for two-dimensional (2-D) separable-denominator digital filters is investigated. Linear algebraic techniques that convert the problem at hand into an unconstrained optimization problem are explored, and an efficient quasi-Newton algorithm is then applied to solve the unconstrained optimization problem iteratively. Closed-form formulas for fast and accurate gradient evaluation are derived. A numerical example is presented to demonstrate the validity and effectiveness of the proposed technique.