A Normalized Minimum Error Entropy Stochastic Algorithm
Seungju Han, Sudhir Rao, Kyu-Hwa Jeong, José Carlos Príncipe · 2006
We propose in this paper the normalized Minimum Error Entropy (NMEE). Following the same rational that lead to the normalized LMS, the weight update adjustment for Minimum Error Entropy (MEE) is constrained by the principle of minimum disturbance. Unexpectedly, we obtained an algorithm that not only is insensitive to the power of the input, but is also faster than the MEE for the same misadjustment, and also that is less sensitive to the kernel size. We explain these results analytically, and through system identification simulations.