Using N o n-negative S p arse P ro les in a H ierarch ical Featu re E x tractio n N etw o rk
Ingo Bax, Gunther Heidemann, Helge Joachim Ritter · 2005
Ab s tr a c t In this contribution w e utiliz e recent advances in feature coding strategies for a hierarchical N eocognitron-like neural architecture, w hich can be used for invariant recognition of natural visual stimuli like objects or faces. Several researchers have identi ed that sparseness is an important coding principle for learning receptive eld pro les that resemble response properties of simple cells in visual cortex. How ever, an ongoing discussion is concerned w ith the question w hether sparseness should be imposed on the latent variables n as implicitly done in ICA or Sparse Coding n or if it should rather be imposed directly on the feature matrix. Since answ ers to this question have so far not been unique and w ere rather qualitative in nature, this paper investigates the tw o possibilities by applying a recently introduced algorithm for N on-negative Matrix Factoriz ation w ith Sparseness Constraints (N MFSC) to feature learning in a hierarchical recognition netw ork. For this netw ork, w e compare recognition performance on several dif cult image datasets under varying sparseness settings.