Feature Selection Using a Neural Network With Group Lasso Regularization and Controlled Redundancy
Jian Wang, Huaqing Zhang, Junze Wang, Yi‐Fei Pu, Nikhil Ranjan Pal · IEEE Transactions on Neural Networks and Learning Systems · 2020
-norm of weight matrix between the input and hidden layers. These penalty terms are nonsmooth at the origin, and hence, one simple but efficient smoothing technique is employed to overcome this issue. The monotonicity and convergence of the proposed algorithm are specified and proved under suitable assumptions. Then, extensive experiments are conducted on both artificial and real data sets. Empirical results explicitly demonstrate the ability of the proposed FS scheme and its effectiveness in controlling redundancy. The empirical simulations are observed to be consistent with the theoretical results.