A Transfer Learning Method for Deep Networks with Small Sample Sizes
Xin Wei Zheng, Luyue Lin, Shouzhi Liang, Bo Rao, Ruidian Zhan · Journal of Physics Conference Series · 2020
Abstract Transfer learning is that a machine learning model learns knowledge from more than one domain, and it is applied to the context of small sample size. Some of approaches concentrate on the correlation determination among all domains while some pay more attention on knowledge transfer among all domains. In this paper, on the basic of SVM with hinge loss, a new regularized transfer learning deep network with a specific regularization is proposed, in which a deep network learns high level representation with respect to the given samples. And a part of parameters in SVM are shared such that the similarity of data distribution can be well captured. Besides, a modified regularized SVM is exploited such that the gradient based method is feasible, which yields a parallel implementation of the proposed method. After that, in the experiment part, the comparison of our approach with state-of-the-art approaches manifests the competitive performance and the feasibility in classification.