Dense deep stochastic configuration network with hybrid training mechanism
Weidong Zou, Yuanqing Xia, Weipeng Cao · International Journal of Computing Science and Mathematics · 2022
Thanks to the supervised parameter generation strategy and non-iterative training mechanism, deep stochastic configuration network (DSCN) has achieved very efficient modelling efficiency in scenarios with relatively small problem complexity. However, the increasing number of hidden layers and the amount of training data have issued a challenge to the implementation of DSCN. To solve this problem, we propose a Dense DSCN with a Hybrid Training mechanism (HT-DDSCN), which extends the network structure of the DSCN to a dense connection type and combines three typical optimisation techniques and one universal control strategy to optimise the calculation process of the output weights. Extensive experiments on four benchmark regression problems show that HT-DDSCN can significantly improve the generalisation ability and the stability of DSCN.