A Limit of Densely Connected Convolutional Networks v1
Wenkai Huang, Guanglong Peng, Xuan L. Tang · 2019
Residual learning and skip connections can train very deep convolutional networks with a significant performance boost. On this basis, DenseNet proposes a dense connection structure in which each convolutional layer in the network can be directly connected to all the previous layers. Compared with ResNet, this dense structure can reduce the parameter size of the network to a greater extent and enhance the utilization of features. However, this dense structure still has the problem of parameter redundancy. In this paper, the accuracy of image classification is not affected by reducing unnecessary shallow connections in the network and reducing the parameter amount of the model. In this article, the method is referred to as A Limit of Densely Connected Convolutional Networks, or simply LimDenseNet. The method proposed in this paper is simple but effective, the experimental results on the CIFAR-10 and Tiny ImageNet datasets show that although the performance of LimDenseNet and DenseNet is comparable in the shallow network. By increasing the convolutional layers, the decrease range of parameters in the network gradually increases and the classification accuracy also improves. On the Tiny Imagenet, compared with DenseNet, LimDenseNet in layer 264 reduces the number of parameters by 17.40% when the classification error rate is basically the same.