Network Compression via Cooperative Architecture Search and Distillation
Fanghui Xue, Jack X. Xin · 2021
Neural Architecture Search (NAS) and its variants are competitive in many computer vision tasks lately. In this paper, we develop a Cooperative Architecture Search and Distillation (CASD) method for network compression. Compared with prior art, our method achieves better performance in ResNet164 pruning on CIFAR-10 and CIFAR-100 image classifications, promising to be extended to other tasks.