DRF-DRC: dynamic receptive field and dense residual connections for model compression

Cogn Neurodyn. 2023 Dec;17(6):1561-1573. doi: 10.1007/s11571-022-09913-z. Epub 2022 Nov 14.

Abstract

Deep convolutional neural networks have achived remarkable progress on computer vision tasks over last years. These novel neural architecture are most designed manually by human experts, which is a time-consuming process and not the best solution. Hence neural architecture search (NAS) has become a hot research topic for the design of neural architecture. In this paper, we propose the dynamic receptive field (DRF) operation and measurable dense residual connections (DRC) in search space for designing efficient networks, i.e., DRENet. The search method can be deployed on the MobileNetV2-based search space. The experimental results on CIFAR10/100, SVHN, CUB-200-2011, ImageNet and COCO benchmark datasets and an application example in a railway intelligent surveillance system demonstrate the effectiveness of our scheme, which achieves superior performance.

Keywords: Light-weight CNN; Model compression; Neural architecture search (NAS); Search space.