MiniNet: Dense squeeze with depthwise separable convolutions for image classification in resource-constrained autonomous systems

ISA Trans. 2023 Jan:132:120-130. doi: 10.1016/j.isatra.2022.07.030. Epub 2022 Aug 18.

Abstract

In recent years, artificial intelligence (AI) has been developed vigorously, and a great number of AI autonomous applications have been proposed. However, how to decrease computations and shorten training time with high accuracy under the limited hardware resource is a vital issue. In this paper, on the basis of MobileNet architecture, the dense squeeze with depthwise separable convolutions model is proposed, viz. MiniNet. MiniNet utilizes depthwise and pointwise convolutions, and is composed of the dense connection technique and the Squeeze-and-Excitation operations. The proposed MiniNet model is implemented and experimented with Keras. In experimental results, MiniNet is compared with three existing models, i.e., DenseNet, MobileNet, and SE-Inception-Resnet-v1. To validate that the proposed MiniNet model is provided with less computation and shorter training time, two types as well as large and small datasets are used. The experimental results showed that the proposed MiniNet model significantly reduces the number of parameters and shortens training time efficiently. MiniNet is superior to other models in terms of the lowest parameters, shortest training time, and highest accuracy when the dataset is small, especially.

Keywords: Convolutional neural network; Deep learning; DenseNet; Depthwise separable convolution; MobileNet; SENet.