Dense Residual Network: Enhancing global dense feature flow for character recognition

Neural Netw. 2021 Jul:139:77-85. doi: 10.1016/j.neunet.2021.02.005. Epub 2021 Feb 25.

Abstract

Deep Convolutional Neural Networks (CNNs), such as Dense Convolutional Network (DenseNet), have achieved great success for image representation learning by capturing deep hierarchical features. However, most existing network architectures of simply stacking the convolutional layers fail to enable them to fully discover local and global feature information between layers. In this paper, we mainly investigate how to enhance the local and global feature learning abilities of DenseNet by fully exploiting the hierarchical features from all convolutional layers. Technically, we propose an effective convolutional deep model termed Dense Residual Network (DRN) for the task of optical character recognition. To define DRN, we propose a refined residual dense block (r-RDB) to retain the ability of local feature fusion and local residual learning of original RDB, which can reduce the computing efforts of inner layers at the same time. After fully capturing local residual dense features, we utilize the sum operation and several r-RDBs to construct a new block termed global dense block (GDB) by imitating the construction of dense blocks to adaptively learn global dense residual features in a holistic way. Finally, we use two convolutional layers to design a down-sampling block to reduce the global feature size and extract more informative deeper features. Extensive results show that our DRN can deliver enhanced results, compared with other related deep models.

Keywords: Down-sampling block; Fast dense residual network; Global dense block; Global dense residual learning; Text image representation and recognition.

MeSH terms

  • Deep Learning*
  • Neural Networks, Computer*
  • Pattern Recognition, Automated / methods*