FFENet: frequency-spatial feature enhancement network for clothing classification

PeerJ Comput Sci. 2023 Sep 14:9:e1555. doi: 10.7717/peerj-cs.1555. eCollection 2023.

Abstract

Clothing analysis has garnered significant attention, and within this field, clothing classification plays a vital role as one of the fundamental technologies. Due to the inherent complexity of clothing scenes in real-world environments, the learning of clothing features in such complex scenes often encounters interference. Because clothing classification relies on the contour and texture information of clothing, clothing classification in real scenes may lead to poor classification results. Therefore, this paper proposes a clothing classification network based on frequency-spatial domain conversion. The proposed network combines frequency domain information with spatial information and does not compress channels. It aims to enhance the extraction of clothing features and improve the accuracy of clothing classification. In our work, (1) we combine the frequency domain information and spatial information to establish a clothing feature extraction clothing classification network without compressed feature map channels, (2) we use the frequency domain feature enhancement module to realize the preliminary extraction of clothing features, and (3) we introduce a clothing dataset in complex scenes (Clothing-8). Our network achieves a top-1 model accuracy of 93.4% on the Clothing-8 dataset and 94.62% on the Fashion-MNIST dataset. Additionally, it also achieves the best results in terms of top-3 and top-5 metrics on the DeepFashion dataset.

Keywords: Clothing; Convolutional neural network; Drequency domain enhancement; Feature extraction; Image classification.

Associated data

  • figshare/10.6084/m9.figshare.22220011.v1

Grants and funding

This work was supported by the National Natural Science Foundation of China (No. 62202346), the Hubei key research and development program (No.2021BAA042), the open project of engineering research center of Hubei province for clothing information (No. 2022HBCI01), the Wuhan applied basic frontier research project (No. 2022013988065212), MIIT’s AI Industry Innovation Task unveils flagship projects (Key technologies, equipment, and systems for flexible customized and intelligent manufacturing in the clothing industry), and the Hubei science and technology project of safe production special fund (Scene control platform based on proprioception information computing of artificial intelligence). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.