Recognition of food images based on transfer learning and ensemble learning

PLoS One. 2024 Jan 19;19(1):e0296789. doi: 10.1371/journal.pone.0296789. eCollection 2024.

Abstract

The recognition of food images is of great significance for nutrition monitoring, food retrieval and food recommendation. However, the accuracy of recognition had not been high enough due to the complex background of food images and the characteristics of small inter-class differences and large intra-class differences. To solve these problems, this paper proposed a food image recognition method based on transfer learning and ensemble learning. Firstly, generic image features were extracted by using the convolutional neural network models (VGG19, ResNet50, MobileNet V2, AlexNet) pre-trained on the ImageNet dataset. Secondly, the 4 pre-trained models were transferred to the food image dataset for model fine-tuning. Finally, different basic learner combination strategies were adopted to establish the ensemble model and classify feature information. In this paper, several kinds of experiments were performed to compare the results of food image recognition between single models and ensemble models on food-11 dataset. The experimental results demonstrated that the accuracy of the ensemble model was the highest, reaching 96.88%, which was superior to any base learner. Therefore, the convolutional neural network model based on transfer learning and ensemble learning has strong learning ability and generalization ability, and it is feasible and practical to apply the method to food image recognition.

MeSH terms

  • Machine Learning*
  • Neural Networks, Computer*

Grants and funding

This research was funded by Jinling Institute of Technology High-level Talent Research Start-up Project (jit-rcyj-202102), Key R&D Plan Project of Jiangsu Province (BE2022077), Jiangsu Province College Student Innovation Training Program Project (202313573080Y, 202313573081Y) and Jinling Institute of Technology Science and Education Integration Project (2022KJRH18).The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.