HARNet in deep learning approach-a systematic survey

Sci Rep. 2024 Apr 10;14(1):8363. doi: 10.1038/s41598-024-58074-y.

Abstract

A comprehensive examination of human action recognition (HAR) methodologies situated at the convergence of deep learning and computer vision is the subject of this article. We examine the progression from handcrafted feature-based approaches to end-to-end learning, with a particular focus on the significance of large-scale datasets. By classifying research paradigms, such as temporal modelling and spatial features, our proposed taxonomy illuminates the merits and drawbacks of each. We specifically present HARNet, an architecture for Multi-Model Deep Learning that integrates recurrent and convolutional neural networks while utilizing attention mechanisms to improve accuracy and robustness. The VideoMAE v2 method ( https://github.com/OpenGVLab/VideoMAEv2 ) has been utilized as a case study to illustrate practical implementations and obstacles. For researchers and practitioners interested in gaining a comprehensive understanding of the most recent advancements in HAR as they relate to computer vision and deep learning, this survey is an invaluable resource.

Keywords: Accuracy; CNN; Deep learning; Feature-based approaches; Human action recognition (HAR).

MeSH terms

  • Deep Learning*
  • Human Activities
  • Humans
  • Neural Networks, Computer