Ambient intelligence-based multimodal human action recognition for autonomous systems

ISA Trans. 2023 Jan:132:94-108. doi: 10.1016/j.isatra.2022.10.034. Epub 2022 Nov 1.

Abstract

Human activity recognition can deduce the behaviour of one or more people from a set of sensor measurements. Despite its widespread applications in monitoring activities, robotics, and visual surveillance, accurate, meticulous, precise and efficient human action recognition remains a challenging research area. As human beings are moving towards the establishment of a smarter planet, human action recognition using ambient intelligence has become an area of huge potential. This work presents a method based on Bi-Convolutional Recurrent Neural Network (Bi-CRNN) -based Feature Extraction and then Random Forest classification for achieving outcomes utilizing Ambient Intelligence that are at the cutting edge of human action recognition for Autonomous Robots. The auto fusion technique used has improved fusion for utilizing and processing data from various sensors. This paper has drawn comparisons with already existing algorithms for Human Action Recognition (HAR) and tried to propose a heuristic and constructive hybrid deep learning-based algorithm with an accuracy of 94.7%.

Keywords: Ambient assisted living, Auto fusion, Autonomous techniques, Convolution-recurrent neural network, Human activity detection, Hybrid deep learning.

MeSH terms

  • Algorithms
  • Ambient Intelligence*
  • Human Activities
  • Humans
  • Neural Networks, Computer
  • Pattern Recognition, Automated* / methods