Automated anomalous child repetitive head movement identification through transformer networks

Phys Eng Sci Med. 2023 Dec;46(4):1427-1445. doi: 10.1007/s13246-023-01309-5. Epub 2023 Oct 9.

Abstract

The increasing prevalence of behavioral disorders in children is of growing concern within the medical community. Recognising the significance of early identification and intervention for atypical behaviors, there is a consensus on their pivotal role in improving outcomes. Due to inadequate facilities and a shortage of medical professionals with specialized expertise, traditional diagnostic methods have been unable to effectively address the rising incidence of behavioral disorders. Hence, there is a need to develop automated approaches for the diagnosis of behavioral disorders in children, to overcome the challenges with traditional methods. The purpose of this study is to develop an automated model capable of analyzing videos to differentiate between typical and atypical repetitive head movements in. To address problems resulting from the limited availability of child datasets, various learning methods are employed to mitigate these issues. In this work, we present a fusion of transformer networks, and Non-deterministic Finite Automata (NFA) techniques, which classify repetitive head movements of a child as typical or atypical based on an analysis of gender, age, and type of repetitive head movement, along with count, duration, and frequency of each repetitive head movement. Experimentation was carried out with different transfer learning methods to enhance the performance of the model. The experimental results on five datasets: NIR face dataset, Bosphorus 3D face dataset, ASD dataset, SSBD dataset, and the Head Movements in the Wild dataset, indicate that our proposed model has outperformed many state-of-the-art frameworks when distinguishing typical and atypical repetitive head movements in children.

Keywords: Atypical head movements; Head gesture classification; Head pose estimation; Movement analysis; Non-deterministic finite automata (NFA); Periodicity; Repetitive behavior analysis; Transfer learning; Transformer.

MeSH terms

  • Child
  • Endoscopy
  • Head Movements*
  • Humans
  • Mental Disorders*
  • Risk Assessment
  • Stereotyped Behavior