Breathing-Associated Facial Region Segmentation for Thermal Camera-Based Indirect Breathing Monitoring

IEEE J Transl Eng Health Med. 2023 Jul 17:11:505-514. doi: 10.1109/JTEHM.2023.3295775. eCollection 2023.

Abstract

Breathing can be measured in a non-contact method using a thermal camera. The objective of this study investigates non-contact breathing measurements using thermal cameras, which have previously been limited to measuring the nostril only from the front where it is clearly visible. The previous method is challenging to use for other angles and frontal views, where the nostril is not well-represented. In this paper, we defined a new region called the breathing-associated-facial-region (BAFR) that reflects the physiological characteristics of breathing, and extract breathing signals from views of 45 and 90 degrees, including the frontal view where the nostril is not clearly visible. Experiments were conducted on fifteen healthy subjects in different views, including frontal with and without nostril, 45-degree, and 90-degree views. A thermal camera (A655sc model, FLIR systems) was used for non-contact measurement, and biopac (MP150, Biopac-systems-Inc) was used as a chest breathing reference. The results showed that the proposed algorithm could extract stable breathing signals at various angles and views, achieving an average breathing cycle accuracy of 90.9% when applied compared to 65.6% without proposed algorithm. The average correlation value increases from 0.587 to 0.885. The proposed algorithm can be monitored in a variety of environments and extract the BAFR at diverse angles and views.

Keywords: Breathing; Markov random field (Clinical Impact)The proposed algorithm shows the feasibility of non-contact breathing reliable monitoring that versatile and accurate than previous methods The proposed algorithm could be used to monitor breathing in various clinical environments; and intensive care units with high infection risks; including isolated wards; noncontact; operation rooms; physiological features; thermal camera.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Algorithms
  • Biological Phenomena*
  • Face / diagnostic imaging
  • Humans
  • Monitoring, Physiologic / methods
  • Respiration*

Grants and funding

This work was supported in part by the Korea Medical Device Development Fund grant funded by the Korean Government under Project HW20C2151; and in part by the Industrial Technology Innovation Program (Development of Emotional Cognitive and Sympathetic Artificial Intelligence (AI) Service Technology for Remote (Non-Face-to-Face) Learning and Industrial Sites) funded by the Ministry of Trade, Industry and Energy (MOTIE, South Korea) under Grant 20012603.