An App Developed for Detecting Nurse Burnouts Using the Convolutional Neural Networks in Microsoft Excel: Population-Based Questionnaire Study

Yi-Lien Lee; Willy Chou; Tsair-Wei Chien; Po-Hsin Chou; Yu-Tsen Yeh; Huan-Fang Lee

doi:10.2196/16528

An App Developed for Detecting Nurse Burnouts Using the Convolutional Neural Networks in Microsoft Excel: Population-Based Questionnaire Study

JMIR Med Inform. 2020 May 7;8(5):e16528. doi: 10.2196/16528.

Authors

Yi-Lien Lee^{1

2}, Willy Chou^#^{3

4}, Tsair-Wei Chien^#⁵, Po-Hsin Chou^#^{6

7}, Yu-Tsen Yeh⁸, Huan-Fang Lee⁹

Affiliations

¹ Department of Medical Affairs, Chi Mei Medical Center, Tainan, Taiwan.
² Department of Information Management and Institute of Healthcare Information Management, National Chung Cheng University, Chayi, Taiwan.
³ Department of Physical Medicine and Rehabilitation, Chiali Chi Mei Hospital, Chi Mei Medical Groups, Tainan, Taiwan.
⁴ Department of Physical Medicine and Rehabilitation, Chung Shan Medical University, Taichun, Taiwan.
⁵ Department of Medical Research, Chi Mei Medical Center, Chi Mei Medical Groups, Tainan, Taiwan.
⁶ Department of Orthopedics and Traumatology, Taipei Veterans General Hospital, Taipei, Taiwan.
⁷ School of Medicine, National Yang-Ming University, Taipei, Taiwan.
⁸ Medical School, St George's, University of London, London, United Kingdom.
⁹ Department of Nursing, College of Medicine, National Cheng Kung University, Tainan, Taiwan.

^# Contributed equally.

PMID: 32379050
PMCID: PMC7243132
DOI: 10.2196/16528

Abstract

Background: Burnout (BO), a critical syndrome particularly for nurses in health care settings, substantially affects their physical and psychological status, the institute's well-being, and indirectly, patient outcomes. However, objectively classifying BO levels has not been defined and noticed in the literature.

Objective: The aim of this study is to build a model using the convolutional neural network (CNN) to develop an app for automatic detection and classification of nurse BO using the Maslach Burnout Inventory-Human Services Survey (MBI-HSS) to help assess nurse BO at an earlier stage.

Methods: We recruited 1002 nurses working in a medical center in Taiwan to complete the Chinese version of the 20-item MBI-HSS in August 2016. The k-mean and CNN were used as unsupervised and supervised learnings for dividing nurses into two classes (n=531 and n=471 of suspicious BO+ and BO-, respectively) and building a BO predictive model to estimate 38 parameters. Data were separated into training and testing sets in a proportion 70%:30%, and the former was used to predict the latter. We calculated the sensitivity, specificity, and receiver operating characteristic curve (area under the curve) across studies for comparison. An app predicting respondent BO was developed involving the model's 38 estimated parameters for a website assessment.

Results: We observed that (1) the 20-item model yields a higher accuracy rate (0.95) with an area under the curve of 0.97 (95% CI 0.94-0.95) based on the 1002 cases, (2) the scheme named matching personal response to adapt for the correct classification in model drives the prior model's predictive accuracy at 100%, (3) the 700-case training set with 0.96 accuracy predicts the 302-case testing set reaching an accuracy of 0.91, and (4) an available MBI-HSS app for nurses predicting BO was successfully developed and demonstrated in this study.

Conclusions: The 20-item model with the 38 parameters estimated by using CNN for improving the accuracy of nurse BO has been particularly demonstrated in Excel (Microsoft Corp). An app developed for helping nurses to self-assess job BO at an early stage is required for application in the future.

Keywords: Lz person fit statistic; MBI-HSS Chinese version; convolutional neural network; nurse burnout; receiver operating characteristic curve.

©Yi-Lien Lee, Willy Chou, Tsair-Wei Chien, Po-Hsin Chou, Yu-Tsen Yeh, Huan-Fang Lee. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 07.05.2020.