Corticosteroid treatment prediction using chest X-ray and clinical data

Anzhelika Mezina; Samuel Genzor; Radim Burget; Vojtech Myska; Jan Mizera; Aleksandr Ometov

doi:10.1016/j.csbj.2023.11.057

Corticosteroid treatment prediction using chest X-ray and clinical data

Comput Struct Biotechnol J. 2023 Dec 7:24:53-65. doi: 10.1016/j.csbj.2023.11.057. eCollection 2024 Dec.

Authors

Anzhelika Mezina¹, Samuel Genzor², Radim Burget¹, Vojtech Myska¹, Jan Mizera², Aleksandr Ometov³

Affiliations

¹ Brno University of Technology, FEEC, Dept. of Telecommunications, Technicka 12, Brno, 616 00, Czech Republic.
² Center for Digital Health, Palacky Univesity Olomouc, Faculty of Medicine and Dentistry, Hnevotinska 976/3, Olomouc 779 00, Czech Republic.
³ Electrical Engineering Unit, Faculty of Information Technology and Communication Sciences, Tampere University, Tampere, 33720, Finland.

Abstract

Background and objective: Severe courses of COVID-19 disease can lead to long-term complications. The post-acute phase of COVID-19 refers to the persistent or new symptoms. This problem is becoming more relevant with the increasing number of patients who have contracted COVID-19 and the emergence of new virus variants. In this case, preventive treatment with corticosteroids can be applied. However, not everyone benefits from the treatment, moreover, it can have severe side effects. Currently, no study would analyze who benefits from the treatment.

Methods: This work introduces a novel approach to the recommendation of Corticosteroid (CS) treatment for patients in the post-acute phase. We have used a novel combination of clinical data, including blood tests, spirometry, and X-ray images from 273 patients. These are very challenging to collect, especially from patients in the post-acute phase of COVID-19. To our knowledge, no similar dataset exists in the literature. Moreover, we have proposed a unique methodology that combines machine learning and deep learning models based on Vision Transformer (ViT) and InceptionNet, preprocessing techniques, and pretraining strategies to deal with the specific characteristics of our data.

Results: The experiments have proved that combining clinical data with CXR images achieves 8% higher accuracy than independent analysis of CXR images. The proposed method reached 80.0% accuracy (78.7% balanced accuracy) and a ROC-AUC of 0.89.

Conclusions: The introduced system for CS treatment prediction using our neural network and learning algorithm is unique in this field of research. Here, we have shown the efficiency of using mixed data and proved it on real-world data. The paper also introduces the factors that could be used to predict long-term complications. Additionally, this system was deployed to the hospital environment as a recommendation tool, which admits the clinical application of the proposed methodology.

Keywords: Chest X-ray images; Clinical data; Image classification; Post-acute COVID-19; Treatment prediction; Vision transformer.