Analysis of Longitudinal Assessment: Role of Radiology Online Longitudinal Assessment-Type Questions

Sara A Hunter; Jennifer Bullen; Kyle J Hunter; Kavita Bhatt

doi:10.1016/j.jacr.2024.03.011

Analysis of Longitudinal Assessment: Role of Radiology Online Longitudinal Assessment-Type Questions

J Am Coll Radiol. 2024 Mar 26:S1546-1440(24)00299-0. doi: 10.1016/j.jacr.2024.03.011. Online ahead of print.

Authors

Sara A Hunter¹, Jennifer Bullen², Kyle J Hunter³, Kavita Bhatt⁴

Affiliations

¹ Assistant Professor of Radiology, Imaging Institute, Cleveland Clinic, Cleveland, Ohio. Electronic address: Hunters2@ccf.org.
² Senior Biostatistician, Department of Quantitative Health Sciences, Cleveland Clinic, Cleveland, Ohio.
³ Vice Chair of Quality for the Department of Radiology, Assistant Professor of Radiology, Department of Radiology, MetroHealth, Cleveland, Ohio.
⁴ Diagnostic Radiology Residency Associate Program Director, Assistant Professor of Radiology, Imaging Institute, Cleveland Clinic, Cleveland, Ohio.

PMID: 38527644
DOI: 10.1016/j.jacr.2024.03.011

Abstract

Objective: The purpose of this investigation was to assess gaps in radiologists' medical knowledge using abdominal subspecialty online longitudinal assessment (OLA)-type questions. Secondarily, we evaluated what question-centric factors influenced radiologists to pursue self-directed additional reading on topics presented.

Methods: A prospective OLA-type test was distributed nationally to radiologists over a 4-month period. Questions were divided into multiple groupings, including arising from three different time periods of literature (≤5 years, 6-15 years, and >20 years), relating to common versus uncommon modalities, and guideline-based versus knowledge-based characterization. After each question, participants rated their confidence in diagnosis and perceived question relevance. Answers were provided, and links to answer explanations and references were provided and tracked. A series of regression models were used to test potential predictors of correct response, participant confidence, and perceived question relevance.

Results: In all, 119 participants initiated the survey, with 100 answering at least one of the questions. Participants had significantly lower perceived relevance (mean: 51.3, 59.2, and 62.1 for topics ≤5 years old, 6-15 years old, and >20 years old, respectively; P < .001) and confidence (mean: 48.4, 57.8, and 63.4, respectively; P < .001) with questions on newer literature compared with older literature. Participants were significantly more likely to read question explanations for questions on common modalities compared with uncommon (46% versus 40%; P = .005) and on guideline-based questions compared with knowledge-based questions (49% versus 43%; P = .01).

Discussion: OLA-type questions function by identifying areas in which radiologists lack knowledge or confidence and highlight areas in which participants have interest in further education.

Keywords: Continuing certification; longitudinal assessment; physician education.