National survey of user-reported usability of electronic medical record software in ophthalmology in Germany

Graefes Arch Clin Exp Ophthalmol. 2023 Nov;261(11):3325-3334. doi: 10.1007/s00417-023-06139-5. Epub 2023 Jun 28.

Abstract

Purpose: A nationwide, comparative survey of the physician-reported usability of electronic medical record (EMR) software used by ophthalmologists in Germany using the System Usability Scale (SUS) as a standardized metric.

Methods: A cross-sectional survey of members of the German Ophthalmological Society (DOG) and professional association of ophthalmologists (BVA) was conducted in May 2022. All 7788 physician members of both societies were invited to participate in an anonymous online-survey by individualized links. User-reported usability of the participants main software used for electronic medical recordkeeping was assessed using the SUS (range 0-100).

Results: A total of 881 participants with 51 different EMRs completed the entire questionnaire. Mean EMR-SUS score was 65.7 (SD ± 23.5). Significant differences in mean SUS of several EMR programs were observed with a range of 31.5 to 87.2 in programs with 10 or more responses. 31.8% of all main program SUS ratings were below 50 points. Female gender was associated with 4.02 higher SUS score (95% CI 0.46-7.59). Main program SUS was positively correlated with overall work-related satisfaction and work environment SUS but negatively correlated with the number of programs in the work environment. The SUS of the entire digital work environment including all programs used daily was closely correlated with the main EMR SUS, but not the number of programs used.

Conclusion: Our survey revealed a fragmented pattern of EMR use by ophthalmologists in Germany with many competing software products and widely diverging mean System Usability Scale scores. A considerable share of ophthalmologists report EMR usability below what is commonly considered acceptable.

Keywords: Digitalization; Electronic medical record; Medical informatics; National survey; Usability.