Usability evaluation of a comprehensive national health information system: relationship of quality components to users' characteristics

Fateme Rangraz Jeddi; Ehsan Nabovati; Reyhane Bigham; Reza Khajouei

doi:10.1016/j.ijmedinf.2019.104026

Usability evaluation of a comprehensive national health information system: relationship of quality components to users' characteristics

Int J Med Inform. 2020 Jan:133:104026. doi: 10.1016/j.ijmedinf.2019.104026. Epub 2019 Nov 9.

Authors

Fateme Rangraz Jeddi¹, Ehsan Nabovati², Reyhane Bigham³, Reza Khajouei⁴

Affiliations

¹ Health Information Management Research Center, Kashan University of Medical Sciences, Kashan, Iran; Department of Health Information Management & Technology, School of Allied Health Professions, Kashan University of Medical Sciences, Kashan, Iran.
² Health Information Management Research Center, Kashan University of Medical Sciences, Kashan, Iran; Department of Health Information Management & Technology, School of Allied Health Professions, Kashan University of Medical Sciences, Kashan, Iran. Electronic address: Nabovati@kaums.ac.ir.
³ Department of Health Information Management & Technology, School of Allied Health Professions, Kashan University of Medical Sciences, Kashan, Iran; Student research committee, Kashan University of Medical Sciences, Kashan, Iran.
⁴ Medical Informatics Research Center, Institute for Futures Studies in Health, Kerman University of Medical Sciences, Kerman, Iran.

PMID: 31733603
DOI: 10.1016/j.ijmedinf.2019.104026

Abstract

Objective: One of the most important methods for evaluating information systems is usability evaluation. Usability is a context-dependent qualitative feature that is measured by multiple quality components that can be related to users' characteristics. This study was conducted to evaluate the usability of a comprehensive national health information system (SIB; an abbreviation for the Persian equivalent of 'integrated health system') from the perspective of different users and to determine the relationship between quality components and users' characteristics.

Method: The study population were users of the national health information system (n = 309) at health centers and health homes affiliated to Kashan University of Medical Sciences, Kashan, Iran. Data were collected using Software Usability Measurement Inventory (SUMI) questionnaire which measures users' experiences of software interface in five quality components (i.e. affect, efficiency, helpfulness, control, and learnability) and provides a global usability score. SUMI scores were analyzed according to an extensive reference database (SUMISCO). The relationships between quality components and users' characteristics were investigated by one-way analysis of variance (ANOVA), independent t-test, and Pearson's correlation coefficient.

Results: A total of 250 users completed the questionnaire (response rate = 81%). The mean scores of all quality components were significantly lower than the mean of SUMISCO. Learnability score had significant relationships with the user's position, education level, and field of education (P < 0.001). Physicians scored significantly lower than other users in efficiency, helpfulness and global usability (P < 0.05). Users' practice experience and age had significant linear inverse relationships with efficiency, helpfulness, and learnability (P < 0.05).

Conclusions: The national health information system which is used by a large number of users across a developing country have low usability. Given the significant relationships between the users' characteristics of such systems and quality components, it is essential to consider the characteristics and needs of various user groups during the processes of system analysis and design.

Keywords: Evaluation studies; Health information systems; Usability; User-computer interface.

Publication types

Research Support, Non-U.S. Gov't

MeSH terms

Adult
Female
Health Information Systems*
Humans
Iran
Male
Software
Surveys and Questionnaires