Psychometric Validation of an Instrument for Measuring Patient Experiences with Outpatient Healthcare

Zdr Varst. 2023 Jun 13;62(3):153-161. doi: 10.2478/sjph-2023-0021. eCollection 2023 Sep.

Abstract

Aim: Recently, a patient-reported experience measure (PREM) was developed in Slovenia to assess patients' experiences with outpatient specialist healthcare clinics. The aim of this study was to evaluate the psychometric properties (including factor structure, reliability, convergent validity, and response distribution) of the questionnaire.

Methods: The sample consisted of 8,406 adult participants treated in 171 specialist clinics from different medical fields. Participants voluntarily and anonymously responded to either the paper or online survey.

Results: Descriptive statistics show meaningful response patterns with a general tendency towards favourable assessments. The psychometric analyses of the scales evaluating doctor's and nurses' work, respectively, generally showed a good fit of the unidimensional factor model as well as the Rasch model, high factor loadings and very good to satisfactory reliability. The Rasch scaling showed that these scales were most informative for patients with relatively unfavourable experience ratings.

Conclusions: The results are similar to those found in previous evaluations of PREMs in other countries. Given its good psychometric properties, the Slovenian PREM can be recommended for healthcare evaluations in Slovenia and as a model for the development of similar PREMs in other countries.

Namen: V Sloveniji je bil pred kratkim razvit Vprašalnik o izkušnjah pacientov z obravnavo v specialističnih ambulantah. Namen te raziskave je bil preveriti njegove psihometrične lastnosti (vključno s faktorsko strukturo, zanesljivostjo, konvergentno veljavnostjo in porazdelitvami odgovorov).

Metode: V raziskavi je sodelovalo 8.406 odraslih udeležencev, ki so bili obravnavani v 171 specialističnih ambulantah različnih zdravstvenih dejavnosti. Udeležba je bila prostovoljna in anonimna. Udeleženci so lahko izbirali med papirnato in spletno verzijo vprašalnika.

Rezultati: Opisne statistike kažejo smiselne vzorce odgovorov, pri čemer so se nizke ocene v splošnem pojavljale razmeroma redko. Psihometrične analize lestvic zdravnikovega dela in dela sester so v splošnem pokazale dobro prileganje enodimenzionalnega faktorskega in Raschevega modela, visoke faktorske uteži in zelo dobro (pri delu zdravnika) oz. zadovoljivo (pri delu sester) zanesljivost dosežka na lestvici. Rezultati Raschevega lestvičenja so pokazali, da sta ti lestvici najbolj informativni za paciente z relativno nizkimi ocenami svoje izkušnje.

Zaključek: Rezultati so podobni tistim, ki so jih pokazale analize podobnih vprašalnikov v drugih državah. Glede na dobre psihometrične lastnosti lahko slovenski vprašalnik priporočimo za uporabo tako pri ocenjevanju zdravstvenih storitev v Sloveniji kot tudi kot model za razvoj podobnih vprašalnikov v primerljivih državah.

Keywords: Factor analysis; Patient reported; Reliability; Slovenia; Validity; experience measures.