Preliminary psychometric evaluation of the patient reported experience measure for addiction treatment (PREMAT)

Peter J Kelly; Emma L Hatton; Kate Hinsley; Esther Davis; Briony Larance

doi:10.1016/j.addbeh.2021.107048

Preliminary psychometric evaluation of the patient reported experience measure for addiction treatment (PREMAT)

Addict Behav. 2021 Dec:123:107048. doi: 10.1016/j.addbeh.2021.107048. Epub 2021 Jul 12.

Authors

Peter J Kelly¹, Emma L Hatton², Kate Hinsley², Esther Davis³, Briony Larance⁴

Affiliations

¹ School of Psychology, University of Wollongong, Australia; Illawarra Health and Medical Research Institute, University of Wollongong, Australia. Electronic address: pkelly@uow.edu.au.
² School of Psychology, University of Wollongong, Australia.
³ School of Psychology, University of Wollongong, Australia; Illawarra Health and Medical Research Institute, University of Wollongong, Australia; Australian Health Services Research Institute, University of Wollongong, Australia.
⁴ School of Psychology, University of Wollongong, Australia; Illawarra Health and Medical Research Institute, University of Wollongong, Australia.

PMID: 34348223
DOI: 10.1016/j.addbeh.2021.107048

Abstract

Introduction: Patient-reported experience measures (PREMs) are recommended for use in evaluating person-centred care. To date, a PREM has not been validated for residential alcohol and other drug (AOD) treatment. Utilising items developed through a previously published qualitative study informing the development of the PREM for Addiction Treatment (PREMAT), the current study conducted a psychometric evaluation and validation of the PREMAT.

Design and methods: Cross-sectional survey data were collected from six Australian residential AOD treatment facilities (N = 178). Psychometric evaluation included examining the factor structure, internal consistency, and construct validity of the PREMAT. Test re-test reliability was conducted at one treatment site (n = 24).

Results: The total PREMAT score demonstrated strong internal consistency (α = 0.91). Principle components analysis identified six factors (all α > 0.72). The PREMAT total score and factor scores were negatively skewed. Concurrent validity was demonstrated by strong positive correlations with measures of satisfaction (ρ = 0.81, Client Satisfaction Questionnaire-8; ρ = 0.78, Treatment Perceptions Questionnaire), and divergent validity was demonstrated with weaker correlations with Drug-Taking Confidence Questionnaire (ρ = 0.25) and Kessler-10 (ρ = -0.20). Test-retest reliability was strong for the total PREMAT (ρ = 0.89).

Discussion and conclusions: Results support the use of the PREMAT as a valid measure of experience in residential AOD treatment settings. Future research should examine the use of the PREMAT across the course of treatment to examine if experience is related to client characteristics, outcome, dropout or re-engagement in treatment.

Keywords: Alcohol; Quality improvement; Residential rehabilitation; Satisfaction; Substance dependence; Therapeutic community; Treatment experience.

Publication types

Research Support, Non-U.S. Gov't

MeSH terms

Australia
Cross-Sectional Studies
Humans
Patient Reported Outcome Measures*
Psychometrics
Reproducibility of Results
Surveys and Questionnaires