Routine outcome measurement in specialist non-government alcohol and other drug treatment services: Establishing effectiveness indicators for the NADAbase

Peter J Kelly; Frank P Deane; Esther L Davis; Suzie Hudson; Laura D Robinson; Carol A Keane; Emma L Hatton; Briony Larance

doi:10.1111/dar.13191

Routine outcome measurement in specialist non-government alcohol and other drug treatment services: Establishing effectiveness indicators for the NADAbase

Drug Alcohol Rev. 2021 May;40(4):540-552. doi: 10.1111/dar.13191. Epub 2020 Nov 5.

Authors

Peter J Kelly^{1

2}, Frank P Deane^{1

2}, Esther L Davis^{1

2}, Suzie Hudson³, Laura D Robinson^{1

2}, Carol A Keane^{1

4}, Emma L Hatton^{1

2}, Briony Larance^{1

2}

Affiliations

¹ School of Psychology, University of Wollongong, Wollongong, Australia.
² Illawarra Health and Medical Research Institute, Wollongong, Australia.
³ Network of Alcohol and other Drug Agencies, Sydney, Australia.
⁴ School of Health, Medical and Applied Science, Central Queensland University, Rockhampton, Australia.

PMID: 33155315
DOI: 10.1111/dar.13191

Abstract

Introduction and aims: The collection of routine outcome measurement (ROM) data provides an opportunity for service providers to conduct benchmarking to inform quality assurance practices. To conduct comparative benchmarking, it is important that services have access to comparative data. This paper aims to establish effectiveness indicators for ROM data collected within the alcohol and other drug (AOD) sector.

Design and methods: ROM data were collected by specialist non-government AOD treatment services within the Network of Alcohol and other Drugs Agencies online database (i.e. NADAbase). All participants were attending treatment within New South Wales, Australia (N = 21 572). Effectiveness indicators were calculated by using effect sizes, standard error of measurement, and rates of reliable and clinically significant change. The study focused on quality of life (EUROHIS Quality of Life Scale), psychological distress (Kessler-10) and substance dependence (Substance Dependence Scale).

Results: Since 2010, 21 572 unique people have completed at least one NADAbase Client Outcome Measure. Amphetamines (36%) and alcohol (32%) were the most commonly reported primary substances of concern. Effectiveness indicators were established for the total sample, as well as for people attending residential rehabilitation (n = 8161) and community-based (n = 10 306) treatment services. Standard error of measurement was the least stringent effectiveness indicator (i.e. a higher proportion of people demonstrated improvement), while the clinically significant change was the most stringent approach.

Discussion and conclusions: The study demonstrated the utility of the NADAbase to establish effectiveness indicators for benchmarking purposes. Recommendations are provided for the use of benchmarking to inform quality assurance activities in the sector.

Keywords: EUROHIS Quality of Life Scale; Kessler-10; Substance Dependence Scale; benchmarking; routine outcome monitoring.

Publication types

Research Support, Non-U.S. Gov't

MeSH terms

Australia
Humans
New South Wales
Pharmaceutical Preparations*
Quality of Life
Substance-Related Disorders* / therapy

Substances

Pharmaceutical Preparations