Evaluation of an Online System for Routine Outcome Monitoring: Cross-sectional Survey Study

Abstract

Background: The use of routine outcome monitoring (ROM) in the treatment of mental health has emerged as a method of improving psychotherapy treatment outcomes. Despite this, very few clinicians regularly use ROM in clinical practice. Online ROM has been suggested as a solution to increase adoption.

Objective: The aim of this study is to identify the influence of moving ROM online on client completion rates of self-reported outcome measures and to identify implementation and utilization barriers to online ROM by assessing clinicians' views on their experience using the online system over previous paper-based methods.

Methods: Client completion rates of self-reported outcome measures were compared pre- and postimplementation of an online system of ROM. In addition, a survey questionnaire was administered to 324 mental health service providers regarding their perception of the benefits with an online system of ROM.

Results: Client completion rates of self-reported measures increased from 15.62% (427/2734) to 53.98% (1267/2347) after they were moved online. Furthermore, 57% (56/98) of service providers found the new system less time-consuming than the previous paper-based ROM, and 64% (63/98) found that it helped monitor clients. However, the perceived value of the system remains in doubt as only 23% (23/98) found it helped them identify clients at risk for treatment failure, and only 18% (18/98) found it strengthened the therapeutic alliance.

Conclusions: Although the current study suggests mixed results regarding service providers' views on their experience using an online system for ROM, it has identified barriers and challenges that are actionable for improvement.

Keywords: measurement-based care; outcome measurement questionnaire; outcome measures; progress monitoring and feedback; routine outcome monitoring; routine outcome monitoring software; web-based outcome monitoring.