The quality of systematic reviews of health-related outcome measurement instruments

Qual Life Res. 2016 Apr;25(4):767-79. doi: 10.1007/s11136-015-1122-4. Epub 2015 Sep 7.

Abstract

Background: Systematic reviews of outcome measurement instruments are important tools for the selection of instruments for research and clinical practice. Our aim was to assess the quality of systematic reviews of health-related outcome measurement instruments and to determine whether the quality has improved since our previous study in 2007.

Methods: A systematic literature search was performed in MEDLINE and EMBASE between July 1, 2013, and June 19, 2014. The quality of the reviews was rated using a study-specific checklist.

Results: A total of 102 reviews were included. In many reviews the search strategy was considered not comprehensive; in only 59 % of the reviews a search was performed in EMBASE and in about half of the reviews there was doubt about the comprehensiveness of the search terms used for type of measurement instruments and measurement properties. In 41 % of the reviews, compared to 30 % in our previous study, the methodological quality of the included studies was assessed. In 58 %, compared to 55 %, the quality of the included instruments was assessed. In 42 %, compared to 7 %, a data synthesis was performed in which the results from multiple studies on the same instrument were somehow combined.

Conclusion: Despite a clear improvement in the quality of systematic reviews of outcome measurement instruments in comparison with our previous study in 2007, there is still room for improvement with regard to the search strategy, and especially the quality assessment of the included studies and the included instruments, and the data synthesis.

Keywords: Measurement properties; Outcome measurement instruments; Reliability; Systematic review; Validity.

Publication types

  • Review
  • Systematic Review

MeSH terms

  • Checklist
  • Humans
  • Outcome Assessment, Health Care*
  • Patient Outcome Assessment*
  • Quality of Life
  • Research / standards*
  • Review Literature as Topic*