Development of a high-value care culture survey: a modified Delphi process and psychometric evaluation

BMJ Qual Saf. 2017 Jun;26(6):475-483. doi: 10.1136/bmjqs-2016-005612. Epub 2016 Oct 26.

Abstract

Background: Organisational culture affects physician behaviours. Patient safety culture surveys have previously been used to drive care improvements, but no comparable survey of high-value care culture currently exists. We aimed to develop a High-Value Care Culture Survey (HVCCS) for use by healthcare leaders and training programmes to target future improvements in value-based care.

Methods: We conducted a two-phase national modified Delphi process among 28 physicians and nurse experts with diverse backgrounds. We then administered a cross-sectional survey at two large academic medical centres in 2015 among 162 internal medicine residents and 91 hospitalists for psychometric evaluation.

Results: Twenty-six (93%) experts completed the first phase and 22 (85%) experts completed the second phase of the modified Delphi process. Thirty-eight items achieved ≥70% consensus and were included in the survey. One hundred and forty-one residents (83%) and 73 (73%) hospitalists completed the survey. From exploratory factor analyses, four factors emerged with strong reliability: (1) leadership and health system messaging (α=0.94); (2) data transparency and access (α=0.80); (3) comfort with cost conversations (α=0.70); and (4) blame-free environment (α=0.70). In confirmatory factor analysis, this four-factor model fit the data well (Bentler-Bonett Normed Fit Index 0.976 and root mean square residual 0.056). The leadership and health system messaging (r=0.56, p<0.001), data transparency and access (r=0.15, p<0.001) and blame-free environment (r=0.37, p<0.001) domains differed significantly between institutions and positively correlated with Value-Based Purchasing Scores.

Conclusions: Our results provide support for the reliability and validity of the HVCCS to assess high-value care culture among front-line clinicians. HVCCS may be used by healthcare groups to identify target areas for improvements and to monitor the effects of high-value care initiatives.

Keywords: Healthcare quality improvement; Quality measurement; Safety culture.

MeSH terms

  • Academic Medical Centers / economics
  • Academic Medical Centers / organization & administration*
  • Academic Medical Centers / standards
  • Adult
  • Aged
  • Cross-Sectional Studies
  • Delphi Technique
  • Environment
  • Female
  • Hospital Costs*
  • Hospitalists / psychology
  • Humans
  • Internal Medicine / education
  • Internship and Residency / organization & administration
  • Leadership
  • Male
  • Middle Aged
  • Organizational Culture*
  • Patient Safety*
  • Quality Improvement / economics
  • Quality Improvement / organization & administration*
  • Reproducibility of Results