Test-specific funnel plots for healthcare provider profiling leveraging individual- and summary-level information

Health Serv Outcomes Res Methodol. 2023 Mar:23:45-58. doi: 10.1007/s10742-022-00285-9. Epub 2022 Jul 6.

Abstract

In addition to applications in meta-analysis, funnel plots have emerged as an effective graphical tool for visualizing the detection of health care providers with unusual performance. Although there already exist a variety of approaches to producing funnel plots in the literature of provider profiling, limited attention has been paid to elucidating the critical relationship between funnel plots and hypothesis testing. Within the framework of generalized linear models, here we establish methodological guidelines for creating funnel plots specific to the statistical tests of interest. Moreover, we show that the test-specific funnel plots can be created merely leveraging summary statistics instead of individual-level information. This appealing feature inhibits the leak of protected health information and reduces the cost of inter-institutional data transmission. Two data examples, one for surgical patients from Michigan hospitals and the other for Medicare-certified dialysis facilities, demonstrate the applicability to different types of providers and outcomes with either individual- or summary-level information.

Keywords: Data sharing; Exact test; Poisson-binomial distribution; Quality of care; Score test.