How are risk ratios reported in orthopaedic surgery journals? A descriptive study of formats used to report absolute risks

Abstract

Purpose: The numerical format in which risks are communicated can affect risk comprehension and perceptions of medical professionals. We investigated what numerical formats are used to report absolute risks in empirical articles, estimated the frequency of biasing formats and rated the quality of figures used to display the risks.

Design: Descriptive study of reporting practices.

Method: We randomly sampled articles published in seven leading orthopaedic surgery journals during a period of 13 years. From these, we selected articles that reported group comparisons on a binary outcome (eg, revision rates in two groups) and recorded the numerical format used to communicate the absolute risks in the results section. The quality of figures was assessed according to published guidelines for transparent visual aids design.

Outcome measures: Prevalence of information formats and quality of figures.

Results: The final sample consisted of 507 articles, of which 14% reported level 1 evidence, 13% level 2 and 73% level 3 or lower. The majority of articles compared groups of different sizes (90%), reported both raw numbers and percentages (64%) and did not report the group sizes alongside (50%). Fifteen per cent of articles used two formats identified as biasing: only raw numbers (8%, '90 patients vs 100 patients') or raw numbers reported alongside different group sizes (7%, '90 out of 340 patients vs 100 out of 490 patients'). The prevalence of these formats decreased in more recent publications. Figures (n=79) had on average two faults that could distort comprehension, and the majority were rated as biasing.

Conclusion: Authors use a variety of formats to report absolute risks in scientific articles and are likely not aware of how some formats and graph design features can distort comprehension. Biases can be reduced if journals adopt guidelines for transparent risk communication but more research is needed into the effects of different formats.

Keywords: general surgery; orthopedics; risk communication; scientific reporting; visual aids.