The New Statistics for Better Science: Ask How Much, How Uncertain, and What Else is Known

Am Stat. 2019;73(Suppl 1):271-280. doi: 10.1080/00031305.2018.1518266. Epub 2019 Mar 20.

Abstract

The "New Statistics" emphasizes effect sizes, confidence intervals, meta-analysis, and the use of Open Science practices. We present 3 specific ways in which a New Statistics approach can help improve scientific practice: by reducing over-confidence in small samples, by reducing confirmation bias, and by fostering more cautious judgments of consistency. We illustrate these points through consideration of the literature on oxytocin and human trust, a research area that typifies some of the endemic problems that arise with poor statistical practice.

Keywords: Confidence Intervals; Estimation; Meta-Analysis; Open Science; the New Statistics.