Reporting of effect sizes is standard practice in psychology and psychiatry research. However, interpretation of these effect sizes can be meaningless or misleading - in particular, the evaluation of specific effect sizes as 'small', 'medium' and 'large' can be inaccurate depending on the research context. A real-world example of this is research into the mental health of children and young people during the COVID-19 pandemic. Evidence suggests that clinicians and services are struggling with increased demand, yet population studies looking at the difference in mental health before and during the pandemic report effect sizes that are deemed 'small'. In this short review, we utilise simulations to demonstrate that a relatively small shift in mean scores on mental health measures can indicate a large shift in the number of cases of anxiety and depression when scaled up to an entire population. This shows that 'small' effect sizes can in some contexts be large and impactful.
Keywords: COVID-19; Effect size; children; epidemiology; mental health; pandemic; simulations; young people.
© 2023 The Authors. Journal of Child Psychology and Psychiatry published by John Wiley & Sons Ltd on behalf of Association for Child and Adolescent Mental Health.