Assessing machine learning for fair prediction of ADHD in school pupils using a retrospective cohort study of linked education and healthcare data

BMJ Open. 2022 Dec 5;12(12):e058058. doi: 10.1136/bmjopen-2021-058058.

Abstract

Objectives: Attention deficit hyperactivity disorder (ADHD) is a prevalent childhood disorder, but often goes unrecognised and untreated. To improve access to services, accurate predictions of populations at high risk of ADHD are needed for effective resource allocation. Using a unique linked health and education data resource, we examined how machine learning (ML) approaches can predict risk of ADHD.

Design: Retrospective population cohort study.

Setting: South London (2007-2013).

Participants: n=56 258 pupils with linked education and health data.

Primary outcome measures: Using area under the curve (AUC), we compared the predictive accuracy of four ML models and one neural network for ADHD diagnosis. Ethnic group and language biases were weighted using a fair pre-processing algorithm.

Results: Random forest and logistic regression prediction models provided the highest predictive accuracy for ADHD in population samples (AUC 0.86 and 0.86, respectively) and clinical samples (AUC 0.72 and 0.70). Precision-recall curve analyses were less favourable. Sociodemographic biases were effectively reduced by a fair pre-processing algorithm without loss of accuracy.

Conclusions: ML approaches using linked routinely collected education and health data offer accurate, low-cost and scalable prediction models of ADHD. These approaches could help identify areas of need and inform resource allocation. Introducing 'fairness weighting' attenuates some sociodemographic biases which would otherwise underestimate ADHD risk within minority groups.

Keywords: Child & adolescent psychiatry; EPIDEMIOLOGY; MENTAL HEALTH.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Attention Deficit Disorder with Hyperactivity* / diagnosis
  • Attention Deficit Disorder with Hyperactivity* / epidemiology
  • Child
  • Cohort Studies
  • Delivery of Health Care
  • Humans
  • Machine Learning
  • Retrospective Studies
  • Schools