Administrative data are frequently used to identify Autism Spectrum Disorder (ASD) cases in epidemiological studies. However, validation studies on this mode of case ascertainment have lacked access to high-quality clinical diagnostic data and have not followed published reporting guidelines. We report on the diagnostic accuracy of using readily available health administrative data for pediatric ASD case ascertainment. The validation cohort included almost all the ASD-positive children born in British Columbia, Canada from April 1, 2000 to December 31, 2009 and consisted of 8,670 children in total. 4,079 ASD-positive and 2,787 ASD-negative children were identified using Autism Diagnostic Observation Schedule (ADOS) and Autism Diagnostic Interview-Revised (ADI-R) assessments done through the British Columbia Autism Assessment Network (BCAAN). An additional 1,804 ADOS/ADI-R assessed ASD-positive children were identified using Ministry of Education records. This prospectively collected clinical data (the diagnostic gold standard) was then linked to each child's physician billing and hospital discharge data. The diagnostic accuracy of 11 algorithms that used the administrative data to assign ASD case status was assessed. For all algorithms, high positive predictive values (PPVs) were observed alongside low values for other measures of diagnostic accuracy illustrating that PPVs alone are not an adequate measure of diagnostic accuracy. We show that British Columbia's health administrative data cannot reliably be used to discriminate between children with ASD and children with other developmental disorders. Utilizing these data may result in misclassification bias. Methodologically sound, region-specific validation studies are needed to support the use of administrative data for ASD case ascertainment. Autism Res 2020, 13: 456-463. © 2019 International Society for Autism Research, Wiley Periodicals, Inc. LAY SUMMARY: Health administrative data are frequently used to identify Autism Spectrum Disorder (ASD) cases for research purposes. However, previous validation studies on this sort of case identification have lacked access to high-quality clinical diagnostic data and have not followed published reporting guidelines. We show that British Columbia's health administrative data cannot reliably be used to discriminate between children with ASD and children with other developmental disorders.
Keywords: Autism spectrum disorder; diagnostic accuracy; health administrative data; validation.
© 2019 International Society for Autism Research, Wiley Periodicals, Inc.