Agent-based simulation and child protection systems: Rationale, implementation, and verification

Abstract

Background and objective: Simulation models are an important tool used in health care and other disciplines to support operational research and decision-making. In the child protection literature, simulation models are an under-utilized source of research evidence.

Participants and setting: In this paper, we describe the rationale for and the development of an agent-based simulation of a child protection system in the US. Using the investigation, prevention service, and placement histories of 600,000 children served in an urban child welfare system, we walk the reader through the development of a prototype known as OSPEDALE.

Methods: The governing equations built into OSPEDALE probabilistically simulate the onset of investigations. Then, drawing from empirical survival distributions, the governing equations trace the probability of subsequent interactions with the system (recurrence of maltreatment, service referrals, and placement) conditional on the characteristics of children, their assessed risk level, and prior child protection system involvement.

Results: As an initial test of OSPEDALE's utility, we compare empirical admission counts with counts generated from OSPEDALE. Though the verification step is admittedly simple, the comparison shows that OSPEDALE replicates the empirical count of new admissions closely enough to justify further investment in OSPEDALE.

Conclusions: Management of public child protection systems is increasingly research evidence-dependent. The emphasis on research evidence as a decision-support tool has elevated evidence acquired through randomized clinical trials. Though important, the evidence from clinical trials represents only one type of research evidence. Properly specified, simulation models are another source of evidence with real-world relevance.

Keywords: Agent-based; Child protection; Simulation; Systems.