Speech-driven mobile games for speech therapy: User experiences and feasibility

Int J Speech Lang Pathol. 2018 Nov;20(6):644-658. doi: 10.1080/17549507.2018.1513562. Epub 2018 Oct 9.

Abstract

Purpose: To assist in remote treatment, speech-language pathologists (SLPs) rely on mobile games, which though entertaining, lack feedback mechanisms. Games integrated with automatic speech recognition (ASR) offer a solution where speech productions control gameplay. We therefore performed a feasibility study to assess children's and SLPs' experiences towards speech-controlled games, game feature preferences and ASR accuracy. Method: Ten children with childhood apraxia of speech (CAS), six typically developing (TD) children and seven SLPs trialled five games and answered questionnaires. Researchers also compared the results of ASR to perceptual judgment. Result: Children and SLPs found speech-controlled games interesting and fun, despite ASR-human disagreements. They preferred games with rewards, challenge and multiple difficulty levels. Automatic speech recognition-human agreement was higher for SLPs than children, similar between TD and CAS and unaffected by CAS severity (77% TD, 75% CAS - incorrect; 51% TD, 47% CAS, 71% SLP - correct). Manual stop recording yielded higher agreement than automatic. Word length did not influence agreement. Conclusion: Children's and SLPs' positive responses towards speech-controlled games suggest that they can engage children in higher intensity practice. Our findings can guide future improvements to the ASR, recording methods and game features to improve the user experience and therapy adherence.

Keywords: ASR applications; ASR in games; childhood apraxia of speech; mobile therapy apps; speech-controlled games.

Publication types

  • Clinical Trial
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Child
  • Feasibility Studies
  • Female
  • Humans
  • Male
  • Mobile Applications*
  • Speech Therapy / instrumentation
  • Speech Therapy / methods*
  • Speech-Language Pathology / instrumentation
  • Speech-Language Pathology / methods*
  • Video Games*