An exploratory study on dialect density estimation for children and adult's African American Englisha)

J Acoust Soc Am. 2024 Apr 1;155(4):2836-2848. doi: 10.1121/10.0025771.

Abstract

This paper evaluates an innovative framework for spoken dialect density prediction on children's and adults' African American English. A speaker's dialect density is defined as the frequency with which dialect-specific language characteristics occur in their speech. Rather than treating the presence or absence of a target dialect in a user's speech as a binary decision, instead, a classifier is trained to predict the level of dialect density to provide a higher degree of specificity in downstream tasks. For this, self-supervised learning representations from HuBERT, handcrafted grammar-based features extracted from ASR transcripts, prosodic features, and other feature sets are experimented with as the input to an XGBoost classifier. Then, the classifier is trained to assign dialect density labels to short recorded utterances. High dialect density level classification accuracy is achieved for child and adult speech and demonstrated robust performance across age and regional varieties of dialect. Additionally, this work is used as a basis for analyzing which acoustic and grammatical cues affect machine perception of dialect.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Adolescent
  • Adult
  • Black or African American*
  • Child
  • Child Language
  • Child, Preschool
  • Female
  • Humans
  • Language
  • Male
  • Phonetics
  • Speech Acoustics*
  • Speech Perception
  • Speech Production Measurement / methods
  • Young Adult