Use of a humanoid robot for auditory psychophysical testing

PLoS One. 2023 Dec 13;18(12):e0294328. doi: 10.1371/journal.pone.0294328. eCollection 2023.

Abstract

Tasks in psychophysical tests can at times be repetitive and cause individuals to lose engagement during the test. To facilitate engagement, we propose the use of a humanoid NAO robot, named Sam, as an alternative interface for conducting psychophysical tests. Specifically, we aim to evaluate the performance of Sam as an auditory testing interface, given its potential limitations and technical differences, in comparison to the current laptop interface. We examine the results and durations of two voice perception tests, voice cue sensitivity and voice gender categorisation, obtained from both the conventionally used laptop interface and Sam. Both tests investigate the perception and use of two speaker-specific voice cues, fundamental frequency (F0) and vocal tract length (VTL), important for characterising voice gender. Responses are logged on the laptop using a connected mouse, and on Sam using the tactile sensors. Comparison of test results from both interfaces shows functional similarity between the interfaces and replicates findings from previous studies with similar tests. Comparison of test durations shows longer testing times with Sam, primarily due to longer processing times in comparison to the laptop, as well as other design limitations due to the implementation of the test on the robot. Despite the inherent constraints of the NAO robot, such as in sound quality, relatively long processing and testing times, and different methods of response logging, the NAO interface appears to facilitate collecting similar data to the current laptop interface, confirming its potential as an alternative psychophysical test interface for auditory perception tests.

MeSH terms

  • Auditory Perception
  • Cues
  • Gender Identity
  • Hearing Tests* / instrumentation
  • Hearing Tests* / methods
  • Humans
  • Robotics*
  • Speech Acoustics
  • Speech Perception*

Grants and funding

D. Baskent: VICI Grant from the Netherlands Organization for Scientific Research (NWO) and the Netherlands Organization for Health Research and Development (ZonMw) (Grant No. 918-17-603) – https://www.nwo.nl/en; The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. L. Meyer, L. Rachman, G. Araiza-Illan, D. Baskent: W.J. Kolff Institute, University Medical Centre Groningen (no grant number) – https://umcgresearch.org/w/wjkolff; The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. L. Meyer, L. Rachman, G. Araiza-Illan, E. Gaudrain, D. Baskent: Heinsius-Houbolt Foundation (No grant number); The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.