Effect of Perceptual Training with Sound-Guided and Kinesthetic Feedback on Human 3D Sound Localization Capabilities

Sensors (Basel). 2023 May 24;23(11):5023. doi: 10.3390/s23115023.

Abstract

In this paper, we experimentally investigate how the 3D sound localization capabilities of the blind can improve through perceptual training. To this end, we develop a novel perceptual training method with sound-guided feedback and kinesthetic assistance to evaluate its effectiveness compared to conventional training methods. In perceptual training, we exclude visual perception by blindfolding the subjects to apply the proposed method to the visually impaired. Subjects used a specially designed pointing stick to generate a sound at the tip, indicating localization error and tip position. The proposed perceptual training aims to evaluate the training effect on 3D sound localization, including variations in azimuth, elevation, and distance. The six days of training based on six subjects resulted in the following outcomes: (1) In general, accuracy in full 3D sound localization can be improved based on training. (2) Training based on relative error feedback is more effective than absolute error feedback. (3) Subjects tend to underestimate distance when the sound source is near, less than 1000 mm, or larger than 15° to the left, and overestimate the elevation when the sound source is near or in the center, and within ±15° in azimuth estimations.

Keywords: blind person; kinesthetic assistance; perceptual training; sound localization; vision system.

MeSH terms

  • Blindness
  • Feedback
  • Humans
  • Sound
  • Sound Localization*
  • Visual Perception

Grants and funding

This work was supported, in part, by the Deep Cross-Sensory Transfer for Visually Impaired project, 2020R1A2C200956811, of Korea National Research Foundation (NRF) sponsored by the Korea Ministry of Science and ICT; in part, by the AI Graduate School Program, Grant No. 2019-0-00421; and by the ICT Consilience Program, IITP -2020-0-01821, sponsored by the Korean Ministry of Science and Information Technology (MSIT) and Basic Science Research Program through the National Research Foundation funded by the Ministry of Education (NRF2016R1D1A1B03935633), South Korea.