Automatic Speech Recognition Performance Improvement for Mandarin Based on Optimizing Gain Control Strategy

Sensors (Basel). 2022 Apr 15;22(8):3027. doi: 10.3390/s22083027.

Abstract

Automatic speech recognition (ASR) is an essential technique of human-computer interactions; gain control is a commonly used operation in ASR. However, inappropriate gain control strategies can lead to an increase in the word error rate (WER) of ASR. As there is a current lack of sufficient theoretical analyses and proof of the relationship between gain control and WER, various unconstrained gain control strategies have been adopted on realistic ASR systems, and the optimal gain control with respect to the lowest WER, is rarely achieved. A gain control strategy named maximized original signal transmission (MOST) is proposed in this study to minimize the adverse impact of gain control on ASR systems. First, by modeling the gain control strategy, the quantitative relationship between the gain control strategy and the ASR performance was established using the noise figure index. Second, through an analysis of the quantitative relationship, an optimal MOST gain control strategy with minimal performance degradation was theoretically deduced. Finally, comprehensive comparative experiments on a Mandarin dataset show that the proposed MOST gain control strategy can significantly reduce the WER of the experimental ASR system, with a 10% mean absolute WER reduction at -9 dB gain.

Keywords: automatic speech recognition (ASR); gain control; human–computer interaction; maximized original signal transmission (MOST); noise figure; word error rate (WER).

MeSH terms

  • Humans
  • Noise
  • Speech
  • Speech Perception*
  • Speech Recognition Software*