Application of Wearable Computer and ASR Technology in an Underground Mine to Support Mine Supervision of the Heavy Machinery Chamber

Sensors (Basel). 2022 Oct 8;22(19):7628. doi: 10.3390/s22197628.

Abstract

Systems that use automatic speech recognition in industry are becoming more and more popular. They bring benefits especially in cases when the user's hands are often busy or the environment does not allow the use of a keyboard. However, the accuracy of algorithms is still a big challenge. The article describes the attempt to use ASR in the underground mining industry as an improvement in the records of work in the heavy machinery chamber by a foreman. Particular attention was paid to the factors that in this case will have a negative impact on speech recognition: the influence of the environment, specialized mining vocabulary, and the learning curve. First, the foreman's workflow and documentation were recognized. This allowed for the selection of functionalities that should be included in the application. A dictionary of specialized mining vocabulary and a source database were developed which, in combination with the string matching algorithms, aim to improve correct speech recognition. Text mining analysis, machine learning methods were used to create functionalities that provide assistance in registering information. Finally, the prototype of the application was tested in the mining environment and the accuracy of the results were presented.

Keywords: augmented reality; automatic speech recognition; self-propelled machine; text mining; transcription; underground mining; voice interface; wearable computer.

MeSH terms

  • Computers
  • Speech Recognition Software
  • Speech*
  • Technology
  • Wearable Electronic Devices*