Isolated word recognition of silent speech using magnetic implants and sensors

Abstract

There are a number of situations where individuals wish to communicate verbally but are unable to use conventional means-so called 'silent speech'. These include speakers in noisy and covert situations as well as patients who have lost their voice as a result of a laryngectomy or similar procedure. This paper focuses on those who are unable to speak following a laryngectomy and assesses the possibility of speech recognition based on a magnetic implant/sensors system. Permanent magnets are placed on the tongue and lips and the changes in magnetic field resulting from movement during speech are monitored using a set of magnetic sensors. The sensor signals are compared to sets of pre-recorded templates using the dynamic time warping (DTW) method, and the best match is identified. Experimental trials are reported for subjects with intact larynx, typically using 500-1000 utterances used for speaker dependant training and testing. It is shown that recognition rates of over 90% are achievable for vocabularies of at least 57 isolated words: sufficient to drive command-and-control applications.