Isolated word recognition of silent speech using magnetic implants and sensors

Gilbert, J. M.; Rybchenko, S. I.; Hofe, R.; Ell, S. R.; Fagan, M. J.; Moore, R. K.; Green, P.

Abstract

There are a number of situations where individuals wish to communicate verbally but are unable to use conventional means so called 'silent speech'. These include speakers in noisy and covert situations as well as patients who have lost their voice as a result of a laryngectomy or similar procedure. This paper focuses on those who are unable to speak following a laryngectomy and assesses the possibility of speech recognition based on a magnetic implant/sensors system. Permanent magnets are placed on the tongue and lips and the changes in magnetic field resulting from movement during speech are monitored using a set of magnetic sensors. The sensor signals are compared to sets of pre-recorded templates using the dynamic time warping (DTW) method, and the best match is identified. Experimental trials are reported for subjects with intact larynx, typically using 500-1000 utterances used for speaker dependant training and testing. It is shown that recognition rates of over 90% are achievable for vocabularies of at least 57 isolated words: sufficient to drive command-and-control applications. (C) 2010 IPEM. Published by Elsevier Ltd. All rights reserved.

• Journal Article Type: Article
• Publication Date: 2010-12
• Journal: Medical Engineering & Physics
• Print ISSN: 1350-4533
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 32
• Issue: 10
• Pages: 1189-1197
• APA6 Citation: Gilbert, J. M., Rybchenko, S. I., Hofe, R., Ell, S. R., Fagan, M. J., Moore, R. K., & Green, P. (2010). Isolated word recognition of silent speech using magnetic implants and sensors. Medical engineering & physics, 32(10), 1189-1197. https://doi.org/10.1016/j.medengphy.2010.08.011
• DOI: https://doi.org/10.1016/j.medengphy.2010.08.011
• Keywords: Laryngectomy; Speech restoration; Speech recognition; Silent speech interface
• Publisher URL: https://www.sciencedirect.com/science/article/pii/S1350453310001803?via%3Dihub#!