Skip to main content

Isolated word recognition of silent speech using magnetic implants and sensors

Gilbert, J. M.; Rybchenko, S. I.; Hofe, R.; Ell, S. R.; Fagan, M. J.; Moore, R. K.; Green, P.

Authors

R. Hofe

S. R. Ell

R. K. Moore

P. Green



Abstract

There are a number of situations where individuals wish to communicate verbally but are unable to use conventional means so called 'silent speech'. These include speakers in noisy and covert situations as well as patients who have lost their voice as a result of a laryngectomy or similar procedure. This paper focuses on those who are unable to speak following a laryngectomy and assesses the possibility of speech recognition based on a magnetic implant/sensors system. Permanent magnets are placed on the tongue and lips and the changes in magnetic field resulting from movement during speech are monitored using a set of magnetic sensors. The sensor signals are compared to sets of pre-recorded templates using the dynamic time warping (DTW) method, and the best match is identified. Experimental trials are reported for subjects with intact larynx, typically using 500-1000 utterances used for speaker dependant training and testing. It is shown that recognition rates of over 90% are achievable for vocabularies of at least 57 isolated words: sufficient to drive command-and-control applications. (C) 2010 IPEM. Published by Elsevier Ltd. All rights reserved.

Journal Article Type Article
Publication Date 2010-12
Journal Medical Engineering & Physics
Print ISSN 1350-4533
Publisher Elsevier
Peer Reviewed Peer Reviewed
Volume 32
Issue 10
Pages 1189-1197
APA6 Citation Gilbert, J. M., Rybchenko, S. I., Hofe, R., Ell, S. R., Fagan, M. J., Moore, R. K., & Green, P. (2010). Isolated word recognition of silent speech using magnetic implants and sensors. Medical engineering & physics, 32(10), 1189-1197. https://doi.org/10.1016/j.medengphy.2010.08.011
DOI https://doi.org/10.1016/j.medengphy.2010.08.011
Keywords Laryngectomy; Speech restoration; Speech recognition; Silent speech interface
Publisher URL https://www.sciencedirect.com/science/article/pii/S1350453310001803?via%3Dihub#!
;