Speech synthesis parameter generation for the assistive silent speech interface MVOCA

Hofe, Robin; Ell, Stephen R.; Fagan, Michael J.; Gilbert, James M.; Green, Phil D.; Moore, Roger K.; Rybchenko, Sergey I.

Abstract

In previous publications, a silent speech interface based on permanent-magnetic articulography (PMA) has been introduced and evaluated using standard automatic speech recognition techniques. However, word recognition is a task that is computationally expensive and introduces a significant time delay between speech articulation and generation of the acoustic signal. This paper investigates a direct synthesis approach where control parameters for parametric speech synthesis are generated directly from the sensor data of the silent speech interface, without an intermediate lexical representation. Users of such a device would not be tied to the limited vocabulary of a word-based recogniser and could therefore express themselves more freely. This paper presents a feasibility study that investigates whether it is possible to infer speech synthesis parameters from PMA sensor data

Citation

Hofe, R., Ell, S. R., Fagan, M. J., Gilbert, J. M., Green, P. D., Moore, R. K., & Rybchenko, S. I. (2011). Speech synthesis parameter generation for the assistive silent speech interface MVOCA

• Journal Article Type: Article
• Conference Name: Interspeech 2011: 12th Annual Conference of the International Speech Communication Association
• Conference Location: Florence, Italy
• Acceptance Date: Dec 31, 2011
• Publication Date: Dec 31, 2011
• Journal: Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
• Peer Reviewed: Peer Reviewed
• Pages: 3009 - 3012
• Public URL: https://hull-repository.worktribe.com/output/417603
• Publisher URL: https://www.isca-speech.org/archive/interspeech_2011/i11_3009.html