Abstract
Voice rehabilitation is needed after several diseases, when a subject’s vocal ability is compromised by surgical interference or removal of phonation organs (e.g. the larynx), by neural degeneration or by neurological injury to the motor component of the motor-speech system in the phonation area of the brain (e.g. dysarthria in Parkinson disease). A novel approach to voice rehabilitation consists of predicting the phonetic control sequence of the voice-production apparatus (larynx, tongue, etc.) by drawing inferences on the basis of myoelectric (EMG) signals captured by a set of contact electrodes, applied to the neck area of a subject with important phonatory alteration (e.g. laryngectomised) and intact neural control. The inference paradigm is based on an EFuNN (Evolving Fuzzy Neural Network) that has been trained to use the sampled EMG signal to predict the phoneme that corresponds to the motor control of the sublingual muscle movements monitored at phonation time. A phoneme-to-speech synthesizer generates audio output corresponding to the utterance the subject has tried to enunciate.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Balasubramanian, T.: Voice rehabilitation following total laryngectomy. Otoryngology Online J. 5(1), 5 (2015)
Goldstain, E.A., Heaton, J.T., Kobler, B., Stanley, G.B., Hillman, R.E.: Design and implementation of a hand-free electrolarynx device controlled by neck strap muscle electromyographic activity. IEEE Trans. Biomed. Eng. 51, 325–332 (2004)
Titze, I.R.: The physics of small-amplitude oscillation of the vocal folds. J. Acoust. Soc. Am. 83, 1536–1552 (1988). https://doi.org/10.1121/1.395910. PMID 3372869
Lucero, J.C.: The minimum lung pressure to sustain vocal fold oscillation. J. Acoust. Soc. Am. 98, 779–784 (1995)
Lucero, J.C.: Optimal glottal configuration for ease of phonation. J. Voice 12, 151–158 (1998)
Mor, N., Simonyan, K., Blitzer, A.: Central voice production and pathophysiology of spasmodic dysphonia. Laryngoscope 128(1), 177–183 (2018). Epub 23 May 2017, Review (2018)
Jürgens, U.: Neural pathways underlying vocal control. Neurosci. Biobehav. Rev. 26, 235–258 (2002)
Jürgens, U.: A study of the central control of vocalization using the squirrel monkey. Med. Eng. Phys. 24, 473–477 (2002)
Vihma, Mn., de Boysson-Bardies, B.: The nature and origins of ambient language influence on infant vocal production and early words. Phonetica 51, 159–169 (1994)
Mac Neilage, P.F.: The frame/content theory of evolution of speech production. Behav. Brain Sci. 21, 499–511 (1998)
Kuypers, H.G.: Cortico-bulbar connexions to the pons and lower brainstem in man: an anatomical study. Brain 81, 364–388 (1958)
Haslinger, B., Erhard, P., Dresel, C., Castrop, F., Roettinger, M., Ceballos-Baumann, A.O.: Silent event-related, fMRI reveals reduced sensorimotor activation in laryngeal dystonia. Neurology 65, 1562–1569 (2005)
Simonyan, K., Ludlow, C.L.: Abnormal activation of the primary somatosensory cortex in spasmodic dysphonia: an fMRI study. Cereb. Cortex 20, 2749–2759 (2010)
Rödel, R.M., et al.: Human cortical motor representation of the larynx as assessed by transcranial magnetic stimulation (TMS). Laryngoscope 114, 918–922 (2004)
Ludlow, C.L.: Spasmodic dysphonia: a laryngeal control disorder specific to speech. J. Neurosci. 31(3), 793–797 (2011)
Kasabov, N.: Evolving Connectionist Systems: The Knowledge Engineering Approach. Springer, Heidelberg (2007). https://doi.org/10.1007/978-1-84628-347-5
Kasabov, N.: EFuNN, IEEE Tr SMC (2001)
Kasabov, N.: Evolving fuzzy neural networks – algorithms, applications and biological motivation. In: Yamakawa, T., Matsumoto, G. (eds.) Methodologies for the Conception, Design and Application of the Soft Computing, pp. 271–274. World Computing (1998)
http://www.kedri.aut.ac.nz/areas-of-expertise/data-mining-and-decision-support-systems/neucom
Zahner, M., Janke, M., Wand, M., Schultz, T.: Conversion from facial myoelectric signals to speech: a unit selection approach. In: Interspeech, pp. 1184–1188 (2014)
Acknowledgments
A special acknowledgment is due to Prof. Nikola Kasabov, Auckland University of Technology, Director KEDRI – Knowledge Engineering and Discovery Research Institute, for his invaluable suggestions on how to get the most from the EFuNN’s evolving capabilities.
Acknowledgment is also due to Jan Hein Broeders (Analog Devices’ healthcare business-development manager for EMEA) for his precious support and expertise in hardware prototyping, especially for the analog front-end (AFE) subsystem.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Malcangi, M. et al. (2018). Myo-To-Speech - Evolving Fuzzy-Neural Network Prediction of Speech Utterances from Myoelectric Signals. In: Pimenidis, E., Jayne, C. (eds) Engineering Applications of Neural Networks. EANN 2018. Communications in Computer and Information Science, vol 893. Springer, Cham. https://doi.org/10.1007/978-3-319-98204-5_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-98204-5_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-98203-8
Online ISBN: 978-3-319-98204-5
eBook Packages: Computer ScienceComputer Science (R0)