Abstract
It is proposed that myo-electric signals can be used to augment conventional speech-recognition systems to improve their performance under acoustically noisy conditions (e.g. in an aircraft cockpit). A preliminary study is performed to ascertain the presence of speech information within myo-electric signals from facial muscles. Five surface myo-electric signals are recorded during speech, using Ag−AgCl button electrodes embedded in a pilot oxygen mask. An acoustic channel is also recorded to enable segmentation of the recorded myo-electric signal. These segments are processed off-line, using a wavelet transform feature set, and classified with linear discriminant analysis. Two experiments are performed, using a ten-word vocabulary consisting of the numbers ‘zero’ to ‘nine’. Five subjects are tested in the first experiment, where the vocabulary is not randomised. Subjects repeat each word continuously for 1 min; classification errors range from 0.0% to 6.1%. Two of the subjects perform the second experiment, saying words from the vocabulary randomly; classification errors are 2.7% and 10.4%. The results demonstrate that there is excellent potential for using surface myo-electric signals to enhance the performance of a conventional speech-recognition system.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Day, S. H. (1990): ‘Recognition of speech utilizing the myoelectric signals of neck muscles — An advanced study in the time domain’. MSc thesis, Auburn University
Englehart, K., Hudgins, B., Parker, P.A., andStevenson, M. (1999): ‘Classification of the myoelectric signal using time-frequency based representations,’Med. Eng. Phys.,21, pp. 431–438
Hudgins, B. (1991) ‘A new approach to multifunction myoelectric control’. PhD thesis, University of New Brunswick, Fredericton, NB, Canada
Hudgins, B., Parker, P. A., andScott, R. N. (1993): ‘A new strategy for multifunction myoelectric control’,IEEE Trans. Biomed. Eng.,40, pp. 82–94
Long, D. W. (1990): ‘Speech recognition from myoelectric signals — Frequency spectrum shaping effects on speech recognition’. MSc thesis, Auburn University
Lovely, D. F. (1993): ‘Low noise electrode amplifier for use in evoked potential studies’. 19th Canadian Medical & Biological Engineering Society (CMBES) Conference, Ottawa, Ont., Canada, pp. 236–237
Morse, M. S., andO'Brien, E. M. (1986): ‘Research summary of a scheme to ascertain the availability of speech information in the myoelectric signals of neck and head muscles using surface electrodes’,Comput. Biol. Med.,16, pp. 399–410
Research and Technology Organization (North Atlantic Treaty Organization) (1998): ‘Alternative control technologies’. RTO Technical Report 7
Sugie, N., andTsunoda, K. (1985): ‘A speech prosthesis employing a speech synthesizer — vowel discrimination from perioral muscle activities and vowel production’,IEEE Trans. Biomed. Eng.,32, pp. 485–490
White, R. G., andBeckett, P. (1983): ‘Increased aircraft survivability using direct voice input’. Proc. AGARD Flight Mechanics Panel Symposium: Flight mechanics and system design lessons from operational experience, AGARD-CP-347, Athens
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chan, A.D.C., Englehart, K., Hudgins, B. et al. Myo-electric signals to augment speech recognition. Med. Biol. Eng. Comput. 39, 500–504 (2001). https://doi.org/10.1007/BF02345373
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF02345373