This is a report on perception aspects of a novel method of spectrography, developed as an aid for the deaf. By this method an animation is displayed on a screen, showing the time-frequency variations of an ongoing speech signal in real time. Here we evaluate the ability of human subjects to learn the animations for some multi-digit number utterances (such as telephone numbers). A recognition score of about 68 percent (where zero means chance expectation) was obtained through a number of forced-choice tests involving 2- digit up to 5-digit number utterances. The human subjects, being all beginners, took the tests after about only 30 minutes of training course. The results suggest a potential utility of the system for the deaf.
- Automatic Gain Control
- Recognition Score
- Speech Visualizer
- Human Auditory System
- Deaf Subject
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, access via your institution.
Unable to display preview. Download preview PDF.
Bregman, A.S.: Auditory Scene Analysis. MIT Press, Cambridge (1990)
Zhiyan, H., Jian, W., Shuxian, L.: Speech visualization system based on integrating feature for the hearing handicapped. In: IEEE Conference on Control and Decision (CCDC), China, pp. 1694–1698 (2011)
Soltani Farani, A.A., Chilton, E.H.S.: Auditory-based dynamical spectrogram. In: IEEE UK Symposium on Applications of Time-Frequency and Time-Scale Methods (TFTS 1997), University of Warwick, UK, August 27-29, pp. 173–176 (1997)
Liberman, A.M., Cooper, F.S., Shankweiler, D.P., Studdert-Kennedy: Why are speech spectrograms hard to read. Am. Annal. Deaf 113(2), 127–134 (1968)
Soltani Farani, A.A.: Sound visualization as an aid for the deaf, a new approach. PhD thesis, University of Surrey (1998)
Editors and Affiliations
Rights and permissions
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bazin, S., Farani, A.A.S. (2013). Perception of Animated Spectrogram of Speech, a Multi-word Test. In: Pons, J., Torricelli, D., Pajaro, M. (eds) Converging Clinical and Engineering Research on Neurorehabilitation. Biosystems & Biorobotics, vol 1. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34546-3_60
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34545-6
Online ISBN: 978-3-642-34546-3
eBook Packages: EngineeringEngineering (R0)