Skip to main content
Book cover

Converging Clinical and Engineering Research on Neurorehabilitation pp 375–379Cite as

Perception of Animated Spectrogram of Speech, a Multi-word Test

  • Conference paper

  • 208 Accesses

Part of the Biosystems & Biorobotics book series (BIOSYSROB,volume 1)

Abstract

This is a report on perception aspects of a novel method of spectrography, developed as an aid for the deaf. By this method an animation is displayed on a screen, showing the time-frequency variations of an ongoing speech signal in real time. Here we evaluate the ability of human subjects to learn the animations for some multi-digit number utterances (such as telephone numbers). A recognition score of about 68 percent (where zero means chance expectation) was obtained through a number of forced-choice tests involving 2- digit up to 5-digit number utterances. The human subjects, being all beginners, took the tests after about only 30 minutes of training course. The results suggest a potential utility of the system for the deaf.

Keywords

  • Automatic Gain Control
  • Recognition Score
  • Speech Visualizer
  • Human Auditory System
  • Deaf Subject

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-642-34546-3_60
  • Chapter length: 5 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   349.00
Price excludes VAT (USA)
  • ISBN: 978-3-642-34546-3
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   449.99
Price excludes VAT (USA)
Hardcover Book
USD   549.99
Price excludes VAT (USA)
Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bregman, A.S.: Auditory Scene Analysis. MIT Press, Cambridge (1990)

    Google Scholar 

  2. Zhiyan, H., Jian, W., Shuxian, L.: Speech visualization system based on integrating feature for the hearing handicapped. In: IEEE Conference on Control and Decision (CCDC), China, pp. 1694–1698 (2011)

    Google Scholar 

  3. Soltani Farani, A.A., Chilton, E.H.S.: Auditory-based dynamical spectrogram. In: IEEE UK Symposium on Applications of Time-Frequency and Time-Scale Methods (TFTS 1997), University of Warwick, UK, August 27-29, pp. 173–176 (1997)

    Google Scholar 

  4. Liberman, A.M., Cooper, F.S., Shankweiler, D.P., Studdert-Kennedy: Why are speech spectrograms hard to read. Am. Annal. Deaf 113(2), 127–134 (1968)

    Google Scholar 

  5. Soltani Farani, A.A.: Sound visualization as an aid for the deaf, a new approach. PhD thesis, University of Surrey (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Electrical Engineering Group, Faculty of Engineering and Technology, Imam Khomeini International University, Qazvin, Iran

    Somayeh Bazin & Ali Asghar Soltani Farani

Authors
  1. Somayeh Bazin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ali Asghar Soltani Farani
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Somayeh Bazin .

Editor information

Editors and Affiliations

  1. Bioengineering Group, Spanish National Research Council (CSIC), Madrid, Spain

    José L Pons

  2. Bioengineering Group, Spanish National Research Council (CSIC), Madrid, Spain

    Diego Torricelli

  3. Bioengineering Group, Spanish National Research Council (CSIC), Madrid, Spain

    Marta Pajaro

Rights and permissions

Reprints and Permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Bazin, S., Farani, A.A.S. (2013). Perception of Animated Spectrogram of Speech, a Multi-word Test. In: Pons, J., Torricelli, D., Pajaro, M. (eds) Converging Clinical and Engineering Research on Neurorehabilitation. Biosystems & Biorobotics, vol 1. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34546-3_60

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-34546-3_60

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-34545-6

  • Online ISBN: 978-3-642-34546-3

  • eBook Packages: EngineeringEngineering (R0)