Abstract
The number of persons with hearing and vision loss is on the rise as lifespans increase. Vision plays an important role in communication, especially in the presence of background noise or for persons with hearing loss. However, persons with vision loss cannot make use of this extra modality to overcome their hearing deficits. We propose automatically utilizing some visual information in hearing aids through the addition of a small wearable camera. Our initial results show potentially significant benefits to incorporating low level robust visual cues when the background noise is high. This technique can potentially benefit all persons with hearing loss, with substantial improvements possible for the speech perception performance of persons with dual sensory loss.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Compton-Conley, C., Neuman, A., Killion, M., Levitt, H.: Performance of directional microphones for hearing aids: real world versus simulation. J. Am. Acad.Audiol. 15, 440–455 (2004)
Fabry, D.A.: Adaptive directional microphone technology and hearing aids: Theoretical and clinical implications. Hearing Review (April 2005)
Gatehouse, S.: Electronic aids to hearing. Br. Med. Bull. 63(1), 147–156 (2002)
Haegerstrom-Portnoy, G., Schneck, M.E., Brabyn, J.: Seeing into old age: vision function beyond acuity. Optom. Vis. Sci. 76, 141–158 (1999)
Helfer, K.S., Freyman, R.L.: The role of visual speech cues in reducing energetic and informational masking. J. Acous. Soc. Am. 117(2), 842–849 (2005)
Horowitz, A.: Dual sensory impairment among the elderly. Tech. rep., Lighthouse International and AARP Andrus Foundation (2001)
Loizou, P.C.: Speech Enhancement: Theory and Practice. CRC Press (June 2007)
MacLeod, A., Summerfield, Q.: Quantifying the contribution of vision to speech perception in noise. Br. J. Audiol. 21(2), 131–141 (1987)
Ramírez, J., Segura, J.C., Benítez, C., Torre, Á.D.L., Rubio, A.: A new adaptive long-term spectral estimation voice activity detector. In: Eurospeech, Korea, pp. 961–964 (October 2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Tekin, E., Coughlan, J.M., Simon, H.J. (2014). An Investigation into Incorporating Visual Information in Audio Processing. In: Miesenberger, K., Fels, D., Archambault, D., Peňáz, P., Zagler, W. (eds) Computers Helping People with Special Needs. ICCHP 2014. Lecture Notes in Computer Science, vol 8547. Springer, Cham. https://doi.org/10.1007/978-3-319-08596-8_67
Download citation
DOI: https://doi.org/10.1007/978-3-319-08596-8_67
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-08595-1
Online ISBN: 978-3-319-08596-8
eBook Packages: Computer ScienceComputer Science (R0)