Skip to main content
SpringerLink
Log in

A Survey on Different Visual Speech Recognition Techniques

  • Conference paper
  • First Online:
Data Analytics and Learning

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 43))

Abstract

In automatic speech recognition (ASR) visual speech information plays a pivotal role especially in the presence of acoustic noise. This paper provides a short review of the different methods for visual speech recognition systems (VSR). Here, we discuss the different stages of VSR including the face and lip localization techniques and different visual feature extraction techniques. We also provide the details of audio-visual database related to this study.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Dupont, S., Luettin, J.: Audio-visual speech modelling for continuous speech recognition. IEEE Trans. Multimed. 2(3), 141–151 (2000)

    Article  Google Scholar 

  2. Hazen, T.J.: Visual modal structures and asynchrony constraints for audio-visual speech recognition. IEEE Trans. Audio Speech Lang. Process. 14(3) (2006)

    Article  Google Scholar 

  3. Seymour, R., Stewart, D., Ming, J.: Comparison of image transform based features for visual speech recognition in clean and corrupted videos. EURASIP J. Image Video Process. 2008(14) (2008)

    Article  Google Scholar 

  4. Puvisan, N., Palanivel, S.: Lip reading of hearing impaired persons using HMM. Int. J. Expert Syst. Appl. 38(4) (2011)

    Google Scholar 

  5. Kaynak, M.N., Cheok, A.D., Sengupta, K., Jian, Z., Chung, K.C.: Lip geometric features for human-computer interaction using bimodal speech recognition: comparison and analysis. Speech Commun. 43(1–2), 1–16 (2004)

    Article  Google Scholar 

  6. Jachimski, D., Czyzewski, A., Ciszewski, T.A.: Comparative study of English viseme recognition methods and algorithms. Multimed. Tools Appl. (2017)

    Google Scholar 

  7. Hassanat, A.B.: Visual words for automatic lip reading. Ph.D. thesis, Buckingham, UK, University of Buckingham (2009)

    Google Scholar 

  8. Upadhyaya, P., Farooq, O.: Comparative study of visual feature for bimodal Hindi speech recognition. Arch. Acoust. 609–619 (2015)

    Article  Google Scholar 

  9. Morade, S.S., Patnaik, S.: Comparison of classifiers for lip reading with CUAVE and TULIPS database. Int. J. Light Electr. Opt. 126(24) (2015). Elsevier

    Article  Google Scholar 

  10. Morade, S.S., Patnaik, S.: A novel lip-reading algorithm by using localized ACM and HMM: tested for digit recognition. Int. J. Light Electr. Opt. 125(18) (2014). Elsevier

    Article  Google Scholar 

  11. Astik, B., Sahu, P.K., Chandra, M.: Multiple camera audio visual speech recognition using active appearance model in car environment. Int. J. Speech Technol. 19(1) (2016). Springer

    Google Scholar 

  12. Harte, N.: TCD-TIMIT: an audio-visual corpus of continuous speech. IEEE Trans. Multimed. (2015)

    Google Scholar 

  13. Matthews, I., Cootes, T.F., Banbham, J.A., Cox, S., Harvey, R.: Extraction of visual features of lip reading. IEEE Trans. Pattern Anal. Mach. Intell. 24(2) (2002)

    Google Scholar 

  14. Czyzewski, A., Kostek, B., Bratoszewski, P., Kotus, J., Szykulski, M.: An audio-visual corpus for multimodal automatic speech recognition. J. Intell. Inf. Syst. 49, 167 (2017)

    Article  Google Scholar 

  15. Ibrahim, M.Z., Mulvaney, D.J.: Geometric based lip-reading using template probabilistic multi-dimension dynamic time warping. J. Vis. Commun. Image Represent. 30 (2015)

    Article  Google Scholar 

  16. Zhu, Z., Zhao, G., Hong, X., Pietikainen, M.: A review of recent advances in visual speech decoding. Int. J. Image Vis. Comput. 32(9) (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Central University of Kerala, Kasaragod, Kerala, India

    Shabina Bhaskar, T. M. Thasleema & R. Rajesh

Authors
  1. Shabina Bhaskar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. T. M. Thasleema
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. R. Rajesh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shabina Bhaskar .

Editor information

Editors and Affiliations

  1. Indian Institute of Information Technology, Allahabad, Uttar Pradesh, India

    P. Nagabhushan

  2. Department of Computer Science and Engineering, CBCS Education, University of Mysore, Mysuru, Karnataka, India

    D. S. Guru

  3. Department of Studies in Computer Science, Mangalore University, Mangalore, Karnataka, India

    B. H. Shekar

  4. Department of Information Science and Engineering, Maharaja Institute of Technology, Belawadi, Karnataka, India

    Y. H. Sharath Kumar

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bhaskar, S., Thasleema, T.M., Rajesh, R. (2019). A Survey on Different Visual Speech Recognition Techniques. In: Nagabhushan, P., Guru, D., Shekar, B., Kumar, Y. (eds) Data Analytics and Learning. Lecture Notes in Networks and Systems, vol 43. Springer, Singapore. https://doi.org/10.1007/978-981-13-2514-4_26

Download citation

Publish with us

Policies and ethics

Search

Navigation