Abstract
By the earliest motivation of building robots to take care of human being in the daily life, the researches on humanoid robots have been explored and developed over the recent decades. One challenge of humanoid robots is its capability of communication with people via audio-visual speech. Certainly, the integration of audio module and visual module improve the robot performance. In this paper, we present a novel system combines these two modules in one environment to be utilized alone or in humanoid robots. The proposed system adapts the user facial movements that cannot be avoided in reality. The experimental results show how these two modules enhance each other and yield an effective speech recognizer.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Bailly, G., Perrier, P., Vatikiotis-Bateson, E.: Audiovisual Speech Processing. Cambridge University Press (2012)
Chin, S.W., Seng, K.P., Ang, L.-M.: Audio-visual speech processing for human computer interaction. In: Gulrez, T., Hassanien, A.E. (eds.) Advances in Robotics and Virtual Reality. ISRL, vol. 26, pp. 135–165. Springer, Heidelberg (2012)
Kohonen, T.: Self-Organizing Maps, 3rd edn. Springer (2001)
Potamianos, G.: Audio-visual speech processing: Progress and challenges. In: Proceedings of the HCSNet Workshop on Use of Vision in Human-Computer Interaction (VisHCI 2006), vol. 56, p. 5. Australian Computer Society, Inc. (2006)
Puviarasan, N., Palanivel, S.: Lip reading of hearing impaired persons using hmm. Expert Systems with Applications 38(4), 4477–4481 (2011)
Rabiner, L.: A tutorial on hidden markov models and selected applications in speech recognition. Proceedings of the IEEE 77, 257–286 (1989)
Saitoh, T., Konishi, R.: Real-time word lip reading system based on trajectory feature. IEE J. Transactions on Electrical and Electronic Engineering 6(3), 289–291 (2011)
Shin, J., Lee, J., Kim, D.: Real-time lip reading system for isolated korean word recognition. Pattern Recognition 44(3), 559–571 (2011)
Viola, P., Jones, M.: Robust real-time object detection. International Journal of Computer Vision 57(2), 137–154 (2004)
Wu, X., Kumar, V., Ross Quinlan, J., Ghosh, J., Yang, Q., et al.: Top 10 algorithms in data mining. In: Knowledge Information Systems, vol. 14, pp. 1–37. Springer (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Sagheer, A., Aly, S., Anter, S. (2014). Bimodal Speech Recognition for Robot Applications. In: Gruca, D., Czachórski, T., Kozielski, S. (eds) Man-Machine Interactions 3. Advances in Intelligent Systems and Computing, vol 242. Springer, Cham. https://doi.org/10.1007/978-3-319-02309-0_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-02309-0_9
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-02308-3
Online ISBN: 978-3-319-02309-0
eBook Packages: EngineeringEngineering (R0)