Abstract
Eye contact with virtual character can provide a realistic illusion to a user in an immersive virtual reality (VR) environment. This allows more believable eye communication between a user and a computer-generated virtual character. In this paper, an effective eye contact mechanism by innovatively combining a vision-based head tracker and an eye animation method is shown. Together, a robust color classification method to track the user’s face is developed which includes extracting the 3D information of the tracked face available from a stereo camera without the need for any handheld devices or special sensors attached on the user. Through the use of the vision-based head tracker, the virtual character will be aware of the user’s movements and can react to the user in a believable and pleasing manner by moving the head and the eyes to gaze at the user when the user is looking at the virtual character, or turning away when the user is not looking, or be in idle mode when the user is not around. The proposed eye contact method has been successfully applied in a virtual reality interactive game.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Taylor, R., Torres, D., Boulanger, P., Torres D., and Boulanger P., 2005, Using music to interact with a virtual character, Conference on New Interfaces for Musical Expression, Vancouver, 220–223.
Cayazza M., Charles F. and Steven J.M., 2002, Interacting with Virtual Characters in Interactive Storytelling, the first international joint conference on Autonomous agents and multiagent systems: part 1, Bologna, Italy, 318–325.
State A., 2007, Extract eye contact with virtual humans, Lecture Notes in Computer Science, Vol. 4796, 138–145.
Masuko S. and Hoshino J., 2007, Head-eye Animation Corresponding to a Conversation for CG Characters, Eurographics, 26(3).
Chai J.X., Xiao J. and Jodgins J., 2003, Vision-based Control of 3D Facial Animation, Eurographics, 193–206.
Kim K.N. and Ramakrishna R.S., 1999, Vision-Based Eye-Gaze Tracking for Human Computer Interface, IEEE International Conference on Systems, Man, and Cybernetics, 324–329.
Yuzer T.V., 2007, Generating Virtual Eye Contacts through Online Synchronous Communications in Virtual Classroom Applications, Turkish Online Journal of Distance Education, 8(1).
Yin, X.M. and Xie, M., 2001, Hand image Segmentation using Color and RCE Neural Network, Journal of Robotics and Autonomous Systems, 34(4), pp. 235–250.
Viola P. and Jones J.J, 2001, Rapid Object Detection using a Boosted Cascade of Simple Features, IEEE Conference on Computer Vision and Pattern Recognition, Hawaii, USA.
Williams B., Klein G. and Reid I., 2007, Real-time SLAM Relocalisation, IEEE Conference on Computer Vision.
Yuan, M. L., Ong, S. K. and Nee, A. Y. C., 2006, Augmented reality for assembly guidance using a virtual interactive tool, International Journal of Production Research, 46(7), 1745–1767.
Yuan, M. L., Ong, S. K. and Nee, A. Y. C., 2004, The virtual interaction panel: an easy control tool in augmented reality system, Computer Animation and Virtual Worlds, 15, 425–432.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer Science+Business Media B.V.
About this paper
Cite this paper
Yuan, M.L., Chua, G.G., Farbiz, F., Rahardja, S. (2011). Eye contact with a virtual character using a vision-based head tracker. In: Gelenbe, E., Lent, R., Sakellari, G., Sacan, A., Toroslu, H., Yazici, A. (eds) Computer and Information Sciences. Lecture Notes in Electrical Engineering, vol 62. Springer, Dordrecht. https://doi.org/10.1007/978-90-481-9794-1_43
Download citation
DOI: https://doi.org/10.1007/978-90-481-9794-1_43
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-90-481-9793-4
Online ISBN: 978-90-481-9794-1
eBook Packages: EngineeringEngineering (R0)