A Haptic-Based Application for Active Exploration of Facial Expressions by the Visually Impaired
In this paper, a haptic-based interpretation of video images directly acquired by a webcam is introduced to help individuals who are visually impaired dynamically explore their own faces in an immersive haptic environment. Haptic interaction involves perception of the movement of different facial features through geometric cues in a 3D environment. Spatio-temporal variation of features due to facial movement assists those who are visually impaired to understand different facial expressions of emotions through active exploration of their own facial features. A dynamic haptic interface appropriate for this kind of interaction has been discussed. Lastly, application of this kind of training has been proposed for communication among individuals who are deafblind.
KeywordsFacial Expression Feature Point Facial Feature Anchor Point Active Exploration
Unable to display preview. Download preview PDF.
- 1.Mase, K.: Recognition of facial expression from optical flow. IEICE Transactions 74(10), 3474–3483 (1991)Google Scholar
- 2.Busso, C., Deng, Z., Yildirim, S., Bulut, M., Lee, C.M., Kazemzadeh, A., Lee, S., Neu-mann, U., Narayanan, S.: Analysis of emotion recognition using facial expressions, speech and multimodal information. In: Proceedings of the 6th International Conference on Multimodal Interfaces (ICMI), pp. 205–211 (2004)Google Scholar
- 3.Nicolle, J., Rapp, V., Bailly, K., Prevost, L., Chetouani, M.: Robust continuous prediction of human emotions using multiscale dynamic cues. In: Proceedings of the 14th International Conference on Multimodal Interfaces (ICMI), pp. 501–508 (2012)Google Scholar
- 4.Xiong, X., Torre, F.: Supervised descent method and its application to face alignment. In: Proceedings of Computer Vision and Pattern Recognition (CVPR) (2013)Google Scholar
- 8.Bailenson, J.N., Yee, N., Brave, S., Merget, D., Koslow, D.: Virtual interpersonal touch: expressing and recognizing emotions through haptic devices. Human-computer Interaction 22, 325–353 (2007)Google Scholar
- 9.Krishna, S., Bala, S., McDaniel, T.L., McGuire, S., Panchanathan, S.: VibroGlove: an assistive technology aid for conveying facial expressions. In: CHI Extended Abstracts, pp. 3637–3642 (2010)Google Scholar
- 13.Kim, S., Israr, A., Poupyrev, I.: Tactile rendering of 3D features on touch surfaces. In: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST), pp. 531–538 (2013)Google Scholar