Fast Head Tilt Detection for Human-Computer Interaction
Accurate head tilt detection has a large potential to aid people with disabilities in the use of human-computer interfaces and provide universal access to communication software. We show how it can be utilized to tab through links on a web page or control a video game with head motions. It may also be useful as a correction method for currently available video-based assistive technology that requires upright facial poses. Few of the existing computer vision methods that detect head rotations in and out of the image plane with reasonable accuracy can operate within the context of a real-time communication interface because the computational expense that they incur is too great. Our method uses a variety of metrics to obtain a robust head tilt estimate without incurring the computational cost of previous methods. Our system runs in real time on a computer with a 2.53 GHz processor, 256 MB of RAM and an inexpensive webcam, using only 55% of the processor cycles.
KeywordsFace Detection Current Frame Gesture Recognition Previous Frame Head Tilt
Unable to display preview. Download preview PDF.
- 2.Lien, J.-J.J., Kanade, T., Cohn, J., Li, C.-C.: Automated facial expression recognition based on FACS action units. In: Proceedings of the Third IEEE International Conference on Face and Gesture Recognition, April 1998, pp. 390–395 (1998)Google Scholar
- 3.Lyons, M.J.: Facial gesture interfaces for expression and communication. In: Proceedings of the 2004 IEEE International Conference on Systems, Man and Cybernetics, vol. 1, pp. 598–603 (October 2004)Google Scholar
- 4.Magee, J.J., Scott, M.R., Waber, B.N., Betke, M.: Eyekeys: A real-time vision interface based on gaze detection from a low-grade video camera. In: Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW 2004), pp. 159–166 (July 2004)Google Scholar
- 5.Raouzaiou, N., Tsapatsoulis, V., Tzouvaras, G., Stamou, G., Kollias, S.: Stamou, and S. Kollias. A hybrid intelligent system for facial expression recognition. In: Proceedings of the European Symposium on Intelligent Technologies, Hybrid Systems and their implementation on Smart Adaptive Systems, Eunite 2002 (September 2002)Google Scholar
- 6.Bradski, G.R.: Computer vision face tracking for use in a perceptual user interface. Intel Technology Journal Q2, 15 (1998)Google Scholar
- 7.Schiele, B., Waibel, A.: Gaze tracking based on face color. In: International Workshop on Automatic Face- and Gesture-Recognition, pp. 344–349 (1995)Google Scholar
- 8.Schwerdt, K., Crowley, J.L.: Robust face tracking using color. In: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, Grenoble, France (March 2000)Google Scholar
- 9.Rowley, H., Baluja, S., Kanade, T.: Rotation invariant neural network-based face detection. In: Proceedings of the 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 1998), p. 38 (June 1998)Google Scholar
- 10.Shakhnarovich, G., Viola, P.A., Baback, M.: A unified learning framework for real time face detection and classification. In: Proceedings of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition, May 2004, pp. 16–26 (2004)Google Scholar
- 11.Sochman, J., Matas, J.: AdaBoost with totally corrective updates for fast face detection. In: Proceedings of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition, May 2004, pp. 445–450 (2004)Google Scholar
- 12.Wu, B., Ai, H., Huang, C., Lao, S.: Fast rotation invariant multi-view face detection based on real AdaBoost. In: Proceedings of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition, May 2004, pp. 79–84 (2004)Google Scholar