Welfare Interface Using Multiple Facial Features Tracking
We propose a welfare interface using multiple facial features tracking, which can efficiently implement various mouse operations. The proposed system consist of five modules: face detection, eye detection, mouth detection, facial features tracking, and mouse control. The facial region is first obtained using skin-color model and connected-component analysis (CCs). Thereafter the eye regions are localized using neural network (NN)-based texture classifier that discriminates the facial region into eye class and non-eye class, and then mouth region is localized using edge detector. Once eye and mouth regions are localized, they are continuously and correctly tracking by mean-shift algorithm and template matching, respectively. Based on the tracking results, mouse operations such as movement or click are implemented. To assess the validity of the proposed system, it was applied to the interface system for web browser and was tested on a group of 25 users. The results show that our system have the accuracy of 99% and process more than 12 frames/sec on PC for the 320(240 size input image, as such it can supply a user-friendly and convenient access to a computer in real-time operation.
KeywordsFacial Feature Face Detection Facial Region Search Window Mouth Region
Unable to display preview. Download preview PDF.
- 2.Scassellati, B.: Eye finding via face detection for a foveated, active vision system. American Association for Artificial Intelligence (1998)Google Scholar
- 3.Hornof, A., Cavender, A., Hoselton, R.: EyeDraw: A System for Drawing Pictures with Eye Movements. ACM SIGACCESS Accessibility and Computing, Issue 77–78 (2003)Google Scholar
- 5.Lyons, M.J.: Facial Gesture Interfaces for Expression and Communication. In: IEEE International Conference on Systems, Man, Cybernetics, vol. 1, pp. 598–603 (2004)Google Scholar
- 6.Jie, Y., DaQuan, Y., WeiNa, W., XiaoXia, X., Hui, W.: Real-time detecting system of the driver’s fatigue. In: ICCE International Conference on Consumer Electronics, 2006 Digest of Technical Papers, pp. 233–234 (2006)Google Scholar
- 7.Schiele, B., Waibel, A.: Gaze Tracking Based on Face-Color. School of Computer Science. Carnegie Mello University (1995)Google Scholar
- 10.Olson, C.F.: Maximum-Likelihood Template Matching. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 52–57 (2000)Google Scholar