Evaluation of Expression Recognition Techniques
The most expressive way humans display emotions is through facial expressions. In this work we report on several advances we have made in building a system for classification of facial expressions from continuous video input. We introduce and test different Bayesian network classifiers for classifying expressions from video. In particular we use Naive-Bayes classifiers and to learn the dependencies among different facial motion features we use Tree-Augmented Naive Bayes (TAN) classifiers. We also investigate a neural network approach. Further, we propose an architecture of hidden Markov models (HMMs) for automatically segmenting and recognizing human facial expression from video sequences. We explore both person-dependent and person-independent recognition of expressions and compare the different methods.
Unable to display preview. Download preview PDF.
- I. Cohen. Automatic facial expression recognition from video sequences using temporal information. In MS Thesis, University of Illinois at Urbana-Champaign, Dept. of Electrical Engineering, 2000.Google Scholar
- I. Cohen, N. Sebe, L. Chen, and T.S. Huang. Facial expression recognition from video sequences: Temporal and static modeling. to appear in Computer Vision and Image Understanding, 2003.Google Scholar
- P. Ekman and W.V. Friesen. Facial Action Coding System: Investigator’s Guide. Consulting Psychologists Press, Palo Alto, CA, 1978.Google Scholar
- T. Kanade, J. Cohn, and Y. Tian. Comprehensive database for facial expression analysis, 2000.Google Scholar
- A. Lanitis, C.J. Taylor, and T.F. Cootes. A unified approach to coding and interpreting face images. In Proc. 5th International Conference on Computer Vision (ICCV’95), pages 368–373, 1995.Google Scholar
- T. Otsuka and J. Ohya. Recognizing multiple persons’ facial expressions using HMM based on automatic extraction of significant frames from image sequences. In Proc. Int. Conf. on Image Processing (ICIP’97), pages 546–549, 1997.Google Scholar
- C. Padgett and G.W. Cottrell. Representing face images for emotion classification. In Conf. Advances in Neural Information Processing Systems, pages 894–900, 1996.Google Scholar
- H. Tao and T.S. Huang. Connected vibrations: A modal analysis approach to non-rigid motion tracking. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR’98), pages 735–740, 1998.Google Scholar
- N. Ueki, S. Morishima, H. Yamada, and H. Harashima. Expression analysis/synthesis system based on emotion space constructed by multilayered neural network. Systems and Computers in Japan, 25(13):95–103, Nov. 1994.Google Scholar