Weight-Based Facial Expression Recognition from Near-Infrared Video Sequences
This paper presents a novel weight-based approach to recognize facial expressions from the near-infrared (NIR) video sequences. Facial expressions can be thought of as specific dynamic textures where local appearance and motion information need to be considered. The face image is divided into several regions from which local binary patterns from three orthogonal planes (LBP-TOP) features are extracted to be used as a facial feature descriptor. The use of LBP-TOP features enables us to set different weights for each of the three planes (appearance, horizontal motion and vertical motion) inside the block volume. The performance of the proposed method is tested in the novel NIR facial expression database. Assigning different weights to the planes according to their contribution improves the performance. NIR images are shown to deal with illumination variations comparing with visible light images.
KeywordsLocal binary pattern region based weights illumination invariance support vector machine
- 3.Shan, C., Gong, S., McOwan, P.W.: Robust Facial Expression Recognition Using Local Binary Patterns. In: 12th IEEE ICIP, pp. 370–373 (2005)Google Scholar
- 4.Liao, S., Fan, W., Chung, A.C.S., Yeung, D.-Y.: Facial Expression Recognition Using Advanced Local Binary Patterns, Tsallis Entropies and Global Appearance Features. In: 13rd IEEE ICIP, pp. 665–668 (2006)Google Scholar
- 9.Taini, M., Zhao, G., Li, S.Z., Pietikäinen, M.: Facial Expression Recognition from Near-Infrared Video Sequences. In: 19th ICPR (2008)Google Scholar
- 12.Zhao, G., Pietikäinen, M.: Principal Appearance and Motion from Boosted Spatiotemporal Descriptors. In: 1st IEEE Workshop on CVPR4HB, pp. 1–8 (2008)Google Scholar