Signal, Image and Video Processing

, Volume 9, Issue 8, pp 1871–1880 | Cite as

Head pose estimation based on face symmetry analysis

  • Afifa Dahmane
  • Slimane Larabi
  • Ioan Marius Bilasco
  • Chabane Djeraba
Original Paper
First Online:
Received:
Revised:
Accepted:

Abstract

This paper addresses the problem of head pose estimation in order to infer non-intrusive feedback from users about gaze attention. The proposed approach exploits the bilateral symmetry of the face. Size and orientation of the symmetrical area of the face is used to estimate roll and yaw poses by the mean of decision tree model. The approach does not need the location of interest points on face and presents robustness to partial occlusions. Tests were performed on different datasets (FacePix, CMU PIE, Boston University) and our approach coped with variability in illumination and expressions. Results demonstrate that the changes in the size of the regions that contain a bilateral symmetry provide accurate pose estimation.

Keywords

Head pose estimation Symmetry detection Pattern recognition 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgments

This work was conducted in the context of the ITEA2 “Empathic Products” project, ITEA2 1105, and is supported by funding from DGCIS, France.

References

  1. 1.
    Murphy-Chutorian, E., Trivedi, M.M.: Head pose estimation in computer vision: a survey. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 31(4), 607–626 (2009)CrossRefGoogle Scholar
  2. 2.
    Black, J., Gargesha, M., Kahol, K., Kuchi, P., Panchanathan, S.: A framework for performance evaluation of face recognition algorithms. In: ITCOM, Internet Multimedia Systems II, Boston (2002)Google Scholar
  3. 3.
    Sim, T., Baker, S., Bsat, M.: The cmu pose, illumination, and expression database. IEEE Trans. Pattern Anal. Mach. Intell. 25(12), 1615–1618 (2003)CrossRefGoogle Scholar
  4. 4.
    Valenti, R., Gevers, T.: Robustifying eye center localization by head pose cues. In: CVPR (2009)Google Scholar
  5. 5.
    Wang, J.-G., Sung, E.: Em enhancement of 3d head pose estimated by point at infinity. Image Vis. Comput. 25(12), 1864–1874 (2007)CrossRefGoogle Scholar
  6. 6.
    Pan, Y., Zhu, H., Ji, R.: 3-D Head Pose Estimation for Monocular Image. ser. Fuzzy Systems and Knowledge Discovery. Springer, Berlin (2005)Google Scholar
  7. 7.
    Baker, S., Matthews, I., Xiao, J., Gross, R., Kanade, T., Ishikawa, T.: Real-time non-rigid driver head tracking for driver mental state estimation. In: 11th World Congress on Intelligent Transportation Systems (2004)Google Scholar
  8. 8.
    Caunce, A., Taylor, C.J., Cootes, T.F.: Improved 3d model search for facial feature location and pose estimation in 2d images. In: BMVC (2010)Google Scholar
  9. 9.
    Huang, J., Shao, X., Wechsler, H.: Face pose discrimination using support vector machines (svm). In: ICPR (1998)Google Scholar
  10. 10.
    Dahmane, M., Meunier, J.: Object representation based on gabor wave vector binning: an application to human head pose detection. In: ICCV (2011)Google Scholar
  11. 11.
    Chamveha, I., Sugano, Y., Sugimura, D., Siriteerakul, T., Okabe, T., Sato, Y., Sugimoto, A.: Appearance-based head pose estimation with scene-specific adaptation. In: ICCV (2011)Google Scholar
  12. 12.
    Li, S., Fu, Q., Gu, L., Scholkopf, B., Cheng, Y., Zhang, H.: Kernel machine based learning for multi-view face detection and pose estimation. In: ICCV, vol. 2, pp. 674–679 (2001)Google Scholar
  13. 13.
    Benfold, B., Reid, I.: Colour invariant head pose classification in low resolution video. In: BMVC (2008)Google Scholar
  14. 14.
    Zhang, Z., Hu, Y., Liu, M., Huang, T.: Head pose estimation in seminar room using multi view face detectors. Multimodal Technol Percept. Hum. 4122, 299–304 (2007)CrossRefGoogle Scholar
  15. 15.
    Ji, H., Liu, R., Su, F., Su, Z., Tian, Y.: Robust head pose estimation via convex regularized sparse regression. In: ICIP (2011)Google Scholar
  16. 16.
    Ranganathan, A., Yang, M.-H.: Online sparse matrix gaussian process regression and vision applications. In: ECCV (2008)Google Scholar
  17. 17.
    Murad Al Haj, J.G., Davis, L.S.: On partial least squares in head pose estimation: how to simultaneously deal with misalignment. In: CVPR (2012)Google Scholar
  18. 18.
    Murphy-Chutorian, E., Doshi, A., Trivedi, M.: Head pose estimation for driver assistance systems: a robust algorithm and experimental evaluation. In: Intelligent Transportation Systems Conference, ITSC. IEEE, pp. 709–714 (2007)Google Scholar
  19. 19.
    li Tian, Y., Brown, L., Connell, J., Pankanti, S., Hampapur, A., Senior, A., Bolle, R.: Absolute head pose estimation from overhead wide-angle cameras. In: IEEE International Workshop on Analysis and Modeling of Faces and Gestures (2003)Google Scholar
  20. 20.
    Beymer, D.J.: Face recognition under varying pose. In: CVPR, pp. 756–761 (1994)Google Scholar
  21. 21.
    Jamie Sherrah, S.G., Ong, E.-J.: Understanding pose discrimination in similarity space. In: BMVC (1999)Google Scholar
  22. 22.
    Balasubramanian, V.N., Ye, J., Panchanathan, S.: Biased manifold embedding: a framework for person-independent head pose estimation. In: CVPR (2007)Google Scholar
  23. 23.
    BenAbdelkader, C.: Robust head pose estimation using supervised manifold learning. In: ECCV (2010)Google Scholar
  24. 24.
    Huang, D., Storer, M., la Torre, F.D., Bischof, H.: Supervised local subspace learning for continuous head pose estimation. In: CVPR (2011)Google Scholar
  25. 25.
    Liu, X., Lu, H., Li, W.: Multi-manifold modeling for head pose estimation. In: ICIP (2010)Google Scholar
  26. 26.
    Valenti, R., Sebe, N., Gevers, T.: Combining head pose and eye location information for gaze estimation. IEEE Trans. Image Process. 21(2), 802–815 (2012)MathSciNetCrossRefGoogle Scholar
  27. 27.
    Ba, S.O., Odobez, J.-M.: Multiperson visual focus of attention from head pose and meeting contextual cues. IEEE Trans. Pattern Anal. Mach. Intell. 33, 101–116 (2011)CrossRefGoogle Scholar
  28. 28.
    Nabati, M., Behrad, A.: 3d head pose estimation and camera mouse implementation using a monocular video camera. Signal Image Video Process. 6, 1–6 (2012)Google Scholar
  29. 29.
    Wilson, H.R., Wilkinson, F., Lin, L., Castillo, M.: Perception of head orientation. Vis. Res. 40(5), 459–472 (2000)CrossRefGoogle Scholar
  30. 30.
    Rowley, H.A., Baluja, S., Kanade, T.: Rotation invariant neural network-based face detection. In: CVPR (1998)Google Scholar
  31. 31.
    Luhandjula, T., Monacelli, E., Hamam, Y., van Wyk, B., Williams, Q.: Visual intention detection for wheelchair motion. In: International Symposium on Visual Computing (ISVC) pp. 407–416 (2009)Google Scholar
  32. 32.
    Vinod Pathangay, S.D., Greiner, T.: Symmetry-based face pose estimation from a single uncalibrated view. In: 8th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 1–8 (2008)Google Scholar
  33. 33.
    Ma, B., Li, A., Chai, X., Shan, S.: Head yaw estimation via symmetry of regions, In: FG, pp. 1–6 (2013)Google Scholar
  34. 34.
    Gruendig, M., Hellwich, O.: 3d head pose estimation with symmetry based illumination model in low resolution video. In: Lecture Notes in Computer Science 3175 Springer, Berlin, pp. 45–53 (2004)Google Scholar
  35. 35.
    Harguess, J., Gupta, S., Aggarwal, J.: 3d face recognition with the average-half-face. In: ICPR, pp. 1–4 (2008)Google Scholar
  36. 36.
    Hattori, K., Matsumori, S., Sato, Y.: Estimating pose of human face based on symmetry plane using range and intensity images. In: ICPR, vol. 2, pp. 1183–1187 (1998)Google Scholar
  37. 37.
    Gui, Z., Zhang, C.: 3d head pose estimation using non-rigid structure-from-motion and point correspondence. In: IEEE TENCON (2006)Google Scholar
  38. 38.
    Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: CVPR, vol. 1, pp. 511–518 (2001)Google Scholar
  39. 39.
    Coxeter, H.: Projective Geometry, ser. Fuzzy Systems and Knowledge Discovery, 2nd Revised edition. Springer, Berlin (2003)Google Scholar
  40. 40.
    Stentiford, F.: Attention based facial symmetry detection. In: Proceedings of ICAPR (2005)Google Scholar
  41. 41.
    Holmes, G., Pfahringer, B., Kirkby, R., Frank, E., Hall, M.: Multiclass alternating decision trees. In: ECML, Springer, Berlin, pp. 161–172 (2001)Google Scholar
  42. 42.
    Chen, W., Er, M.J., Wu, S.: Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain. IEEE Trans. Syst. Man Cybern. 36, 458–466 (2006)CrossRefGoogle Scholar
  43. 43.
    Morency, L.-P., Whitehill, J., Movellan, J.: Monocular head pose estimation using generalized adaptive view-based appearance model Image. Vision Comput. 28, 754–761 (2010)Google Scholar

Copyright information

© Springer-Verlag London 2014

Authors and Affiliations

  • Afifa Dahmane
    • 1
    • 2
  • Slimane Larabi
    • 1
  • Ioan Marius Bilasco
    • 2
  • Chabane Djeraba
    • 2
  1. 1.Computer Science DepartmentUSTHB UniversityAlgiersAlgeria
  2. 2.LIFL, USTLUniversity of Lille UMR CNRSLilleFrance

Personalised recommendations