Skip to main content
SpringerLink
Log in

Head pose estimation based on face symmetry analysis

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

This paper addresses the problem of head pose estimation in order to infer non-intrusive feedback from users about gaze attention. The proposed approach exploits the bilateral symmetry of the face. Size and orientation of the symmetrical area of the face is used to estimate roll and yaw poses by the mean of decision tree model. The approach does not need the location of interest points on face and presents robustness to partial occlusions. Tests were performed on different datasets (FacePix, CMU PIE, Boston University) and our approach coped with variability in illumination and expressions. Results demonstrate that the changes in the size of the regions that contain a bilateral symmetry provide accurate pose estimation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Murphy-Chutorian, E., Trivedi, M.M.: Head pose estimation in computer vision: a survey. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 31(4), 607–626 (2009)

    Article  Google Scholar 

  2. Black, J., Gargesha, M., Kahol, K., Kuchi, P., Panchanathan, S.: A framework for performance evaluation of face recognition algorithms. In: ITCOM, Internet Multimedia Systems II, Boston (2002)

  3. Sim, T., Baker, S., Bsat, M.: The cmu pose, illumination, and expression database. IEEE Trans. Pattern Anal. Mach. Intell. 25(12), 1615–1618 (2003)

    Article  Google Scholar 

  4. Valenti, R., Gevers, T.: Robustifying eye center localization by head pose cues. In: CVPR (2009)

  5. Wang, J.-G., Sung, E.: Em enhancement of 3d head pose estimated by point at infinity. Image Vis. Comput. 25(12), 1864–1874 (2007)

    Article  Google Scholar 

  6. Pan, Y., Zhu, H., Ji, R.: 3-D Head Pose Estimation for Monocular Image. ser. Fuzzy Systems and Knowledge Discovery. Springer, Berlin (2005)

  7. Baker, S., Matthews, I., Xiao, J., Gross, R., Kanade, T., Ishikawa, T.: Real-time non-rigid driver head tracking for driver mental state estimation. In: 11th World Congress on Intelligent Transportation Systems (2004)

  8. Caunce, A., Taylor, C.J., Cootes, T.F.: Improved 3d model search for facial feature location and pose estimation in 2d images. In: BMVC (2010)

  9. Huang, J., Shao, X., Wechsler, H.: Face pose discrimination using support vector machines (svm). In: ICPR (1998)

  10. Dahmane, M., Meunier, J.: Object representation based on gabor wave vector binning: an application to human head pose detection. In: ICCV (2011)

  11. Chamveha, I., Sugano, Y., Sugimura, D., Siriteerakul, T., Okabe, T., Sato, Y., Sugimoto, A.: Appearance-based head pose estimation with scene-specific adaptation. In: ICCV (2011)

  12. Li, S., Fu, Q., Gu, L., Scholkopf, B., Cheng, Y., Zhang, H.: Kernel machine based learning for multi-view face detection and pose estimation. In: ICCV, vol. 2, pp. 674–679 (2001)

  13. Benfold, B., Reid, I.: Colour invariant head pose classification in low resolution video. In: BMVC (2008)

  14. Zhang, Z., Hu, Y., Liu, M., Huang, T.: Head pose estimation in seminar room using multi view face detectors. Multimodal Technol Percept. Hum. 4122, 299–304 (2007)

    Article  Google Scholar 

  15. Ji, H., Liu, R., Su, F., Su, Z., Tian, Y.: Robust head pose estimation via convex regularized sparse regression. In: ICIP (2011)

  16. Ranganathan, A., Yang, M.-H.: Online sparse matrix gaussian process regression and vision applications. In: ECCV (2008)

  17. Murad Al Haj, J.G., Davis, L.S.: On partial least squares in head pose estimation: how to simultaneously deal with misalignment. In: CVPR (2012)

  18. Murphy-Chutorian, E., Doshi, A., Trivedi, M.: Head pose estimation for driver assistance systems: a robust algorithm and experimental evaluation. In: Intelligent Transportation Systems Conference, ITSC. IEEE, pp. 709–714 (2007)

  19. li Tian, Y., Brown, L., Connell, J., Pankanti, S., Hampapur, A., Senior, A., Bolle, R.: Absolute head pose estimation from overhead wide-angle cameras. In: IEEE International Workshop on Analysis and Modeling of Faces and Gestures (2003)

  20. Beymer, D.J.: Face recognition under varying pose. In: CVPR, pp. 756–761 (1994)

  21. Jamie Sherrah, S.G., Ong, E.-J.: Understanding pose discrimination in similarity space. In: BMVC (1999)

  22. Balasubramanian, V.N., Ye, J., Panchanathan, S.: Biased manifold embedding: a framework for person-independent head pose estimation. In: CVPR (2007)

  23. BenAbdelkader, C.: Robust head pose estimation using supervised manifold learning. In: ECCV (2010)

  24. Huang, D., Storer, M., la Torre, F.D., Bischof, H.: Supervised local subspace learning for continuous head pose estimation. In: CVPR (2011)

  25. Liu, X., Lu, H., Li, W.: Multi-manifold modeling for head pose estimation. In: ICIP (2010)

  26. Valenti, R., Sebe, N., Gevers, T.: Combining head pose and eye location information for gaze estimation. IEEE Trans. Image Process. 21(2), 802–815 (2012)

    Article  MathSciNet  Google Scholar 

  27. Ba, S.O., Odobez, J.-M.: Multiperson visual focus of attention from head pose and meeting contextual cues. IEEE Trans. Pattern Anal. Mach. Intell. 33, 101–116 (2011)

    Article  Google Scholar 

  28. Nabati, M., Behrad, A.: 3d head pose estimation and camera mouse implementation using a monocular video camera. Signal Image Video Process. 6, 1–6 (2012)

  29. Wilson, H.R., Wilkinson, F., Lin, L., Castillo, M.: Perception of head orientation. Vis. Res. 40(5), 459–472 (2000)

    Article  Google Scholar 

  30. Rowley, H.A., Baluja, S., Kanade, T.: Rotation invariant neural network-based face detection. In: CVPR (1998)

  31. Luhandjula, T., Monacelli, E., Hamam, Y., van Wyk, B., Williams, Q.: Visual intention detection for wheelchair motion. In: International Symposium on Visual Computing (ISVC) pp. 407–416 (2009)

  32. Vinod Pathangay, S.D., Greiner, T.: Symmetry-based face pose estimation from a single uncalibrated view. In: 8th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 1–8 (2008)

  33. Ma, B., Li, A., Chai, X., Shan, S.: Head yaw estimation via symmetry of regions, In: FG, pp. 1–6 (2013)

  34. Gruendig, M., Hellwich, O.: 3d head pose estimation with symmetry based illumination model in low resolution video. In: Lecture Notes in Computer Science 3175 Springer, Berlin, pp. 45–53 (2004)

  35. Harguess, J., Gupta, S., Aggarwal, J.: 3d face recognition with the average-half-face. In: ICPR, pp. 1–4 (2008)

  36. Hattori, K., Matsumori, S., Sato, Y.: Estimating pose of human face based on symmetry plane using range and intensity images. In: ICPR, vol. 2, pp. 1183–1187 (1998)

  37. Gui, Z., Zhang, C.: 3d head pose estimation using non-rigid structure-from-motion and point correspondence. In: IEEE TENCON (2006)

  38. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: CVPR, vol. 1, pp. 511–518 (2001)

  39. Coxeter, H.: Projective Geometry, ser. Fuzzy Systems and Knowledge Discovery, 2nd Revised edition. Springer, Berlin (2003)

  40. Stentiford, F.: Attention based facial symmetry detection. In: Proceedings of ICAPR (2005)

  41. Holmes, G., Pfahringer, B., Kirkby, R., Frank, E., Hall, M.: Multiclass alternating decision trees. In: ECML, Springer, Berlin, pp. 161–172 (2001)

  42. Chen, W., Er, M.J., Wu, S.: Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain. IEEE Trans. Syst. Man Cybern. 36, 458–466 (2006)

    Article  Google Scholar 

  43. Morency, L.-P., Whitehill, J., Movellan, J.: Monocular head pose estimation using generalized adaptive view-based appearance model Image. Vision Comput. 28, 754–761 (2010)

Download references

Acknowledgments

This work was conducted in the context of the ITEA2 “Empathic Products” project, ITEA2 1105, and is supported by funding from DGCIS, France.

Author information

Authors and Affiliations

  1. Computer Science Department, USTHB University, Algiers, Algeria

    Afifa Dahmane & Slimane Larabi

  2. LIFL, USTL, University of Lille UMR CNRS, 8022, Lille, France

    Afifa Dahmane, Ioan Marius Bilasco & Chabane Djeraba

Authors
  1. Afifa Dahmane
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Slimane Larabi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ioan Marius Bilasco
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chabane Djeraba
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Afifa Dahmane.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dahmane, A., Larabi, S., Bilasco, I.M. et al. Head pose estimation based on face symmetry analysis. SIViP 9, 1871–1880 (2015). https://doi.org/10.1007/s11760-014-0676-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-014-0676-x

Keywords

Search

Navigation