Real-Time Face Recognition Using Local Ternary Patterns with Collaborative Representation-Based Classification for Mobile Robots

Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 302)


The ability to recognize faces is a crucial element for human-robot interaction. In this paper, we present an algorithm for mobile robots to detect, track, and recognize human faces accurately, even when humans go through different illumination conditions. We track faces using a tracker that combines the algorithm of an adaptive correlation filter with a Viola-Jones object detection. This tracker adapts to scale changes and to rotation of the face, and its occlusion. It also adapts to complex changes of background and illumination. Recognizing the tracked face is established by using an algorithm that combines local ternary patterns and collaborative representation based classification (CRC). This combination enhances the efficiency of face recognition under different illumination and noisy conditions. Our method achieves high recognition rates on challenging face databases and can run in real time on mobile robots.


Local ternary patterns Collaborative representation Face recognition Face tracking Mobile robot 


  1. 1.
    L. Zhang, M. Yang, and X. Feng, “Sparse representation or collaborative representation: Which helps face recognition?” in Proceedings of the 2011 International Conference on Computer Vision, ser. ICCV ’11. Washington, DC, USA: IEEE Computer Society, 2011, pp. 471–478.Google Scholar
  2. 2.
    J. Wright, Y. Ma, J. Mairal, G. Sapiro, T. Huang, and S. Yan, “Sparse representation for computer vision and pattern recognition,” Proceedings of the IEEE, Special Issue on Applications of Compressive Sensing and Sparse Representation, vol. 98, no. 6, pp. 1031–1044, 2010.Google Scholar
  3. 3.
    X. Tan and B. Triggs, “Enhanced local texture feature sets for face recognition under difficult lighting conditions,” IEEE Transactions on Image Processing, vol. 19, no. 6, pp. 1635–1650, 2010.Google Scholar
  4. 4.
    M. Vo-Duc and A. Zell, “Real time face tracking and pose estimation using an adaptive correlation filter for human-robot interaction,” in European Conference on Mobile Robots (ECMR 2013), Barcelona, Catalonia, Spain, September 2013.Google Scholar
  5. 5.
    Y. Zhang, K. Hornfeck, and K. Lee, “Adaptive face recognition for low-cost, embedded human-robot interaction,” in Intelligent Autonomous Systems 12, Advances in Intelligent Systems and Computing, S. Lee, H. Cho, K.-J. Yoon, and J. Lee, Eds., vol. 193. Springer, Berlin Heidelberg, 2013, pp. 863–872.Google Scholar
  6. 6.
    C. Cruz, L. Sucar, and E. Morales, “Real time face recognition for human-robot interaction,” in FG ’08. 8th IEEE International Conference on Automatic Face Gesture Recognition, 2008, pp. 1–6.Google Scholar
  7. 7.
    T. Ahonen, A. Hadid, and M. Pietikinen, “Face recognition with local binary patterns,” in Computer Vision - ECCV 2004, ser. Lecture Notes in Computer Science, T. Pajdla and J. Matas, Eds., vol. 3021. Springer, Berlin Heidelberg, 2004, pp. 469–481.Google Scholar
  8. 8.
    L. Wolf, T. Hassner, and Y. Taigman, “Descriptor based methods in the wild,” in Faces in Real-Life Images Workshop in ECCV. (2008).Google Scholar
  9. 9.
    M. Vo-Duc, A. Masselli, and A. Zell, “Real time face detection using geometric constraints, navigation and depth-based skin segmentation on mobile robots,” in 2012 IEEE International Symposium on Robotic and Sensors Environments, 2012.Google Scholar
  10. 10.
    B. A. D. David S. Bolme, J. Ross Beveridge and Y. M. Lui, “Visual object tracking using adaptive correlation filters,” in IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2010.Google Scholar
  11. 11.
    P. Viola and M. Jones, “Robust real-time object detection,” in International Journal of Computer Vision, 2001.Google Scholar
  12. 12.
    A. Martinez and R. Benavente, “The AR face database,” in CVC Technical Report 24, June 1998.Google Scholar
  13. 13.
    L. Wolf, T. Hassner, and Y. Taigman, “Similarity scores based on background samples,” in Proceedings of the 9th Asian Conference on Computer Vision - Volume Part II, ser. ACCV’09. Berlin, Heidelberg: Springer-Verlag, 2010, pp. 88–97. [Online]. Available:

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Chair of Cognitive Systems, Computer Science DepartmentUniversity of TübingenTübingenGermany

Personalised recommendations