Advertisement

Online Face Recognition System Based on Local Binary Patterns and Facial Landmark Tracking

  • Marko Linna
  • Juho Kannala
  • Esa Rahtu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9386)

Abstract

This paper presents a system for real-time face recognition. The system learns and recognizes faces from a video on the fly and it doesn’t need already trained database. The system consists of the following sub-methods: face detection and tracking, face alignment, key frame selection, face description and face matching. The system detects face tracks from a video, which are used in learning and recognition. Facial landmark tracking is utilized to detect changes in facial pose and expression in order to select key frames from a face track. Faces in key frames are represented using local binary patterns (LBP) histograms. These histograms are stored into the database. Nearest neighbor classifier is used in face matching. The system achieved recognition rate of 98.6% in offline test and 95.9% in online test.

Keywords

Face Recognition Recognition Rate Local Binary Pattern Face Detection Face Track 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Turk, M., Pentland, A.: Eigenfaces for Recognition. Journal of Cognitive Neuroscience 3(1), 71–86 (2006)CrossRefGoogle Scholar
  2. 2.
    Belhumeur, P.N., Hespanha, J.P., Kriegman, D.: Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(7), 711–720 (1997)CrossRefGoogle Scholar
  3. 3.
    Ahonen, T., Hadid, A., Pietikäinen, M.: Face Description with Local Binary Patterns: Application to Face Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(12), 2037–2041 (2006)CrossRefzbMATHGoogle Scholar
  4. 4.
    Gaisser, F., Rudinac, M., Jonker, P.P., Tax, D.: Online face recognition and learning for cognitive robots. In: 2013 16th International Conference on Advanced Robotics (ICAR), pp. 1–9 (2013)Google Scholar
  5. 5.
    Taigman, Y., Yang, M., Ranzato, M.A., Wolf, L.: DeepFace: closing the gap to human-level performance in face verification. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1701–1708 (2014)Google Scholar
  6. 6.
    Sun, Y., Wang, X., Tang, X.: Deeply learned face representations are sparse, selective, and robust. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2892–2900 (2015)Google Scholar
  7. 7.
    Schroff, F., Kalenichenko, D., Philbin, J.: FaceNet: a Unied embedding for face recognition and clustering. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 815–823 (2015)Google Scholar
  8. 8.
    Lu, C., Tang, X.: Surpassing human-level face verification performance on LFW with GaussianFace. In: Proc. 29th AAAI Conference on Artificial Intelligence (AAAI), pp. 3811–3819 (2015)Google Scholar
  9. 9.
    Wagner, A., Wright, J., Ganesh, A., Zhou, Z., Mobahi, H., Ma, Y.: Toward a Practical Face Recognition System: Robust Alignment and Illumination by Sparse Representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 34(2), 372–386 (2012)CrossRefGoogle Scholar
  10. 10.
    Chen, J., Kellokumpu, V., Zhao, G., Pietikäinen, M.: RLBP: Robust Local Binary Pattern. In: Proc. British Machine Vision Conference (BMVC), pp. 1–10 (2013)Google Scholar
  11. 11.
    Dantone, M., Gall, J., Fanelli, G., Van Gool, L.: Real-time facial feature detection using conditional regression forests. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2578–2585 (2012)Google Scholar
  12. 12.
    Dantone, M., Gall, J., Fanelli, G., van Gool, L.: Facial Feature Detection. http://www.dantone.me/projects-2/facial-feature-detection/
  13. 13.
    Asthana, A., Zafeiriou, S., Cheng, S., Pantic, M.: Incremental face alignment in the wild. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1859–1866 (2014)Google Scholar
  14. 14.
    Asthana, A., Zafeiriou, S.: Chehra. https://sites.google.com/site/chehrahome/home/
  15. 15.
    Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1867–1874 (2014)Google Scholar
  16. 16.
    Lee, K.C., Ho, J., Yang, M.H., Kriegman, D.: Visual Tracking and Recognition Using Probabilistic Appearance Manifolds. Computer Vision and Image Understanding 99(3), 303–331 (2005)CrossRefGoogle Scholar
  17. 17.
    Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proc. 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 511–518 (2001)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringUniversity of OuluOuluFinland

Personalised recommendations