Skip to main content
Book cover

Securing Social Identity in Mobile Platforms pp 129–143Cite as

Unconstrained Face Recognition Using Cell Phone Devices: Faces in the Wild

  • 411 Accesses

Part of the Advanced Sciences and Technologies for Security Applications book series (ASTSA)

Abstract

The ever growing field of face recognition is constantly expanding to tackle new and more challenging, problems as the advances in algorithms yield higher accuracy results. The most recent advances have opened up the possibility of conducting high accuracy face recognition on faces from completely uncontrolled sources, such as search engines, social-media, and other online sources. Conducting face recognition in this area is usually deemed as faces-in-the-wild, given the unbounded nature in which faces are collected. While performing face recognition on faces-in-the-wild datasets has many advantages, it can make it difficult to determine the limitations of the face recognition algorithm in terms of the scenarios in which the faces were collected. In this work, we will collect a simulated faces-in-the-wild dataset using four cell phones (common sources for faces-in-the-wild) in varying scenarios (distance, lighting, background, etc.) to fully demonstrate the capability of newly proposed deep learning based methods of face recognition. Furthermore, we will contrast this with previous, standard, methods of face recognition in the same scenarios to see how recent improvements in the filed have opened up new capabilities.

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-39489-9_7
  • Chapter length: 15 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   129.00
Price excludes VAT (USA)
  • ISBN: 978-3-030-39489-9
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   169.99
Price excludes VAT (USA)
Hardcover Book
USD   169.99
Price excludes VAT (USA)
Learn about institutional subscriptions
Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Notes

  1. 1.

    OpenCV: https://opencv.org/

References

  1. Aghajanian J, Prince S (2009) Face pose estimation in uncontrolled environments. In: BMVC, vol 1, p 3

    Google Scholar 

  2. Aghajanian J, Prince SJD (2009) Face pose estimation in uncontrolled environments. In: In BMVC

    Google Scholar 

  3. Freund Y, Schapire RE, et al (1996) Experiments with a new boosting algorithm. In: ICML, vol 96, pp 148–156

    Google Scholar 

  4. Fukushima K (1980) Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol Cybernetics 36:193–202. https://doi.org/10.1007/BF00344251

    CrossRef  Google Scholar 

  5. Hadid A, Heikkilä JY, Silvén O, Pietikäinen M (2007) Face and eye detection for person authentication in mobile phones. In: ICDSC, pp 101–108

    Google Scholar 

  6. Jain AK, Li SZ (2011) Handbook of face recognition. Springer, Berlin

    MATH  Google Scholar 

  7. Learned-Miller E, Huang GB, RoyChowdhury A, Li H, Hua G (2016) Labeled faces in the wild: a survey. In: Advances in face detection and facial image analysis. Springer, Cham, pp 189–248

    Google Scholar 

  8. Liu Z, Luo P, Wang X, Tang X (2015) Deep learning face attributes in the wild. In: Proceedings of international conference on computer vision (ICCV)

    Google Scholar 

  9. Narang N, Martin M, Metaxas D, Bourlai T (2017) Learning deep features for hierarchical classification of mobile phone face datasets in heterogeneous environments. In: 2017 12th IEEE international conference on automatic face & gesture recognition (FG 2017). IEEE, pp 186–193

    Google Scholar 

  10. Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987

    CrossRef  Google Scholar 

  11. Robertson DJ, Kramer RS, Burton AM (2015) Face averages enhance user recognition for smartphone security. PloS One 10(3):e0119460

    CrossRef  Google Scholar 

  12. Rose J, Bourlai T (2019) Facial attribute estimation of mobile phone face data to aid in biometric systems. IEEE ASONAM (SNAST)

    Google Scholar 

  13. Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117

    CrossRef  Google Scholar 

  14. Schroff F, Kalenichenko D, Philbin J (2015) Facenet: a unified embedding for face recognition and clustering. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 815–823

    Google Scholar 

  15. Statista (2016) Number of mobile phone users worldwide from 2015 to 2020. https://www.statista.com/statistics/274774/forecast-of-mobile-phone-users-worldwide/

  16. Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, Inception-Resnet and the impact of residual connections on learning. In: AAAI, vol 4, p 12

    Google Scholar 

  17. Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Computer vision and pattern recognition, 2001 (CVPR 2001). IEEE computer society conference on proceedings of the 2001, vol 1. IEEE, p I

    Google Scholar 

  18. Wang L, Bourlai T, Dimitris M (2019) A coupled encoder- decoder network for joint face detection and landmark localization. IMAVIS 87(3):37–46

    Google Scholar 

  19. Wang L, Yu X, Bourlai T, Metaxas DN (2018) A coupled encoder-decoder network for joint face detection and landmark localization. Image Vis Comput 87:37–46

    CrossRef  Google Scholar 

  20. Yi D, Lei Z, Liao S, Li SZ (2014) Learning face representation from scratch. arXiv preprint arXiv:1411.7923

    Google Scholar 

  21. Yuan JH, Zhu HD, Gan Y, Shang L (2014) Enhanced local ternary pattern for texture classification. In: Huang DS, Bevilacqua V, Premaratne P (eds) Intelligent computing theory. Springer International Publishing, Cham, pp 443–448

    CrossRef  Google Scholar 

  22. Zhang K, Zhang Z, Li Z, Qiao Y (2016) Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process Lett 23(10):1499–1503

    CrossRef  Google Scholar 

Download references

Acknowledgements

This research was supported in part by the Department of Homeland Security (DHS) and was conducted with the assistance of Dr. Neeru Narang.

Author information

Authors and Affiliations

  1. West Virginia University, Morgantown, WV, USA

    Michael Martin

  2. Lane Department of Computer Science and Electrical Engineering, Multispectral Imagery Lab (MILab), West Virginia University, Morgantown, WV, USA

    Thirimachos Bourlai

Authors
  1. Michael Martin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Thirimachos Bourlai
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Thirimachos Bourlai .

Editor information

Editors and Affiliations

  1. Lane Department of Computer Science and Electrical Engineering Multispectral Imagery Lab (MILab), West Virginia University, Morgantown, WV, USA

    Prof. Thirimachos Bourlai

  2. Department of Informatics and Computers, Hellenic Air Force Academy, Acharnes Attica, Greece

    Prof. Panagiotis Karampelas

  3. Department of Electrical Engineering, Johns Hopkins University, Baltimore, MD, USA

    Dr. Vishal M. Patel

Rights and permissions

Reprints and Permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Verify currency and authenticity via CrossMark

Cite this chapter

Martin, M., Bourlai, T. (2020). Unconstrained Face Recognition Using Cell Phone Devices: Faces in the Wild. In: Bourlai, T., Karampelas, P., Patel, V.M. (eds) Securing Social Identity in Mobile Platforms. Advanced Sciences and Technologies for Security Applications. Springer, Cham. https://doi.org/10.1007/978-3-030-39489-9_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-39489-9_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-39488-2

  • Online ISBN: 978-3-030-39489-9

  • eBook Packages: Computer ScienceComputer Science (R0)