Abstract
Face recognition systems are one of the fastest, accurate and most accessible biometric modalities. These systems are widely used in a variety of applications such as ID verification in phones, surveillance, border control and security checks in payment methods. However, these face recognition systems are prone to major security threats due to different types of spoof attacks (presentation attacks). To address this issue, we propose a multi-stream CNN based architecture for analyzing different color spaces of face images. Different color spaces help us to discriminate between real and spoof images. In order to consider local information, we consider analyzing patches instead of the entire image. We evaluate our architecture on different benchmark databases such as CASIA-FASD, MSU-USSA, and REPLAY-ATTACK to see its efficiency as compared to other approaches.
Keywords
- Face anti-spoofing
- Biometric authentication
- Presentation attacks
- Multi-stream CNN
- Deep learning
This is a preview of subscription content, access via your institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Atoum, Y., Liu, Y., Jourabloo, A., Liu, X.: Face anti-spoofing using patch and depth-based cnns. In: 2017 IEEE International Joint Conference on Biometrics (IJCB), pp. 319–328. IEEE (2017)
Bao, W., Li, H., Li, N., Jiang, W.: A liveness detection method for face recognition based on optical flow field. In: 2009 International Conference on Image Analysis and Signal Processing, pp. 233–236. IEEE (2009)
Boulkenafet, Z., Komulainen, J., Hadid, A.: Face antispoofing using speeded-up robust features and fisher vector encoding. IEEE Signal Process. Lett. 24(2), 141–145 (2016)
Boulkenafet, Z., Komulainen, J., Li, L., Feng, X., Hadid, A.: OULU-NPU: a mobile face presentation attack database with real-world variations. In: 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), pp. 612–618. IEEE (2017)
Chingovska, I., Anjos, A., Marcel, S.: On the effectiveness of local binary patterns in face anti-spoofing. In: 2012 BIOSIG-Proceedings of the International Conference of Biometrics Special Interest Group (BIOSIG), pp. 1–7. IEEE (2012)
Chingovska, I., Anjos, A., Marcel, S.: On the effectiveness of local binary patterns in face anti-spoofing (2012)
Cuimei, L., Zhiliang, Q., Nan, J., Jianhua, W.: Human face detection algorithm via haar cascade classifier combined with three additional classifiers. In: 2017 13th IEEE International Conference on Electronic Measurement & Instruments (ICEMI), pp. 483–487. IEEE (2017)
Dhamecha, T.I., Nigam, A., Singh, R., Vatsa, M.: Disguise detection and face recognition in visible and thermal spectrums. In: 2013 International Conference on Biometrics (ICB), pp. 1–8. IEEE (2013)
Feng, W., Zhou, J., Dan, C., Peiyan, Z., Li, Z.: Research on mobile commerce payment management based on the face biometric authentication. Int. J. Mob. Commun. 15(3), 278–305 (2017)
de Freitas Pereira, T., Anjos, A., De Martino, J.M., Marcel, S.: LBP - TOP based countermeasure against face spoofing attacks. In: Park, J.-I., Kim, J. (eds.) ACCV 2012. LNCS, vol. 7728, pp. 121–132. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-37410-4_11
Gan, J., Li, S., Zhai, Y., Liu, C.: 3d convolutional neural network based on face anti-spoofing. In: 2017 2nd International Conference on Multimedia and Image Processing (ICMIP), pp. 1–5. IEEE (2017)
Kose, N., Dugelay, J.L.: Reflectance analysis based countermeasure technique to detect face mask attacks. In: 2013 18th International Conference on Digital Signal Processing (DSP), pp. 1–6. IEEE (2013)
Li, H., He, P., Wang, S., Rocha, A., Jiang, X., Kot, A.C.: Learning generalized deep feature representation for face anti-spoofing. IEEE Trans. Inf. Foren. Security 13(10), 2639–2652 (2018)
Li, L., Feng, X., Boulkenafet, Z., Xia, Z., Li, M., Hadid, A.: An original face anti-spoofing approach using partial convolutional neural network. In: 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA), pp. 1–6. IEEE (2016)
Lin, W.H., Wang, P., Tsai, C.F.: Face recognition using support vector model classifier for user authentication. Electronic Commerce Res. Appl. 18, 71–82 (2016)
Lucena, O., Junior, A., Moia, V., Souza, R., Valle, E., Lotufo, R.: Transfer learning using convolutional neural networks for face anti-spoofing. In: Karray, F., Campilho, A., Cheriet, F. (eds.) ICIAR 2017. LNCS, vol. 10317, pp. 27–34. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59876-5_4
Määttä, J., Hadid, A., Pietikäinen, M.: Face spoofing detection from single images using texture and local shape analysis. IET Biometrics 1(1), 3–10 (2012)
Pan, G., Sun, L., Wu, Z., Lao, S.: Eyeblink-based anti-spoofing in face recognition from a generic webcamera. In: 2007 IEEE 11th International Conference on Computer Vision, pp. 1–8. IEEE (2007)
Patel, K., Han, H., Jain, A.: Secure Face Unlock: Spoof Detection on Smartphones. IEEE Trans. Inf. Forensic and Security 20(20), 30 (2016)
Pham, V.H., Tran, D.P., Hoang, V.D.: Personal identification based on deep learning technique using facial images for intelligent surveillance systems. Int. J. Mach. Learn. Comput. 9(4), 465–470 (2019)
Raghavendra, R., Busch, C.: Improved face recognition by combining information from multiple cameras in automatic border control system. In: 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1–6. IEEE (2015)
Raghavendra, R., Raja, K.B., Venkatesh, S., Busch, C.: Extended multispectral face presentation attack detection: an approach based on fusing information from individual spectral bands. In: 2017 20th International Conference on Information Fusion (Fusion), pp. 1–6. IEEE (2017)
del Rio, J.S., Moctezuma, D., Conde, C., de Diego, I.M., Cabello, E.: Automated border control e-gates and facial recognition systems. Computers & Security 62, 49–72 (2016)
Shaik, K.B., Ganesan, P., Kalist, V., Sathish, B., Jenitha, J.M.M.: Comparative study of skin color detection and segmentation in HSV and YCBCR color space. Procedia Comput. Sci. 57(12), 41–48 (2015)
Shao, R., Lan, X., Yuen, P.C.: Deep convolutional dynamic texture learning with adaptive channel-discriminability for 3d mask face anti-spoofing. In: 2017 IEEE International Joint Conference on Biometrics (IJCB), pp. 748–755. IEEE (2017)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Tan, X., Li, Y., Liu, J., Jiang, L.: Face liveness detection from a single image with sparse low rank bilinear discriminative model. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6316, pp. 504–517. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15567-3_37
Wen, D., Han, H., Jain, A.K.: Face spoof detection with image distortion analysis. IEEE Trans. Inf. Forensics and Security 10(4), 746–761 (2015)
Wheeler, F.W., Weiss, R.L., Tu, P.H.: Face recognition at a distance system for surveillance applications. In: 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS), pp. 1–8. IEEE (2010)
Xu, Z., Li, S., Deng, W.: Learning temporal features using LSTM-CNN architecture for face anti-spoofing. In: 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), pp. 141–145. IEEE (2015)
Yang, J., Lei, Z., Li, S.Z.: Learn convolutional neural network for face anti-spoofing. arXiv preprint arXiv:1408.5601 (2014)
Zhang, Z., Yan, J., Liu, S., Lei, Z., Yi, D., Li, S.Z.: A face antispoofing database with diverse attacks. In: 2012 5th IAPR International Conference on Biometrics (ICB), pp. 26–31. IEEE (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Mhasakar, P., Mandal, S., Mitra, S.K. (2021). Multi-stream CNN for Face Anti-spoofing Using Color Space Analysis. In: Singh, S.K., Roy, P., Raman, B., Nagabhushan, P. (eds) Computer Vision and Image Processing. CVIP 2020. Communications in Computer and Information Science, vol 1376. Springer, Singapore. https://doi.org/10.1007/978-981-16-1086-8_18
Download citation
DOI: https://doi.org/10.1007/978-981-16-1086-8_18
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-1085-1
Online ISBN: 978-981-16-1086-8
eBook Packages: Computer ScienceComputer Science (R0)