Skip to main content
SpringerLink
Log in

Design and implementation of liveness detection system based on improved shufflenet V2

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Face recognition is a prevalent identity verification method, but it requires a liveness detection system to guard against face fraud from printed images and mobile phone photographs. It is challenging to guarantee low complexity and high accuracy of the face anti-spoofing model applied on the Android development board at the same time in existing research. On the Android development board, we construct a liveness detection system that is resistant to attacks from printed images and photographs of electronic devices such as tablets. In conjunction with the actual circumstance, we create a lightweight liveness detection algorithm based on near-infrared images. We utilize MTCNN to clip the near-infrared images in order to preserve the facial portions and reduce the calculated cost. After applying Gamma correction to weaken the impact of illumination on the faces, the facial images are subsequently incorporated into the enhanced ShuffleNet V2 model based on the MBConv and squeeze-excitation (SE) modules for secondary classification. We evaluate the performance of the enhanced model on the CBSR NIR Face Dataset, CASIA NIR-VIS 2.0 Face Database and Oulu-CASIA, achieving 98.50%, 99.87% and 100% accuracy, which is superior to the performance of the original ShuffleNet V2 model and state-of-the-art methods. Our model’s FLOPs and Params are 0.28 G and 2.17 M, respectively. Meanwhile, the liveness detection system based on Android has an exceptionally high level of security performance

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Zhang, Z., Yan, J., Liu, S., Lei, Z., Yi, D., Li, S.: A face antispoofing database with diverse attacks. Paper presented at the 2012 5th IAPR International Conference on Biometrics, New Delhi, India, 29 March–01 April 2012 (2012)

  2. Zhang, Y., Yin, Z., Yin, G., Yan, J., Shao, J., Liu, Z.: Celeba-spoof: large-scale face anti-spoofing dataset with rich annotations. Paper presented at the 16th European Conference on Computer Vision, Glasgow, UK, 23–28 August 2020 (2020)

  3. Wu, X., Zhou, J., Liu, J., Ni, F., Fan, H.: Single-shot face antispoofing for dual pixel camera. IEEE Trans. Inf. Forensics Secur. 16, 1440–1451 (2021)

    Article  Google Scholar 

  4. Boulkenafet, Z., Komulainen, J., Hadid, A.: Face anti-spoofing based on color texture analysis. Paper presented at the IEEE International Conference on Image Processing, Quebec City, Canada, 27–30 September 2015 (2015)

  5. Boulkenafet, Z., Komulainen, J., Hadid, A.: Face antispoofing using speeded-up robust features and fisher vector encoding. IEEE Signal Process. Lett. 24(2), 141–145 (2017)

    Google Scholar 

  6. Xu, Y., Wu, L., Liu, Y., Wang, Z.: Embedding fast temporal information model to improve face anti-spoofing. Paper presented at the 15th Chinese Conference on Biometric Recognition, Shanghai, China, 10–12 September 2021 (2021)

  7. Ma, N., Zhang, X., Zheng, H., Sun, J.: ShuffleNet V2: practical guidelines for efficient CNN architecture design. Paper presented at the 15th European Conference on Computer Vision, Munich, Germany, 08–14 September 2018 (2018)

  8. Tan, M., Le, Q.V.: EfficientNet: rethinking model scaling for convolutional neural networks. Paper presented at the 36th International Conference on Machine Learning, Long Beach, CA, 09–15 June 2019 (2019)

  9. Woo, S., Park, J., Lee, J.Y., Kweon, I.S.: Cbam: Convolutional block attention module. Paper presented at the 15th European Conference on Computer Vision, Munich, Germany, 08–14 September 2018 (2018)

  10. Zhang, K., Zhang, Z., Li, Z., Qiao, Y.: Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process. Lett. 23(10), 1499–1503 (2016)

    Article  Google Scholar 

  11. Wen, D., Han, H., Jain, A.: Face spoof detection with image distortion analysis. IEEE Trans. Inf. Forensics Secur. 10(4), 746–761 (2015)

    Article  Google Scholar 

  12. Komulainen, J., Hadid, A., Pietikäinen, M.: Context based face anti-spoofing. Paper presented at the IEEE 6th International Conference on Biometrics - Theory, Applications and Systems, Washington, DC, 29 Sept–02 Oct 2013 (2013)

  13. Peixoto, B., Michelassi, C., Rocha, A.: Face liveness detection under bad illumination conditions. Paper presented at the 18th IEEE International Conference on Image Processing, Brussels, Belgium, 11–14 Sept 2011 (2011)

  14. Liu, W., Wei, X., Lei, T., Wang, X., Meng, H., Nandi, A.K.: Data-fusion-based two-stage cascade framework for multimodality face anti-spoofing. IEEE Trans. Cognitive Develop. Syst. 14(2), 672–683 (2022)

    Article  Google Scholar 

  15. Wu, H., Zeng, D., Hu, Y., Shi, H., Mei, T.: Dual spoof disentanglement generation for face anti-spoofing with depth uncertainty learning. IEEE Trans. Circuits Syst. Video Technol. 32(7), 4626–4638 (2022)

    Article  Google Scholar 

  16. Qin, Y., Yu, Z., Yan, L., Wang, Z., Zhao, C., Lei, Z.: Meta-teacher for face anti-spoofing. IEEE Trans. Pattern Anal. Mach. Intell. 44(10), 6311–6326 (2022)

    Article  Google Scholar 

  17. Wang, W., Wen, F., Zheng, H., Ying, R., Liu, P.: Conv-mlp: a convolution and mlp mixed model for multimodal face anti-spoofing. IEEE Trans. Inf. Forensics Secur. 17, 2284–2297 (2022)

    Article  Google Scholar 

  18. Yan, W., Zeng, Y., Hu, H.: Domain adversarial disentanglement network with cross-domain synthesis for generalized face anti-spoofing. IEEE Trans. Circuits Syst. Video Technol. 32(10), 7033–7046 (2022)

    Article  Google Scholar 

  19. Liu, Y., Liu, X.: Spoof trace disentanglement for generic face anti-spoofing. IEEE Trans, Pattern Analys Machine Intell (2022)

    Book  Google Scholar 

  20. Lin, J.D., Lin, H.H., Dy, J., Chen, J.C., Tanveer, M., Razzak, I., Hua, K.L.: Lightweight face anti-spoofing network for telehealth applications. IEEE J. Biomed. Health Inform. 26(5), 1987–1996 (2021)

    Article  Google Scholar 

  21. He, D., He, X., Yuan, R., Li, Y., Shen, C.: Lightweight network-based multi-modal feature fusion for face anti-spoofing. Vis. Comput., 1–13 (2022)

  22. Hu, J., Shen, L., Albanie, S., Sun, G., Wu, E.: Squeeze-and-excitation networks. IEEE Trans. Pattern Anal. Mach. Intell. 42(8), 2011–2023 (2020)

    Article  Google Scholar 

  23. Li, S., Chu, R., Liao, S., Zhang, L.: Illumination invariant face recognition using near-infrared images. IEEE Trans. Pattern Anal. Mach. Intell. 29(4), 627–639 (2007)

    Article  Google Scholar 

  24. Li, S., Yi, D., Lei, Z., Liao, S.: The CASIA NIR-VIS 2.0 face database. Paper presented at the 26th IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, 23–28 June 2013 (2013)

  25. Zhao, G., Huang, X., Taini, M., Li, S.Z., PietikäInen, M.: Facial expression recognition from near-infrared videos. Image Vis. Comput. 29(9), 607–619 (2011)

    Article  Google Scholar 

  26. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. Comput, Sci (2014)

    Google Scholar 

  27. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. Paper presented at the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 27–30 June 2016 (2016)

  28. Szegedy, C., Ioffe, S., Vanhoucke, V., Alemi, A.A.: Inception-v4, Inception-ResNet and the impact of residual connections on learning. Paper presented at the 31st AAAI Conference on Artificial Intelligence, San Francisco, CA, 04–09 Feb 2017 (2017)

Download references

Funding

This work was supported by Science and Technology Planning Project of Guangdong Province under the grant 2018B010108001 and Key-Area Research and Development Program of Foshan City under the grant 2020001006812 and GuangDong Basic and Applied Basic Research Foundation under Grant 2022A1515110119.

Author information

Authors and Affiliations

  1. School of Automation Science and Engineering, South China University of Technology, Guangzhou, 510641, China

    Yongxing Zhang & Wei Xie

  2. Guangdong Provincial Key Laboratory of Technique and Equipment for Macromolecular Advanced Manufacturing, South China University of Technology, Guangzhou, 510640, China

    Wei Xie

  3. School of Physics and Telecommunication Engineering, South China Normal University, Guangzhou, 510006, China

    Xiaoyuan Yu

Authors
  1. Yongxing Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wei Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaoyuan Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wei Xie.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, Y., Xie, W. & Yu, X. Design and implementation of liveness detection system based on improved shufflenet V2. SIViP 17, 3035–3043 (2023). https://doi.org/10.1007/s11760-023-02524-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-023-02524-z

Keywords

Search

Navigation