Skip to main content

Face Fatigue Detection Method Based on MTCNN and Machine Vision

  • Conference paper
  • First Online:
International Conference on Applications and Techniques in Cyber Intelligence ATCI 2019 (ATCI 2019)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1017))

Abstract

Multi-task Cascaded Convolutional Networks (MTCNN) is a face detection method based on deep learning. Compared with the traditional parametric model and regression-based method, MTCNN is more robust to light, angle and facial expression changes in the natural environment, while machine vision as an important branch of the current artificial intelligence technology, it realizes the visual function of the human eye through a computer. By combining MTCNN with machine vision, real-time face detection can be realized. This detection method can be used for in the fields of identification, face behavior analysis, etc. it is especially suitable for the field of fatigue detection and early warning for long-term computer use. Based on this, this paper proposes a face fatigue detection method based on MTCNN and machine vision. This method combines three parameters of blink frequency, yawn frequency and drowsiness frequency, and uses fuzzy neural network to force computer users to know their fatigue in time. For office workers, it can improve their work efficiency and even prevent the occurrence of accidents. For ordinary users, it can remind them to protect their eyes and help them maintain body-health. With the promotion of this method, people can realize the danger of fatigue from the source and develop a healthy way of life and work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Yan, Z., Hu, L., Chen, H., Lu, F.: Computer vision syndrome: a widely spreading but largely unknown epidemic among computer users. Comput. Hum. Behav. 24(5), 2026–2042 (2008)

    Article  Google Scholar 

  2. Geng, L., Yuan, F., Xiao, Z., et a1.: Driver fatigue detection method based on facial behavior analysis. Comput. Eng. 44(1), 274–279 (2018). (in Chinese)

    Google Scholar 

  3. Zhang, Z., Fu, Y.: Research on fatigue early warning system based on eye movement state detection. Comput. Digit. Eng. (2), 255–258 (2016). https://doi.org/10.3969/j.issn.1672-9722.2016.02.018. (in Chinese)

  4. Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models-their training and application. Comput. Vis. Image Underst. 61(1), 38–59 (1995)

    Article  Google Scholar 

  5. Cristinacce, D., Cootes, T.: Automatic feature localisation with constrained local models. Pattern Recogn. 41(10), 3054–3067 (2008)

    Article  Google Scholar 

  6. Zhu, H., Li, Q., Li, D.: Facial multi-landmarks localization based on single convolution neural network. Comput. Sci. 45(4), 273–277, 284 (2018). https://doi.org/10.11896/j.issn.1002-137x.2018.04.046. (in Chinese)

  7. Zhang, K., Zhang, Z., Li, Z., et al.: Joint face detection and alignment using multi-task cascaded convolutional networks (2016). https://doi.org/10.1109/lsp.2016.2603342

    Article  Google Scholar 

  8. Wei, L., Wu, X.P., Zhang, Q., Zhong, Z.-N.: Improving Throughout of Continuous K-Nearest Neighbor Queries With Multi–Threaded Techniques. IEEE. 978-1-4244-4754.I/091525.00

    Google Scholar 

  9. Liu, W.-H., Qian, J.-H., Yao, Z.-W., Jiao, X.-T., Pan, J.-H.: Driver fatigue detection algorithm based on multi-facial feature fusion. Comput. Syst. Appl. 27(10), 177–182 (2018). (in Chinese)

    Google Scholar 

  10. Zhou, F.: Research on facial feature point tracking method. Xidian University (2015). (in Chinese)

    Google Scholar 

  11. Li, L.: Research and Implementation of Face Tracking Method Based on Detection in Video. Chongqing University of Posts and Telecommunications (2009). https://doi.org/10.7666/d.y1824828. (in Chinese)

  12. Liu, X., Fang, Z., Liu, X., Gao, Y., Zhang, X.: Driver fatigue detection system based on states of eyes and mouth. Transducer Microsyst. Technol. 37(10), 108–110 (2018). (in Chinese)

    Google Scholar 

  13. Li, Z., He, R., He, C.: Application of fuzzy neural network in driver fatigue detection. J. Jiangsu Univ. (Nat. Sci. Edn.) (02), 123–126 (2008). (in Chinese)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jun Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Shi, W., Li, J., Yang, Y. (2020). Face Fatigue Detection Method Based on MTCNN and Machine Vision. In: Abawajy, J., Choo, KK., Islam, R., Xu, Z., Atiquzzaman, M. (eds) International Conference on Applications and Techniques in Cyber Intelligence ATCI 2019. ATCI 2019. Advances in Intelligent Systems and Computing, vol 1017. Springer, Cham. https://doi.org/10.1007/978-3-030-25128-4_31

Download citation

Publish with us

Policies and ethics