Skip to main content

Non-contact Physiological Parameters Detection Based on MTCNN and EVM

  • Conference paper
  • First Online:
Cognitive Systems and Signal Processing (ICCSIP 2020)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1397))

Included in the following conference series:

Abstract

Non-contact physiological parameters detection has become an important but challenging task. This paper proposes a novel framework for Non-contact physiological parameters detection, which is based on MTCNN (Multi-task convolutional neural network) and EVM (Eulerian Video Magnification). The MTCNN is applied to compensate negative effects of the pseudo motion for improving the efficiency of face detection. The Laplacian pyramid of EVM is added to our framework to perform motion amplification to achieve simultaneous extraction of heart rate and respiration rate, which improves the accuracy of non-contact physiological parameter detection. Then we use FFT to analyze the relevant frequency bands in time domain and calculate the heart rate and breathing rate. In order to improve efficiency, GPU acceleration is implemented under the TensorRT framework. The experimental results based on data sets DUSS (detection under slight shaking) and DUO (detection under occlusion) show the effectiveness of this method. The average error of the heart rate and respiration rate are −0.1 and 0.6, respectively. Our method achieves comparable performance to finger clip oximeter with a good consistency, even in the case of wearing a mask.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Wang, J., Xue, H., Lu, H., et al.: Non-contact physiological signal detection technology. China Med. Equip. 11, 5–8 (2013)

    Google Scholar 

  2. Liu, Y.: Non-contact heart rate and respiratory rate detection based on FastICA algorithm. Nanchang University, Nanchang (2015)

    Google Scholar 

  3. Liu, H., Wang, X., Chen, G.: Non-contact fetal heart rate detection. Comput. Syst. Appl. 28(8), 204–209 (2019)

    Article  Google Scholar 

  4. Su, P., Liang, X., Liang, Y.: Non-contact heart rate measurement method based on Euler image magnification. J. Comput. Appl. 35(3), 916–922 (2018)

    Google Scholar 

  5. Li, J.: Research on pulse wave extraction method based on video amplification. Hefei University of Technology, Hefei (2019)

    Google Scholar 

  6. Ma, L.: Research on non-contact physiological parameter detection technology based on ordinary camera. Shandong University, Shandong (2017)

    Google Scholar 

  7. Deng, Q.: Research and implementation of heart rate detection based on face video images. Wuhan University of Technology, Wuhan (2017)

    Google Scholar 

  8. Hui, P.: Research on non-contact heart rate measurement method based on face image. Southeast University, Nanjing (2017)

    Google Scholar 

  9. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of CVPR, vol. 1, pp. 511 (2001)

    Google Scholar 

  10. Liu, X., Cui, H., Liu, Z., et al.: Human body sign detection based on Doppler radar sensor. Sens. Microsyst. 2020(39), 137–139 (2020)

    Google Scholar 

  11. Cui, C., Zhao, Q.: Design of vital signs detection system based on micro-Doppler Radar. Control Eng. 26, 105–107 (2019)

    Google Scholar 

  12. Zhou, Y., Pang, L., Zhang, H., et al.: Experimental research on non-contact life detection based on bio-radar technology. Sci. Technol. Vis. 181–182

    Google Scholar 

  13. Zhang, Y., Lu, H., Liang, F., et al.: Current status and application prospects of non-contact battlefield injury detection technology. Med. Med. Equip. 40(07), 99–103 (2019)

    Google Scholar 

  14. Cai, S., Men, X., Wang, S., et al.: Research on rapid and accurate measurement of temperature in dense populations during the epidemic of new coronavirus pneumonia. West China Med. 35, 385–390 (2020)

    Google Scholar 

  15. Ge, Z.: Research on medical infrared thermometer and its key technology. Changchun University of Science and Technology, Changchun (2019)

    Google Scholar 

  16. Ku, H., Dong, W.: Face recognition based on MTCNN and convolutional neural network. Front. Sig. Process. 4(1), 37–42 (2020)

    Google Scholar 

  17. Wu, J., Chen, S.: An improved MTCNN face detection algorithm. Softw. Guide 18(12), 78–81 (2019)

    Google Scholar 

  18. Cai, K.: Research on non-contact heart rate measurement technology. Nanjing University of Posts and Telecommunications (2019)

    Google Scholar 

  19. Liu, Y.: Human heart rate measurement based on facial video. Shanghai Normal University, Shanghai (2018)

    Google Scholar 

  20. Yi, S., Zhu, J., Jing, H.: Research on face occlusion recognition based on MTCNN in railway face brushing scene. Comput. Simul. 37(5), 96–99 (2020)

    Google Scholar 

  21. Chen, D.: Research on non-contact heart rate measurement based on video. South China University of Technology, Guangdong (2016)

    Google Scholar 

Download references

Acknowledgments

This work was supported by the Project (19YFZCSF01150) in the Science & Technology Pillar Program of Tianjin, in part by the Tianjin Natural Science Foundation of China under Grant 18JCZDJC40300, in part by Innovation cultivation Foundation 19-163-12-ZT-006-007-06.

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhao, J., Zhang, W., Chai, R., Wu, H., Chen, W. (2021). Non-contact Physiological Parameters Detection Based on MTCNN and EVM. In: Sun, F., Liu, H., Fang, B. (eds) Cognitive Systems and Signal Processing. ICCSIP 2020. Communications in Computer and Information Science, vol 1397. Springer, Singapore. https://doi.org/10.1007/978-981-16-2336-3_48

Download citation

  • DOI: https://doi.org/10.1007/978-981-16-2336-3_48

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-16-2335-6

  • Online ISBN: 978-981-16-2336-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics