Skip to main content

A New Strategy for Mental Fatigue Detection Based on Deep Learning and Respiratory Signal

  • Conference paper
  • First Online:
Proceedings of the 11th International Conference on Computer Engineering and Networks

Abstract

Mental fatigue is often associated with decreased mental alertness and worsening performances. But its detection method is still a difficult issue due to the contradiction between practicability and accuracy. In the current study, we attempt to provide a new method for mental fatigue detection to realize the unity of practicability and accuracy based on deep learning and respiratory signal. To this end, respiratory signals were collected and two deep learning models, convolutional neural network (CNN) and Long Short Term Memory (LSTM), were constructed. Wavelet scale maps and time series of respiratory signal were as input to CNN and LSTM respectively. The data set was divided into training set, verification set and test set according to the ratio of 6:2:2. Bayesian optimization was used for hyperparametric optimization of CNN and LSTM. The results showed that LSTM model has a better performance of test accuracy of 89.16% than CNN that of 77.29%. Our findings indicated that respiratory signal combined with LSTM classifier may be a practical and effective strategy for mental fatigue detection.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 469.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 599.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 599.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Cao, J., Shi, J., Li, G., Guo, Y., Shan, P.: Research on ECG respiratory monitoring system of automobile driver based on PVDF. Mod. Electron. Technol. 42(10), 79–82+87 (2019)

    Google Scholar 

  2. Li, G., et al.: The Maximum eigenvalue of the brain functional network adjacency matrix: meaning and application in mental fatigue evaluation. Brain Sci. 10(2) (2021)

    Google Scholar 

  3. Hu, S., Peters, B., Zheng, G.: Driver fatigue detection from electroencephalogram spectrum after electrooculography artefact removal. IET Intell. Transp. Syst. 7(1), 105–113 (2013)

    Article  Google Scholar 

  4. Fu, R., Tian, Y., Wang, S., Wang, L.: The recognition of driver’s fatigue based on dynamic Bayesian estimation. Chin. J. Biomed. Eng. 38(06), 759–763 (2019)

    Google Scholar 

  5. Dissanayake, T., Fernando, T., Denman, S., Sridharan, S., Fookes, C.: Deep learning for patient-independent epileptic seizure prediction using scalp EEG signals. IEEE Sens. J. 21(7), 9377–9388 (2021)

    Article  Google Scholar 

  6. Li, G., Li, B., Wang, G., Zhang, J., Wang, J.: A new method for human mental fatigue detection with several EEG channels. J. Med. Biol. Eng. 37(2), 240–247 (2017)

    Article  Google Scholar 

  7. Guo, X., Chen, L., Shen, C.: Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis. Measurement 93(7), 490–502 (2016)

    Article  Google Scholar 

  8. Felix, A.G., Schmidhuber, J., Cummins, F.: Learning to forget: continual prediction with LSTM. Neural Comput. 12(10), 2451–2471 (2000)

    Article  Google Scholar 

  9. Cui, J., Yang, B.: Survey on Bayesian optimization methodology and applications. J. Softw. 29(10), 3068–3090 (2018)

    MathSciNet  MATH  Google Scholar 

  10. Ge, J., Liu, Z.: The algorithm based on CNN and LSTM for sleep apnea syndrome detection. Electron. Sci. Technol. 34(02), 21–26 (2021)

    Google Scholar 

  11. Liu, X., et al.: Toward practical driving fatigue detection using three frontal EEG channels: a proof-of-concept study. Physiol. Meas. (2021). https://doi.org/10.1088/1361-6579/abf336

    Article  Google Scholar 

  12. Ogino, M., Mitsukura, Y.: Portable drowsiness detection through use of a prefrontal single-channel electroencephalogram. Sensors 18(12), 4477 (2018)

    Article  Google Scholar 

  13. Wei, C., Wang, Y., Lin, C., Jung, T.: Toward drowsiness detection using non-hair-bearing EEG-based brain-computer interfaces. IEEE Trans. Neural Syst. Rehabil. Eng. 26(2), 400–406 (2018)

    Article  Google Scholar 

Download references

Acknowledgments

This work was partly supported by the National Natural Science Foundation of China (No. 82001918), Zhejiang Provincial Natural Science Foundation of China (No. LQ19E050011), Key Laboratory of Urban Rail Transit Intelligent Operation and Maintenance Technology & Equipment of Zhejiang Province Independent Research Project (No. ZSDRTZZ2020002), Key Research and Development Program of Zhejiang Province (No. 2019C01134), and National Undergraduate Innovation and Entrepreneurship Training Program (No. 202010345042).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Gang Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wang, J. et al. (2022). A New Strategy for Mental Fatigue Detection Based on Deep Learning and Respiratory Signal. In: Liu, Q., Liu, X., Chen, B., Zhang, Y., Peng, J. (eds) Proceedings of the 11th International Conference on Computer Engineering and Networks. Lecture Notes in Electrical Engineering, vol 808. Springer, Singapore. https://doi.org/10.1007/978-981-16-6554-7_60

Download citation

Publish with us

Policies and ethics