Skip to main content

Deep Leaning-Based Approach for Mental Workload Discrimination from Multi-channel fNIRS

Part of the Lecture Notes in Electrical Engineering book series (LNEE,volume 524)

Abstract

As a non-invasive optical neuroimaging technique, functional near infrared spectroscopy (fNIRS) is currently used to assess brain dynamics during the performance of complex works and everyday tasks. However, the deep learning approaches to distinguish stress levels based on the changes of hemoglobin concentrations have not yet been extensively investigated. In this paper, we evaluated the efficiencies of advanced methods differentiating the rest and task periods during stroop task experiments. First, we explored that the apparent changes of oxy-hemoglobin (HbO) and deoxy-hemoglobin (HbR) concentrations associated with two mental stages did exist across each participant. Then, a novel discrimination framework was studied. Deep learning approaches, including convolutional neural network (CNN), deep belief networks (DBN), have enabled better classification accuracies of 84.26 ± 9.10% and 65.43 ± 1.59% as our preliminary study.

Keywords

  • Stroop task experiments
  • Functional near infrared spectroscopy
  • Convolutional neural networks
  • Deep belief networks

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-981-13-2685-1_41
  • Chapter length: 10 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   229.00
Price excludes VAT (USA)
  • ISBN: 978-981-13-2685-1
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Hardcover Book
USD   299.99
Price excludes VAT (USA)
Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

References

  1. Hoshi, Y., & Tamura, M. (1993). Detection of dynamic changes in cerebral oxygenation coupled to neuronal function during mental work in man. Neuroscience Letters, 150, 5–8.

    CrossRef  Google Scholar 

  2. Nguyen, H. T., Van Nguyen, H., Truong, K. Q. D., & Van Vo, T. (2013). Analysis of oxy-Hb signals to determine relationship between jaw imbalance and arm strength using fNIRS. American Journal of Biomedical Engineering, 3, 107–118.

    Google Scholar 

  3. Ferrari, M., & Quaresima, V. (2012). A brief review on the history of human functional near-infrared spectroscopy (fNIRS) development and fields of application. Neuroimage, 63, 921–935.

    CrossRef  Google Scholar 

  4. Hai, N. T., Cuong, N. Q., Khoa, T. Q. D., & Toi, V. V. (2013). Temporal hemodynamic classification of two hands tapping using functional near infrared spectroscopy. Frontiers in Human Neuroscience, 7, Article 516, 1–12.

    Google Scholar 

  5. Molteni, E., Baselli, G., Bianchi, A. M., Caffini, M., Contini, D., Spinelli, L. et al. (2009). Frontal brain activation during a working memory task: A time-domain fNIRS study. Photonic Therapeutics and Diagnostics V, 71613 N. https://doi.org/10.1117/12.808972.

  6. Sassaroli, A., Zheng, F., Coutts, M., Hirshfield, L. H., Girouard, A., Solovey, E. T., et al. (2009). Application of near-infrared spectroscopy for discrimination of mental workloads. In Proceedings of SPIE 7174, Optical Tomography and Spectroscopy of Tissue VIII (pp. 71741H).

    Google Scholar 

  7. Ramnani, N., & Owen, A. M. (2004). Anterior prefrontal cortex: Insights into function from anatomy and neuroimaging. Nature Reviews Neuroscience, 5, 184–194.

    CrossRef  Google Scholar 

  8. Suthaharan, S. (2016). Support vector machine. In Machine learning models and algorithms for big data classification (pp. 207–235). Springer.

    Google Scholar 

  9. Chu, F., & Zaniolo, C. (2004). Fast and light boosting for adaptive mining of data streams. In Pacific-Asia Conference on Knowledge Discovery and Data Mining (pp. 282–292). Springer.

    Google Scholar 

  10. Hinton, G., Osindero, S., & Teh, Y. W. (2006). A fast learning algorithm for deep belief nets. Neural Computation, 18, 1527–1554.

    MathSciNet  CrossRef  Google Scholar 

  11. LeCun, Y., Kavukcuoglu, K., & Farabet, C. (2010). Convolutional networks and applications in vision. In Proceedings of the IEEE International Symposium on Circuits and Systems (pp 253–226).

    Google Scholar 

  12. Krizhevsky, A., Sutskever, I., & Hinton, G. (2012). ImageNet classification with deep convolutional neural networks. In Proceedings of NIPS (pp. 1097–1105).

    Google Scholar 

  13. Tsinalis, O., Matthews, P. M., Guo, Y., & Zafeiriou, S. (2016). Automatic sleep stage scoring with single-channel EEG using convolutional neural networks. arXiv:1610.01683.

  14. Schroeter, M. L., et al. (2002). Near-infrared spectroscopy can detect brain activity during a color–word matching Stroop task in an event-related design. Human Brain Mapping, 17(1), 61–71.

    CrossRef  Google Scholar 

  15. Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. CoRR. arXiv:1409.1556.

  16. Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2014). Overfeat: Integrated recognition, localization and detection using convolutional networks. In ICLR.

    Google Scholar 

  17. Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014). Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 580–587).

    Google Scholar 

  18. Baker, W. B., Parthasarathy, A. B., Busch, D. R., Mesquita, R. C., Greenberg, J. H., & Yodh, A. G. (2014). Modified Beer-Lambert law for blood flow. Biomedical Optics Express, 5, 4053–4075.

    CrossRef  Google Scholar 

Download references

Acknowledgements

This work was supported by the Basic Science Research Program through the NRF funded by the Ministry of Education (NRF-2017R1D1A1B03036423) and the Brain Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT & Future Planning (NRF-2016M3C7A1905477, NRF-2014M3C7A1046050). All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. This article does not contain any studies with animals performed by any of the authors.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jeonghwan Gwak .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Ho, T.K.K., Gwak, J., Park, C.M., Khare, A., Song, JI. (2019). Deep Leaning-Based Approach for Mental Workload Discrimination from Multi-channel fNIRS. In: Khare, A., Tiwary, U., Sethi, I., Singh, N. (eds) Recent Trends in Communication, Computing, and Electronics. Lecture Notes in Electrical Engineering, vol 524. Springer, Singapore. https://doi.org/10.1007/978-981-13-2685-1_41

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-2685-1_41

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-2684-4

  • Online ISBN: 978-981-13-2685-1

  • eBook Packages: EngineeringEngineering (R0)