Annals of Biomedical Engineering

, Volume 42, Issue 10, pp 2084–2094 | Cite as

Discriminative Analysis of Brain Functional Connectivity Patterns for Mental Fatigue Classification

  • Yu Sun
  • Julian Lim
  • Jianjun Meng
  • Kenneth Kwok
  • Nitish Thakor
  • Anastasios Bezerianos
Article

Abstract

Mental fatigue is a commonly experienced state that can be induced by placing heavy demands on cognitive systems. This often leads to lowered productivity and increased safety risks. In this study, we developed a functional-connectivity based mental fatigue monitoring method. Twenty-six subjects underwent a 20-min mentally demanding test of sustained attention with high-resolution EEG monitoring. Functional connectivity patterns were obtained on the cortical surface via source localization of cortical activities in the first and last 5-min quartiles of the experiment. Multivariate pattern analysis was then adopted to extract the highly discriminative functional connectivity information. The algorithm used in the present study demonstrated an overall accuracy of 81.5% (p < 0.0001) for fatigue classification through leave-one-out cross validation. Moreover, we found that the most discriminative connectivity features were located in or across middle frontal gyrus and several motor areas, in agreement with the important role that these cortical regions play in the maintenance of sustained attention. This work therefore demonstrates the feasibility of a functional-connectivity-based mental fatigue assessment method, opening up a new avenue for modeling natural brain dynamics under different mental states. Our method has potential applications in several domains, including traffic and industrial safety.

Keywords

Cross-validation Electroencephalography (EEG) Partial directed coherence (PDC) Permutation Psychomotor vigilance test (PVT) Multivariate pattern analysis (MVPA) 

Supplementary material

10439_2014_1059_MOESM1_ESM.tif (3.1 mb)
Figure S1. The cortical regions of interest (ROIs) were overlaid on the brain surface at the axial view. The 26 ROIs (13 in each hemisphere), including 4 frontal regions, 16 motor related regions, 4 somatosensory regions, and 2 associative visual regions. For better visualization purposes, labels of ROIs in the left hemisphere were listed in the figure. BA = Brodmann area, L = left, and R = right. (TIFF 3216 kb)
10439_2014_1059_MOESM2_ESM.tif (6.8 mb)
Figure S2. Group average cortical connectivity patterns for (a) rested state and (b) fatigued state. The brain is seen from above. Twenty-six ROIs were labeled and the cortical connections are coded with lines and arrows. The width and color of lines indicates the strengths of the connections. The top 5% cortical connections shared by at least five subjects are shown for illustration. The figure was visualized with BrainNet Viewer software (http://www.nitrc.org/projects/bnv/). (TIFF 6991 kb)
10439_2014_1059_MOESM3_ESM.pdf (47 kb)
Figure S3. Flow chart of the supervised learning approach used in the current work. (PDF 46 kb)

References

  1. 1.
    Akaike, H. A new look at the statistical model identification. IEEE Trans. Autom. Control 19:716–723, 1974.CrossRefGoogle Scholar
  2. 2.
    Astolfi, L., F. de Vico Fallani, F. Cincotti, D. Mattia, M. G. Marciani, S. Bufalari, S. Salinari, A. Colosimo, L. Ding, J. C. Edgar, W. Heller, G. A. Miller, B. He, and F. Babiloni. Imaging functional brain connectivity patterns from high-resolution EEG and fMRI via graph theory. Psychophysiology 44:880–893, 2007.PubMedCrossRefGoogle Scholar
  3. 3.
    Babiloni, F., F. Cincotti, C. Babiloni, F. Carducci, D. Mattia, L. Astolfi, A. Basilisco, P. M. Rossini, L. Ding, Y. Ni, J. Cheng, K. Christine, J. Sweeney, and B. He. Estimation of the cortical functional connectivity with the multimodal integration of high-resolution EEG and fMRI data by directed transfer function. Neuroimage 24:118–131, 2005.PubMedCrossRefGoogle Scholar
  4. 4.
    Baccala, L. A., and K. Sameshima. Partial directed coherence: a new concept in neural structure determination. Biol. Cybern. 84:463–474, 2001.PubMedCrossRefGoogle Scholar
  5. 5.
    Bishop, C. M. Pattern Recognition and Machine Learning. New York: Springer, 2006, 326 pp.Google Scholar
  6. 6.
    Borghini, G., L. Astolfi, G. Vecchiato, D. Mattia, and F. Babiloni. Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci. Biobehav. Rev. 2012. doi:10.1016/j.neubiorev.2012.10.003.
  7. 7.
    Cabeza, R., and L. Nyberg. Imaging cognition II: an empirical review of 275 PET and fMRI studies. J. Cogn. Neurosci. 12:1–47, 2000.PubMedCrossRefGoogle Scholar
  8. 8.
    Chang, C. C., and C. J. Lin. LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Tech. (TIST) 2:27, 2011.Google Scholar
  9. 9.
    Collins, D. L., P. Neelin, T. M. Peters, and A. C. Evans. Automatic 3d intersubject registration of MR volumetric data in standardized Talairach space. J. Comput. Assist. Tomogr. 18:192–205, 1994.PubMedCrossRefGoogle Scholar
  10. 10.
    Coull, J. T., R. S. Frackowiak, and C. D. Frith. Monitoring for target objects: activation of right frontal and parietal cortices with increasing time on task. Neuropsychologia 36:1325–1334, 1998.PubMedCrossRefGoogle Scholar
  11. 11.
    Craig, A., Y. Tran, N. Wijesuriya, and H. Nguyen. Regional brain wave activity changes associated with fatigue. Psychophysiology 49:574–582, 2012.PubMedCrossRefGoogle Scholar
  12. 12.
    Dale, A. M., and M. I. Sereno. Improved localizadon of cortical activity by combining EEG and MEG with MRI cortical surface reconstruction: a linear approach. J. Cogn. Neurosci. 5:162–176, 1993.PubMedCrossRefGoogle Scholar
  13. 13.
    Delorme, A., and S. Makeig. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134:9–21, 2004.PubMedCrossRefGoogle Scholar
  14. 14.
    Demeter, E., L. Hernandez-Garcia, M. Sarter, and C. Lustig. Challenges to attention: a continuous arterial spin labeling (ASL) study of the effects of distraction on sustained attention. Neuroimage 54:1518–1529, 2011.PubMedCentralPubMedCrossRefGoogle Scholar
  15. 15.
    Ding, M., S. L. Bressler, W. Yang, and H. Liang. Short-window spectral analysis of cortical event-related potentials by adaptive multivariate autoregressive modeling: data preprocessing, model validation, and variability assessment. Biol. Cybern. 83:35–45, 2000.PubMedCrossRefGoogle Scholar
  16. 16.
    Dockree, P. M., S. P. Kelly, J. J. Foxe, R. B. Reilly, and I. H. Robertson. Optimal sustained attention is linked to the spectral content of background EEG activity: greater ongoing tonic alpha (approximately 10 Hz) power supports successful phasic goal activation. Eur. J. Neurosci. 25:900–907, 2007.PubMedCrossRefGoogle Scholar
  17. 17.
    Faes, L., and G. Nollo. Extended causal modeling to assess partial directed coherence in multiple time series with significant instantaneous interactions. Biol. Cybern. 103:387–400, 2010.PubMedCrossRefGoogle Scholar
  18. 18.
    Golland, P., and B. Fischl. Permutation tests for classification: towards statistical significance in image-based studies. Inf. Process. Med. Imaging 18:330–341, 2003.PubMedCrossRefGoogle Scholar
  19. 19.
    Grandjean, E. Fatigue in industry. Br. J. Ind. Med. 36:175–186, 1979.PubMedCentralPubMedGoogle Scholar
  20. 20.
    He, B., Y. Dai, L. Astolfi, F. Babiloni, H. Yuan, and L. Yang. eConnectome: a MATLAB toolbox for mapping and imaging of brain functional connectivity. J. Neurosci. Methods 195:261–269, 2011.PubMedCentralPubMedCrossRefGoogle Scholar
  21. 21.
    He, B., T. Musha, Y. Okamoto, S. Homma, Y. Nakajima, and T. Sato. Electric dipole tracing in the brain by means of the boundary element method and its accuracy. IEEE Trans. Biomed. Eng. 34:406–414, 1987.PubMedCrossRefGoogle Scholar
  22. 22.
    Heekeren, H. R., S. Marrett, D. A. Ruff, P. A. Bandettini, and L. G. Ungerleider. Involvement of human left dorsolateral prefrontal cortex in perceptual decision making is independent of response modality. Proc. Natl. Acad. Sci. USA 103:10023–10028, 2006.PubMedCentralPubMedCrossRefGoogle Scholar
  23. 23.
    Helton, W. S., and P. N. Russell. Working memory load and the vigilance decrement. Exp. Brain Res. 212:429–437, 2011.PubMedCrossRefGoogle Scholar
  24. 24.
    Jung, T. P., C. Humphries, T. W. Lee, S. Makeig, M. J. McKeown, V. Iragui, and T. J. Sejnowski. Extended ICA removes artifacts from electroencephalographic recordings. Adv. Neural Inf. Process. Syst. 10:894–900, 1998.Google Scholar
  25. 25.
    Kaminski, M., M. Ding, W. A. Truccolo, and S. L. Bressler. Evaluating causal relations in neural systems: Granger causality, directed transfer function and statistical assessment of significance. Biol. Cybern. 85:145–157, 2001.PubMedCrossRefGoogle Scholar
  26. 26.
    Kar, S., A. Routray, and B. P. Nayak. Functional network changes associated with sleep deprivation and fatigue during simulated driving: validation using blood biomarkers. Clin. Neurophysiol. 122:966–974, 2011.PubMedCrossRefGoogle Scholar
  27. 27.
    Kendall, M. G. Rank Correlation Methods. New York: Oxford University Press, 1948.Google Scholar
  28. 28.
    Khushaba, R. N., S. Kodagoda, S. Lal, and G. Dissanayake. Driver drowsiness classification using fuzzy wavelet–packet-based feature-extraction algorithm. IEEE Trans. Biomed. Eng. 58:121–131, 2011.PubMedCrossRefGoogle Scholar
  29. 29.
    Klimesch, W. EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res. Brain Res. Rev. 29:169–195, 1999.PubMedCrossRefGoogle Scholar
  30. 30.
    Klimesch, W., M. Doppelmayr, H. Russegger, T. Pachinger, and J. Schwaiger. Induced alpha band power changes in the human EEG and attention. Neurosci. Lett. 244:73–76, 1998.PubMedCrossRefGoogle Scholar
  31. 31.
    Korzeniewska, A., M. Manczak, M. Kaminski, K. J. Blinowska, and S. Kasicki. Determination of information flow direction among brain structures by a modified directed transfer function (DDTF) method. J. Neurosci. Methods 125:195–207, 2003.PubMedCrossRefGoogle Scholar
  32. 32.
    Ku, C. H., and M. J. Smith. Organisational factors and scheduling in locomotive engineers and conductors: effects on fatigue, health and social well-being. Appl. Ergon. 41:62–71, 2010.PubMedCrossRefGoogle Scholar
  33. 33.
    Kurzban, R., A. Duckworth, J. W. Kable, and J. Myers. An opportunity cost model of subjective effort and task performance. Behav. Brain Sci. 36:661–679, 2013.PubMedCrossRefGoogle Scholar
  34. 34.
    Lal, S. K., and A. Craig. A critical review of the psychophysiology of driver fatigue. Biol. Psychol. 55:173–194, 2001.PubMedCrossRefGoogle Scholar
  35. 35.
    Lawrence, N. S., T. J. Ross, R. Hoffmann, H. Garavan, and E. A. Stein. Multiple neuronal networks mediate sustained attention. J. Cogn. Neurosci. 15:1028–1038, 2003.PubMedCrossRefGoogle Scholar
  36. 36.
    Lim, J., R. Ebstein, C. Y. Tse, M. Monakhov, P. S. Lai, D. F. Dinges, and K. Kwok. Dopaminergic polymorphisms associated with time-on-task declines and fatigue in the psychomotor vigilance test. PLoS ONE 7:e33767, 2012.PubMedCentralPubMedCrossRefGoogle Scholar
  37. 37.
    Lim, J., W. C. Wu, J. Wang, J. A. Detre, D. F. Dinges, and H. Rao. Imaging brain fatigue from sustained mental workload: an ASL perfusion study of the time-on-task effect. Neuroimage 49:3426–3435, 2010.PubMedCentralPubMedCrossRefGoogle Scholar
  38. 38.
    Lin, C. T., Y. C. Chen, T. Y. Huang, T. T. Chiu, L. W. Ko, S. F. Liang, H. Y. Hsieh, S. H. Hsu, and J. R. Duann. Development of wireless brain computer interface with embedded multitask scheduling and its application on real-time driver’s Drowsiness detection and warning. IEEE Trans. Biomed. Eng. 55:1582–1591, 2008.PubMedCrossRefGoogle Scholar
  39. 39.
    Lin, C. T., L. W. Ko, I. F. Chung, T. Y. Huang, Y. C. Chen, T. P. Jung, and S. F. Liang. Adaptive EEG-based alertness estimation system by using ICA-based fuzzy neural networks. IEEE Trans. Circuits Syst. I: Regul. Pap. 53:2469–2476, 2006.CrossRefGoogle Scholar
  40. 40.
    Liu, F., W. Guo, J. P. Fouche, Y. Wang, W. Wang, J. Ding, L. Zeng, C. Qiu, Q. Gong, W. Zhang, and H. Chen. Multivariate classification of social anxiety disorder using whole brain functional connectivity. Brain Struct. Funct. 2013. doi:10.1007/s00429-013-0641-4.
  41. 41.
    Liu, J. P., C. Zhang, and C. X. Zheng. Estimation of the cortical functional connectivity by directed transfer function during mental fatigue. Appl. Ergon. 42:114–121, 2010.PubMedCrossRefGoogle Scholar
  42. 42.
    MacDonald, 3rd, A. W., J. D. Cohen, V. A. Stenger, and C. S. Carter. Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. Science 288:1835–1838, 2000.PubMedCrossRefGoogle Scholar
  43. 43.
    Maroco, J., D. Silva, A. Rodrigues, M. Guerreiro, I. Santana, and A. de Mendonca. Data mining methods in the prediction of dementia: a real-data comparison of the accuracy, sensitivity and specificity of linear discriminant analysis, logistic regression, neural networks, support vector machines, classification trees and random forests. BMC Res. Notes 4:299, 2011.PubMedCentralPubMedCrossRefGoogle Scholar
  44. 44.
    Nichols, T. E., and A. P. Holmes. Nonparametric permutation tests for functional neuroimaging: a primer with examples. Hum. Brain Mapp. 15:1–25, 2002.PubMedCrossRefGoogle Scholar
  45. 45.
    Ojala, M., and G. C. Garriga. Permutation tests for studying classifier performance. J. Mach. Learn. Res. 99:1833–1863, 2010.Google Scholar
  46. 46.
    Parasuraman, R., and Y. Jiang. Individual differences in cognition, affect, and performance: behavioral, neuroimaging, and molecular genetic approaches. Neuroimage 59:70–82, 2012.PubMedCentralPubMedCrossRefGoogle Scholar
  47. 47.
    Rubinov, M., and O. Sporns. Complex network measures of brain connectivity: uses and interpretations. Neuroimage 52:1059–1069, 2010.PubMedCrossRefGoogle Scholar
  48. 48.
    Shen, H., L. Wang, Y. Liu, and D. Hu. Discriminative analysis of resting-state functional connectivity patterns of schizophrenia using low dimensional embedding of fMRI. Neuroimage 49:3110–3121, 2010.PubMedCrossRefGoogle Scholar
  49. 49.
    Shen, K. Q., X. P. Li, C. J. Ong, S. Y. Shao, and E. P. Wilder-Smith. EEG-based mental fatigue measurement using multi-class support vector machines with confidence estimate. Clin. Neurophysiol. 119:1524–1533, 2008.PubMedCrossRefGoogle Scholar
  50. 50.
    Sturm, W., A. de Simone, B. J. Krause, K. Specht, V. Hesselmann, I. Radermacher, H. Herzog, L. Tellmann, H. W. Muller-Gartner, and K. Willmes. Functional anatomy of intrinsic alertness: evidence for a Fronto-Parietal-Thalamic-brainstem network in the right hemisphere. Neuropsychologia 37:797–805, 1999.PubMedCrossRefGoogle Scholar
  51. 51.
    Sun, Y., Y. Li, Y. Zhu, X. Chen, and S. Tong. Electroencephalographic differences between depressed and control subjects: an aspect of interdependence analysis. Brain Res. Bull. 76:559–564, 2008.PubMedCrossRefGoogle Scholar
  52. 52.
    Sun, Y., J. Lim, K. Kwok, and A. Bezerianos. Functional cortical connectivity analysis of mental fatigue unmasks hemispheric asymmetry and changes in small-world networks. Brain Cogn. 85:220–230, 2014.PubMedCrossRefGoogle Scholar
  53. 53.
    Sun, Y., H. Zhang, T. Feng, Y. Qiu, Y. Zhu, and S. Tong. Early cortical connective network relating to audiovisual stimulation by partial directed coherence analysis. IEEE Trans. Biomed. Eng. 56:2721–2724, 2009.PubMedCrossRefGoogle Scholar
  54. 54.
    Tang, Y., W. Jiang, J. Liao, W. Wang, and A. Luo. Identifying individuals with antisocial personality disorder using resting-state fMRI. PLoS ONE 8:e60652, 2013.PubMedCentralPubMedCrossRefGoogle Scholar
  55. 55.
    Tang, Y., L. Wang, F. Cao, and L. Tan. Identify schizophrenia using resting-state functional connectivity: an exploratory research and analysis. Biomed. Eng. Online 11:50, 2012.PubMedCentralPubMedCrossRefGoogle Scholar
  56. 56.
    Ten Caat, M., M. M. Lorist, E. Bezdan, J. B. Roerdink, and N. M. Maurits. High-density EEG coherence analysis using functional units applied to mental fatigue. J. Neurosci. Methods 171:271–278, 2008.PubMedCrossRefGoogle Scholar
  57. 57.
    Tucker, P., S. Folkard, and I. Macdonald. Rest breaks and accident risk. Lancet 361:680, 2003.PubMedCrossRefGoogle Scholar
  58. 58.
    Wang, L., H. Shen, F. Tang, Y. Zang, and D. Hu. Combined structural and resting-state functional MRI analysis of sexual dimorphism in the young adult human brain: an MVPA approach. Neuroimage 61:931–940, 2012.PubMedCrossRefGoogle Scholar
  59. 59.
    Warm, J. S., R. Parasuraman, and G. Matthews. Vigilance requires hard mental work and is stressful. Hum. Factors 50:433–441, 2008.PubMedCrossRefGoogle Scholar
  60. 60.
    Zeng, L. L., H. Shen, L. Liu, L. Wang, B. Li, P. Fang, Z. Zhou, Y. Li, and D. Hu. Identifying major depression using whole-brain functional connectivity: a multivariate pattern analysis. Brain 135:1498–1507, 2012.PubMedCrossRefGoogle Scholar
  61. 61.
    Zhu, C. Z., Y. F. Zang, Q. J. Cao, C. G. Yan, Y. He, T. Z. Jiang, M. Q. Sui, and Y. F. Wang. Fisher discriminative analysis of resting-state brain function for attention-deficit/hyperactivity disorder. Neuroimage 40:110–120, 2008.PubMedCrossRefGoogle Scholar

Copyright information

© Biomedical Engineering Society 2014

Authors and Affiliations

  • Yu Sun
    • 1
  • Julian Lim
    • 1
    • 2
    • 3
  • Jianjun Meng
    • 4
  • Kenneth Kwok
    • 1
    • 2
  • Nitish Thakor
    • 1
  • Anastasios Bezerianos
    • 1
  1. 1.Singapore Institute for Neurotechnology (SINAPSE), Centre for Life SciencesNational University of SingaporeSingaporeSingapore
  2. 2.Temasek LaboratoriesNational University of SingaporeSingaporeSingapore
  3. 3.Department of PsychologyNational University of SingaporeSingaporeSingapore
  4. 4.BioMechatronics and BioRobotics Laboratory, School of Mechanical EngineeringShanghai Jiao Tong UniversityShanghaiChina

Personalised recommendations