Abstract
The objective of this research was to compare classification methods aimed at predicting working memory (WM) load. Electroencephalogram (EEG) data was collected from physicians while performing basic WM tasks and simulated medical scenarios. Data processing was performed to remove noise from the signal used for analysis (e.g., muscle activity, eye-blinks). The data from basic WM tasks was used to develop and test the four classification models (LASSO regression, support vector machines (SVM), nearest shrunken centroids (NSC), and iterated supervised principal components (ISPC) to predict a WM state indicative of physicians’ optimal performance. The naïve misclassification rate was 19.74 %; LASSO and SVM outperformed this threshold: 18.10 and 12.21 % respectively). Both classification models had relatively high-specificity (LASSO: 97.2 %; SVM: 99.8 %); but relatively low-sensitivity LASSO: 20.7 %; SVM: 39.6 %). Results from simulated medical scenarios suggest that physicians were approximately 83 % of the time in the WM state that is likely indicative of optimal performance.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Kalsbeek, J.W.H., Ettema, J.H.: Scored irregularity of the heart pattern and measurement of perceptual or mental load. Ergonomics 6, 306–307 (1963)
Wildervanck, C., Mulder, G., Michon, J.A.: Mapping mental load in car driving. Ergonomics 21, 225–229 (1978)
Wilson, G.F., Eggemeier, F.T.: Physiological measures of workload in multi-task environments. In: Damos D. (ed.) Multiple-Task Performance (pp. 329–360). Taylor & Francis, London (1991)
Heslegrave, R.J., Furedy, J.J.: Sensitivities of HR and T-wave amplitude for detecting cognitive and anticipatory stress. Physiol. Behav. 22(1), 17–23 (1979)
Izzetoglu, K., Bunce, S., Onaral, B., Pourrezaei, K., Changem, B.: Functional optical brain imaging using near-infrared during cognitive tasks. Int. J. Hum-Comput. Int. 17, 211–227 (2004)
Verwey, W.B., Veltman, H.A.: Detecting short periods of elevated workload: a comparison of nine workload assessment techniques. J. Exp. Psychol. Appl. 2, 270–285 (1996)
Neumann, D.L.: Effect of varying levels of mental workload on startle eyeblink modulation. Ergonomics 45, 583–602 (2002)
Stern, J.A., Boyer, D., Schroeder, D.: Blink rate: a possible measure of fatigue. Hum. Factors 36, 285–297 (1994)
Veltman, J.A., Gaillard, A.W.K.: Physiological workload reactions to increasing levels of task difficulty. Ergonomics 41, 656–669 (1998)
Yamada, F.: Frontal midline theta rhythm and eyeblinking activity during a VDT task and a video game: useful tools for psychophysiology in ergonomics. Ergonomics 41, 678–688 (1998)
Partala, T., Surakka, V.: Pupil size variation as an indication of affective processing. Int. J. Hum-Comput. St. 59(1–2), 185–198 (2003)
Backs, R.W., Seljos, K.A.: Metabolic and cardiorespiratory measures of mental effort: The effects of level of difficulty in a working-memory task. Int. J. Psychophysiol. 16, 57–68 (1994)
Boiten, F.A.: The effects of emotional behaviour on components of the respiratory cycle. Biol. Psychol. 49(1–2), 29–51 (1998)
Porges, S.W., Byrne, E.A.: Research methods for measurement of heart-rate and respiration. Biol. Psychol. 34(2–3), 93–130 (1992)
Veltman, J.A., Gaillard, A.W.K.: Physiological workload reactions to increasing levels of task difficulty. Ergonomics 41, 656–669 (1998)
Wientjes, C.J.E.: Respiration in psychophysiology: methods and applications. Biol. Psychol. 34(2–3), 179–203 (1992)
Beatty, J.: Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychol. Bull. 91(2), 276–292 (1982)
Peavler, W.S.: Pupil size, information overload, and performance differences. Psychophysiology 11, 559–566 (1974)
Beatty, J., Lucero-Wagoner, B.: The pupillary system. Handb. Psychophysiol. 2, 142–162 (2000)
Smith, M.E., Gevins, A., Brown, H., Karnik, A., Du, R.: Monitoring task loading with multivariate EEG measures during complex forms of human-computer interaction. Human Factors J. Human Factors Ergon. Soc. 43(3), 366–380 (2001)
Gevins, A., Smith, M.E., McEvoy, L., Yu, D.: High resolution EEG mapping of cortical activation related to working memory: Effects of task difficulty, type of processing, and practice. Cere Cortex 7, 374–385 (1997)
Brookhuis, K.A., de Waard, D.: The use of psychophysiology to assess driver status. Ergonomics 36, 1099–1110 (1993)
Hankins, T.C., Wilson, G.F.: A comparison of heart rate, eye activity, EEG and subjective measures of pilot mental workload during flight. Aviat. Space Environ. Med. 69, 360–367 (1998)
Wilson, G.F.: An analysis of mental workload in pilots during flight using multiple psychophysiological measures. Int. J. Aviat. Psychol. 12, 3–18 (2001)
Mazur, L.M., Mosaly, P.R., Moore, C., Comitz, E., Yu, F., Falchook, A., Eblan, M., Hoyle, L.M., Tracton, G., Chera, B., Marks, L.B.: Towards a better understanding of task demands, workload, and performance during physician-computer interactions. J. Am. Med. Inf. Assoc. Accepted for publication (2016)
Tibshirani, R.: Regression shrinkage and selection via the Lasso. J. Roy. Stat. Soc. B Met. 58, 267–288 (1996)
Hastie, T., Tibshirani, R., Friedman, J., Franklin, J.: The elements of statistical learning: data mining, inference and prediction. Math. Intell. 27(2), 83–85 (2005)
Tibshirani, R., Hastie, T., Narasimhan, B., Chu, G. (2002). Diagnosis of multiple cancer types by shrunken centroids of gene expression. P Natl. Acad. Sci. USA 99(10), 6567–6572
Bair, E., Tibshirani, R.: Semi-supervised methods to predict patient survival from gene expression data. PLoS Biol. 2(4), e108 (2004)
Abrantes, A.: Classifying Mislabeled High-Dimensional Data with Iterated Supervised PCA (Master’s Thesis) (2015)
Team, R.C.: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria ISBN 3-900051-07-0 (2013)
Meyer, D., Dimitriadou, E., Hornik, K., Weingessel, A., Leisch, F.: Misc functions of the Department of Statistics (e1071). TU Wien, Version, pp. 1–6. (2012) TU Wien. R package version 1.6-4. http://CRAN.R-project.org/package=e1071
Friedman, J., Hastie, T., Tibshirani, R.: Regularization paths for generalized linear models via coordinate descent. J. Stat. Softw. 33(1), 1 (2010)
Tibshirani, R., Hastie, T., Narasimhan, B., Chu, G.: Prediction analysis for microarrays (PAM) software (2003). Available: http://www-stat.stanford.edu/~tibs/PAM/index.html via the Internet (2015)
Acknowledgments
This study was originally funded by the Innovation Center at University of North Carolina (UNC), and the UNC Healthcare System. The data analysis was partially supported by the grant numbers R18HS023458 and R21HS024062 from the Agency for Healthcare Research and Quality. The content is solely the responsibility of the authors and does not necessarily represent the official views of the Agency for Healthcare Research and Quality. Finally, we want to express our gratitude to all participants for their time and effort while participating in our experiments.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing Switzerland
About this paper
Cite this paper
Abrantes, A., Comitz, E., Mosaly, P., Mazur, L. (2017). Classification of EEG Features for Prediction of Working Memory Load. In: Ahram, T., Karwowski, W. (eds) Advances in The Human Side of Service Engineering. Advances in Intelligent Systems and Computing, vol 494. Springer, Cham. https://doi.org/10.1007/978-3-319-41947-3_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-41947-3_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-41946-6
Online ISBN: 978-3-319-41947-3
eBook Packages: EngineeringEngineering (R0)