Theoretical Versus Mathematical Approach to Modeling Psychological and Physiological Data

  • Lauren Reinerman-JonesEmail author
  • Stephanie J. Lackey
  • Julian AbichIV
  • Brandon Sollins
  • Irwin Hudson
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9743)


Variable selection for predictive modeling has traditionally relied on theory in the psychological domain. Given the recent advancements in computing technology and availability, researchers are able to utilize more sophisticated mathematical modeling techniques with greater ease. The challenge becomes evaluating whether theory or mathematics should be relied upon for model development. The presented analyses compared the use of hierarchical and stepwise variable selection methods during a predictive modeling task using linear regression. The results show that the stepwise variable selection method is able to obtain a more efficient model than the hierarchical variable selection method. Implications and recommendations for researchers are further discussed.


Cognitive modeling Perception Emotion Interaction Electroencephalography Brain activity measurement Physiological measuring Human performance 



This work was in part supported by the US Army Research Laboratory (ARL) (W91CRB-08-D-0015). The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of ARL or the US Government.


  1. 1.
    Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. J. Mach. Learn. Res. 3, 1157–1182 (2003)zbMATHGoogle Scholar
  2. 2.
    Hogarty, K.Y., Kromrey, J.D., Ferron, J.M., Hines, C.V.: Selection of variables in exploratory factor analysis: an empirical comparison of a stepwise and traditional approach. Psychometrika 69(4), 593–611 (2004)MathSciNetCrossRefzbMATHGoogle Scholar
  3. 3.
    Otten, L.J., Rugg, M.D.: Electrophysiological correlates of memory encoding are task-dependent. Cogn. Brain. Res. 12(1), 11–18 (2001)CrossRefGoogle Scholar
  4. 4.
    Reinerman-Jones, L.E., Matthews, G., Barber, D.J., Abich IV, J.: Psychophysiological metrics for workload are demand-sensitive but multifactorial. In: Proceedings of the 58th Human Factors and Ergonomics Society 2014, pp. 974–978. SAGE Publications, ChicagoGoogle Scholar
  5. 5.
    Abich IV, J.: Investigating the universality and comprehensive ability of measures to assess the state of workload. Doctoral dissertation, University of Central Florida, Orlando, FL (2013)Google Scholar
  6. 6.
    Abich IV, J., Reinerman-Jones, L., Taylor, G.S.: Establishing workload manipulations utilizing a simulated environment. In: Shumaker, R. (ed.) Proceedings of the 8th International Conference of HCI International 2013. Springer, Las Vegas, NV (2013)Google Scholar
  7. 7.
    Kohlmorgen, J., Dornhege, G., Braun, M., Blankertz, B., Müller, K.R., Curio, G., Hagemann, K., Bruns, A., Schrauf, M., Kineses, W.: Improving human performance in a real operating environment through real-time mental workload detection. In: Dornhege, G., Millan, J.R., Hinterberger, T., McFarland, D.J., Muller, K.R. (eds.) Toward Brain-Computer Interfacing, pp. 409–422. MIT Press, Cambridge (2007)Google Scholar
  8. 8.
    Tattersall, A.J., Foord, P.S.: An experimental evaluation of instantaneous self-assessment as a measure of workload. Ergonomics 39(5), 740–748 (1996)CrossRefGoogle Scholar
  9. 9.
    Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Hancock, P.A., Meshkati, N. (eds.) Human Mental Workload, pp. 139–184. Elsevier Science Publishers, North-Holland (1988)CrossRefGoogle Scholar
  10. 10.
    Abich, J., Reinerman-Jones, L., Taylor, G.S.: Investigating Workload (2013)Google Scholar
  11. 11.
    Measures for adaptive training systems. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 57(1), 2091–2095. SAGE Publications, San DiegoGoogle Scholar
  12. 12.
    Moroney, W.F., Biers, D.W., Eggemeier, F.T., Mitchel, J.A.: A comparison of two scoring procedures with the NASA-Task Load Index in a simulated flight task. In: Proceedings of the 1992 IEEE Aerospace and Electronics Conference, vol. 2, pp. 734–740 (1992)Google Scholar
  13. 13.
    Ergenoglu, T., Demiralp, T., Bayraktaroglu, Z., Ergen, M., Beydagi, H., Uresin, Y.: Alpha rhythm of the EEG modulates visual detection performance in humans. Cogn. Brain. Res. 20(3), 376–383 (2004)CrossRefGoogle Scholar
  14. 14.
    Smith, M.E., Gevins, A., Brown, H., Karnik, A., Du, R.: Monitoring task loading with multivariate EEG measures during complex forms of human-computer interaction. Hum. Factors 43(3), 366–380 (2001)CrossRefGoogle Scholar
  15. 15.
    Larson, C.L.: Relations between PET-derived measures of thalamic glucose metabolism and EEG alpha power. Psychophysiology 35(2), 162–169 (1998)CrossRefGoogle Scholar
  16. 16.
    Asada, H., Fukuda, Y., Tsunoda, S., Yamaguchi, M., Tonoike, M.: Frontal midline theta rhythms reflect alternative activation of prefrontal cortex and anterior cingulate cortex in humans. Neurosci. Lett. 274(1), 29–32 (1999)CrossRefGoogle Scholar
  17. 17.
    Veltman, J.A., Gaillard, A.K.: Physiological workload reactions to increasing levels of task difficulty. Ergonomics 41(5), 656–669 (1998)CrossRefGoogle Scholar
  18. 18.
    Warm, J.S., Tripp, L.D., Matthews, G., Helton, W.S.: Cerebral hemodynamic indices of operator fatigue in vigilance. In: Matthews, G., Desmond, P.A., Neubauer, C., Hancock, P.A. (eds.) Handbook of Operator Fatigue, pp. 197–207. Ashgate Press, Aldershot (2012)Google Scholar
  19. 19.
    Izzetoglu, K., Bunce, S., Onaral, B., Pourrezaei, K., Chance, B.: Functional optical brain imaging using near-infrared during cognitive tasks. Int. J. Hum.-Comput. Interact. 17(2), 211–227 (2004)CrossRefGoogle Scholar
  20. 20.
    Shaw, T.H., Guagliardo, L., de Visser, E., Parasuraman, R.: Using transcranial Doppler sonography to measure cognitive load in a command and control task. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 54(3), 249–253 (2010)CrossRefGoogle Scholar
  21. 21.
    Beatty, J.: Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychol. Bull. 91(2), 276 (1982)CrossRefGoogle Scholar
  22. 22.
    Di Nocera, F., Terenzi, M., Camilli, M.: Another look at scanpath: distance to nearest neighbour as a measure of mental workload. In: de Waard, D., Brookhuis, K.A., Toffetti, A. (eds.) Developments in Human Factors in Transportation, Design, and Evaluation, pp. 1–9. Shaker Publishing, Herzogenrath (2006)Google Scholar
  23. 23.
    Jacob, R.J., Karn, K.S.: Eye tracking in human-computer interaction and usability research: ready to deliver the promises. In: Hyona, J., Radach, R., Deubel, H. (eds.) The Mind’s Eye: Cognitive and Applied Aspects of Eye Movement Research, pp. 573–605. Elsevier Science, Amsterdam (2003)CrossRefGoogle Scholar
  24. 24.
    Van Orden, K.F., Limbert, W., Makeig, S., Jung, T.P.: Eye activity correlates of workload during a visuospatial memory task. Hum. Factors 43(1), 111–121 (2001)CrossRefGoogle Scholar
  25. 25.
    Marshall, S.P.: The index of cognitive activity: measuring cognitive workload. In: Proceedings of the 2002 IEEE 7th Conference on Human Factors and Power Plants, pp. 7–9 (2002)Google Scholar
  26. 26.
    Lewis, M.: Stepwise versus hierarchical regression: pros and cons. Paper Presented at the Annual Meeting of the Southwest Education Research Association, San Antonio, TX, 7 February 2007Google Scholar
  27. 27.
    Field, A.: Discovering Statistics Using SPSS, 3rd edn. SAGE, Los Angeles (2009)zbMATHGoogle Scholar
  28. 28.
    Pedhazur, E.J.: Multiple Regression in Behavioral Research, 3rd edn. Harcourt Brace, Orlando (1997)zbMATHGoogle Scholar
  29. 29.
    Kerlinger, F.N.: Foundations of Behavioral Research, 3rd edn. Holt, Rinehart and Winston, New York (1986)Google Scholar
  30. 30.
    Thompson, M.L.: Selection of variables in multiple regression: part I. A review and evaluation. Int. Statist. Rev. 46(1), 1–19 (1978)CrossRefzbMATHGoogle Scholar
  31. 31.
    Babyak, M.: What you see may not be what you get: a brief, nontechnical introduction to overfitting in regression-type models. Psychosom. Med. 66(3), 411–421 (2004)Google Scholar
  32. 32.
    McClave, J.T., Sincich, T.: Statistics. Prentice Hall, Upper Saddle River (2009)zbMATHGoogle Scholar
  33. 33.
    Reinerman-Jones, L., Barber, D., Lackey, S., Nicholson, D.: Developing methods for utilizing physiological measures. In: Tadeusz, M., Waldemar, K., Rice, V. (eds.) Advances in Understanding Human Performance: Neuroergonomics, Human Factors Design, and Special Populations. CRC Press, Boca Raton (2010)Google Scholar
  34. 34.
    Department of Defense: Department of Defense Interface Standard: Common Warfighting Symbology (MIL-STD-2525B) (2005)Google Scholar
  35. 35.
    Tan, K., Chan, K., Choi, K.: Detection of the QRS complex, P wave and T wave in electrocardiogram. In: First International Conference on Advances in Medical Signal and Information Processing, No. 476, pp. 41–47 (2000)Google Scholar
  36. 36.
    Beal, D.: Information criteria methods in SAS for multiple linear regression models. In: Proceedings of the 15th Annual SouthEast SAS User Group (SESUG) (2007)Google Scholar
  37. 37.
    Ferguson, C.J.: An effect size primer: a guide for clinicians and researchers. Prof. Psychol.: Res. Pract. 40(5), 532–538 (2009)MathSciNetCrossRefGoogle Scholar
  38. 38.
    Cinaz, B., Arnrich, B., La Marca, R., Troster, G.: Monitoring of mental workload levels during an everyday life office-work scenario. Pers. Ubiquit. Comput. 17(2), 229–239 (2011)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Lauren Reinerman-Jones
    • 1
    Email author
  • Stephanie J. Lackey
    • 2
  • Julian AbichIV
    • 1
  • Brandon Sollins
    • 1
  • Irwin Hudson
    • 3
  1. 1.Institute for Simulation and Training (IST)University of Central Florida (UCF)OrlandoUSA
  2. 2.Design InteractiveOrlandoUSA
  3. 3.U.S. Army Research LaboratoryOrlandoUSA

Personalised recommendations