Measuring Stress in an Augmented Training Environment: Approaches and Applications

  • David JonesEmail author
  • Sara Dechmerowski
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9744)


Augmented reality (AR) and virtual reality (VR) training systems provide an opportunity to place learners in high stress conditions that are impossible in real life due to safety risks or the associated costs. Using physiological classifiers it is possible to continually measure the stress levels of learners within AR and VR training environments to adapt training based on their responses. This paper reviews stress measurement approaches, outlines an adaptive stress training model that can be applied to augment training and describes key characteristics and future research that is critical to realizing adaptive VR and AR training platforms that take into account learner stress levels.


Adaptive training Objective stress measurement Training fidelity evaluation High-stress training Augmented Reality 


  1. 1.
    Bartone, P.: Resilience under military operational stress: can leaders influence hardiness? Mil. Psychol. 18, 131–148 (2006)CrossRefGoogle Scholar
  2. 2.
    Carroll, M., Hale, K., Stanney, K., Woodman, M., DeVore, L., Squire, P., Sciarini, L.: Framework for training adaptable and stress-resilient decision making. In: Interservice Training, Simulation, and Education Conference (I/ITSEC) (2012)Google Scholar
  3. 3.
    Jones, D., Hale, K., Dechmerowski, S., Fouad, H.: Creating adaptive emotional experience during VE training. In: Interservice Training, Simulation, and Education Conference (I/ITSEC) (2012)Google Scholar
  4. 4.
    Saunders, T., Driskell, J., Hall, J., Salas, E.: The effect of stress inoculation training on anxiety and performance. ARI Research Note, pp. 96–27 (1996)Google Scholar
  5. 5.
    Robson, S., Manacapilli, T.: Enhancing Performance Under Stress: Stress Inoculation Training for Battlefield Airmen. RAND Corporation, Santa Monica (2014)Google Scholar
  6. 6.
    Keinen, G., Friedland, N.: Training effective performance under stress: queries, dilemmas, and possible solutions. In: Driskell, J.E., Salas, E. (eds.) Stress and Human Performance, pp. 257–277. Erlbaum, Mahwah (1996)Google Scholar
  7. 7.
    Holmes, T.H., Rahe, R.H.: The social readjustment rating scale. J. Psychosom. Res. 11(2), 213–218 (1967)CrossRefGoogle Scholar
  8. 8.
    Grant, K.E., Compas, B.E., Thurm, A.E., McMahon, S.D., Gipson, P.Y.: Stressors and child and adolescent psychopathology: measurement issues and prospective effects. J. Clin. Child Adolesc. Psychol. 33(2), 412–425 (2004)CrossRefGoogle Scholar
  9. 9.
    Southwick, S.M., Morgan 3rd, C.A., Nicolaou, A.L., Charney, D.S.: Consistency of memory for combat-related traumatic events in veterans of Operation Desert Storm. Am. J. Psychiatr. 154(2), 173–177 (1997)CrossRefGoogle Scholar
  10. 10.
    Cohen, S., Kamarck, T., Mermelstein, R.: A global measure of perceived stress. J. Health Soc. Behav. 24, 385–396 (1983)CrossRefGoogle Scholar
  11. 11.
    Malik, M., Bigger, J.T., Camm, A.J., Kleiger, R.E., Malliani, A., Moss, A.J., Schwartz, P.J.: Heart rate variability standards of measurement, physiological interpretation, and clinical use. Eur. Heart J. 17(3), 354–381 (1996)CrossRefGoogle Scholar
  12. 12.
    Sun, F.T., Kuo, C., Cheng, H.T., Buthpitiya, S., Collins, P., Griss, M.: Activity-aware mental stress detection using physiological sensors. In: Gris, M., Yang, G. (eds.) Mobile Computing, Applications, and Services. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol. 76, pp. 211–230. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  13. 13.
    Everly, G.S., Lating, J.M.: The anatomy and physiology of the human stress response. In: A Clinical Guide to the Treatment of the Human Stress Response, pp. 17–51. Springer, Heidelberg (2013)Google Scholar
  14. 14.
    Plarre, K., Raij, A., Hossain, S.M., Ali, A.A., Nakajima, M., al’ Absi, M., Ertin, E., Kamarck, T., Kumar, S., Scott, M., Siewiorek, D., Smailagic, A., Wittmers, Jr., L.E.: Continuous inference of psychological stress from sensory measurements collected in the natural environment. In: 2011 10th International Conference on Information Processing in Sensor Networks (IPSN), pp. 97–108. IEEE (2011)Google Scholar
  15. 15.
    de Santos Sierra, A., Ávila, C.S., Casanova, J.G., del Pozo, G.B.: Real-time stress detection by means of physiological signals. Group of Biometrics, Biosignals and Security Universidad Politécnica de Madrid, Spain, pp. 24–44 (2011)Google Scholar
  16. 16.
    Alamudun, F., Choi, J., Gutierrez-Osuna, R., Khan, H., Ahmed, B.: Removal of subject-dependent and activity-dependent variation in physiological measures of stress. In: 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth), pp. 115–122. IEEE (2012)Google Scholar
  17. 17.
    Bakker, J., Pechenizkiy, M., Sidorova, N.: What’s your current stress level? Detection of stress patterns from GSR sensor data. In: 2011 IEEE 11th International Conference on Data Mining Workshops (ICDMW), pp. 573–580. IEEE (2011)Google Scholar
  18. 18.
    Choi, J., Ahmed, B., Gutierrez-Osuna, R.: Development and evaluation of an ambulatory stress monitor based on wearable sensors. IEEE Trans. Inf. Technol. Biomed. 16(2), 279–286 (2012)CrossRefGoogle Scholar
  19. 19.
    Dechmeroswski, S., Winslow, B., Chadderdon, G., Schmidt-Daly, T.N., Jones, D.: Classifying stress in a mobile environment. In: Interservice Training, Simulation, and Education Conference (I/ITSEC) (2014)Google Scholar
  20. 20.
    Slater, M.: A note on presence terminology. Presence-Connect 3, 1–5 (2003)Google Scholar
  21. 21.
    Meehan, M.: Physiological reaction as an objective measure of presence in virtual environments. Doctoral Dissertation, University of North Carolina at Chapel Hill (2001)Google Scholar
  22. 22.
    Wiederhold, B.K., Jang, D.P., Kaneda, M., Cabral, I., Lurie, Y., May, T., Kim, I.Y., Wiederhold, M.D., Kim, S.I.: An investigation into physiological responses in virtual environments: an objective measurement of presence. In: Riva, G., Galimberti, C. (eds.) Towards CyberPsychology: Mind, Cognitions and Society in the Internet Age. IOS Press, Amsterdam (2001)Google Scholar
  23. 23.
    Stanney, K.M., Schmorrow, D.D., Johnston, M., Fuchs, S., Jones, D., Hale, K.S., Ahmad, A., Young, P.: Augmented cognition: an overview. Rev. Hum. Fact. Ergon. 5(1), 195–224 (2009)CrossRefGoogle Scholar
  24. 24.
    Driskell, J., Johnston, J.: Stress exposure training. In: Cannon-Bowers, J.A., Salas, E. (eds.) Making Decisions Under Stress: Implications for Individual and Team Training, pp. 191–217. American Psychological Association, Washington, DC (1998)CrossRefGoogle Scholar
  25. 25.
    Scherer, K., Shorr, A., Johnstone, T.: Appraisal Process in Emotion: Theory, Methods, Research. Oxford University Press, Canary (2001)Google Scholar
  26. 26.
    Hardy, M., Wiebe, E.N., Grafsgaard, J.F., Boyer, K.E., Lester, J.C.: Physiological responses to events during training use of skin conductance to inform future adaptive learning systems. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, pp. 2101–2105 (2013)Google Scholar
  27. 27.
    Sottilare, R.A., Gilbert, S.: Considerations for adaptive tutoring within serious games: authoring cognitive models and game interfaces. Presentation at the authoring simulation and game-based intelligent tutoring workshop at the fifteenth conference on artificial intelligence in education, Auckland (2011)Google Scholar
  28. 28.
    Joëls, M.: Corticosteroid effects in the brain: U-shape it. Trends Pharmacol. Sci. 27, 244–250 (2006)CrossRefGoogle Scholar
  29. 29.
    Diamond, D.M., Campbell, A.M., Park, C.R., Halonen, J., Zoladz, P.R.: The temporal dynamics model of emotional memory processing: a synthesis on the neurobiological basis of stress-induced amnesia, flashbulb and traumatic memories, and the Yerkes-Dodson law. Neural Plast. 2007, 1–33 (2007)CrossRefGoogle Scholar
  30. 30.
    Smeets, T., Giesbrecht, T., Jelicic, M., Merckelbach, H.: Context-dependent enhancement of declarative memory performance following acute psychosocial stress. Biol. Psychol. 76, 116–123 (2007)CrossRefGoogle Scholar
  31. 31.
    Andreano, J.M., Cahill, L.: Glucocorticoid release and memory consolidation in men and women. Psychol. Sci. 17, 466–470 (2006)CrossRefGoogle Scholar
  32. 32.
    Beckner, V.E., Tiucker, D.M., Delville, Y., Mohr, D.C.: Stress facilitates consolidation of verbal memory for a film but does not affect memory retrieval. Behav. Neurosci. 120, 518–527 (2006)CrossRefGoogle Scholar
  33. 33.
    Schwabe, L., Wolf, O.T.: The context counts: congruent learning and testing environments prevent memory retrieval impairment following stress. Cogn. Affect. Behav. Neurosci. 9, 229–236 (2009)CrossRefGoogle Scholar
  34. 34.
    Guenzel, F.M., Wolf, O.T., Schwabe, L.: Stress disrupts response memory retrieval. Psychoneuroendocrinology 38(8), 1460–1465 (2013)CrossRefGoogle Scholar
  35. 35.
    Schmidt, P.I., Rosga, K., Schatto, C., et al.: Stress reduces the incorporation of misinformation into an established memory. Learn. Mem. 21, 744–747 (2014)CrossRefGoogle Scholar
  36. 36.
    Schwabe, L., Worlf, O.T.: Stress impairs the reconsolidation of autobiographical memories. Neurobiol. Learn. Mem. 94, 153–157 (2010)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Design InteractiveOrlandoUSA

Personalised recommendations