The Visual Computer

, Volume 26, Issue 6–8, pp 649–657

The physiological mirror—a system for unconscious control of a virtual environment through physiological activity

  • Christoph Groenegress
  • Bernhard Spanlang
  • Mel Slater
Original Article

Abstract

This paper introduces a system for real-time physiological measurement, analysis, and metaphorical visualization within a virtual environment (VE). Our goal is to develop a method that allows humans to unconsciously relate to parts of an environment more strongly than to others, purely induced by their own physiological responses to the virtual reality (VR) displays. In particular, we exploit heart rate, respiration, and galvanic skin response in order to control the behavior of virtual characters in the VE. Such unconscious processes may become a useful tool for storytelling or assist guiding participants through a sequence of tasks in order to make the application more interesting, e.g., in rehabilitation. We claim that anchoring of subjective bodily states to a virtual reality (VR) can enhance a person’s sense of realism of the VR and ultimately create a stronger relationship between humans and the VR.

Keywords

Virtual reality Human–computer interaction Physiological processing Whole–body interaction 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Akizuki, H., Uno, A., Arai, K., Morioka, S., Ohyama, S., Nishiike, S., Tamura, K., Takeda, N.: Effects of immersion in virtual reality on postural control. Neurosci. Lett. 379(1), 23–26 (2005) CrossRefGoogle Scholar
  2. 2.
    Andreassi, J.L.: Psychophysiology Human Behavior and Physiological Response. Erlbaum Associates, Hillsdale (2000) Google Scholar
  3. 3.
    Antley, A., Slater, M.: The effect on lower spine muscle activation of walking on a narrow beam in virtual real. IEEE Trans. Vis. Comput. Graph. (2010). http://doi.ieeecomputersociety.org/10.1109/TVCG.2010.26
  4. 4.
    Brogni, A., Vinayagamoorthy, V., Steed, A., Slater, M.: Responses of participants during an immersive virtual environment experience. Int. J. Virtual Real. 6(2), 1–10 (2007) Google Scholar
  5. 5.
    Cardillo, C., Russo, M., LeDuc, P., Torch, W.: Quantitative EEG changes under continuous wakefulness and with fatigue countermeasures: implications for sustaining aviator performance. In: Schmorrow, D., Reeves, L. (eds.) Foundations of Augmented Cognition. Lecture Notes in Computer Science, pp. 137–146. Springer, Berlin (2007) Google Scholar
  6. 6.
    Carrozzino, M., Tecchia, F., Bacinelli, S., Cappelletti, C., Bergamasco, M.: Lowering the development time of multimodal interactive application: the real-life experience of the XVR project. In: ZhiYing, S.Z., Ping, L.S. (eds.) Proc. of the 2005 ACM SIGCHI Intern. Conf. on Advances in Comput. Entertain. Technol., pp. 270–273. Valencia (2005) Google Scholar
  7. 7.
    Dawson, M.E., Schell, A.E., Filion, D.L.: The electrodermal system. In: Cacioppo, J.T., Tassinary, L.G., Berntson, G.G. (eds.) Handbook of Psychophysiology, pp. 200–223. Cambridge Univ. Press, Cambridge (2007) Google Scholar
  8. 8.
    Garau, M., Slater, M., Pertaub, D.P., Razzaque, S.: The responses of people to virtual humans in an immersive virtual environment. Presence: Teleoper. Virtual Environ. 14(1), 104–116 (2005) CrossRefGoogle Scholar
  9. 9.
    Gillies, M., Slater, M.: Non-verbal communication for correlational characters. In: The 8th Annu. Intern. Workshop on Presence, vol. 8, pp. 103–106 (2005) Google Scholar
  10. 10.
    Groenegress, C., Holzner, C., Guger, C., Slater, M.: Effects of BCI use on reported presence in a virtual environment. Presence: Teleoper. Virtual Environ. (2010, in press) Google Scholar
  11. 11.
    Groenegress, C., Thomsen, M.R., Slater, M.: Correlations between vocal input and visual response apparently enhance presence in virtual environments. Cyberpsychol. Behav. 12(4), 429–431 (2009) CrossRefGoogle Scholar
  12. 12.
    Hall, E.T.: The Hidden Dimension. Doubleday, Garden City (1966) Google Scholar
  13. 13.
    Heeter, C.: Being there: the subjective experience of presence. Presence: Teleoper. Virtual Environ. 1(2), 262–271 (1992) Google Scholar
  14. 14.
    Huang, R.S., Jung, T.P., Makeig, S.: Event-related brain dynamics in continuous sustained-attention tasks. In: Schmorrow, D.D., Reeves, L.M. (eds.) Augmented Cognition. Lecture Notes in Computer Science, vol. 4565, pp. 65–74. Springer, Berlin (2007). doi:10.1007/978-3-540-73216-7_8 CrossRefGoogle Scholar
  15. 15.
    Jang, D.P., Kim, I.Y., Nam, S.W., Wiederhold, B.K., Wiederhold, M.D., Kim, S.I.: Analysis of physiological response to two virtual environments: driving and flying simulation. Cyberpsychol. Behav. 5(1), 11–18 (2002) CrossRefGoogle Scholar
  16. 16.
    Leeb, R., Kleinrath, C., Guger, C., Scherer, R., Friedman, D., Slater, M., Pfurtscheller, G.: Using a BCI as a navigation tool in virtual environments. In: 2nd Intern. Brain-Comput. Interface Workshop and Train., pp. 49–50 (2004) Google Scholar
  17. 17.
    Leeb, R., Settgast, V., Fellner, D., Pfurtscheller, G.: Self-paced exploration of the Austrian national library through thought. Int. J. Bioelectromagn. 9(4), 237–244 (2007) Google Scholar
  18. 18.
    Meehan, M., Insko, B., Whitton, M.C., Brooks, F.P.: Physiological measures of presence in stressful virtual environments. ACM Trans. Graph. 21(3), 645–652 (2002) CrossRefGoogle Scholar
  19. 19.
    Meehan, M., Razzaque, S., Whitton, M.C., Brooks, F.P.: Effect of latency on presence in stressful virtual environments. In: IEEE Virtual Real. pp. 141–148 (2003) Google Scholar
  20. 20.
    Nagai, Y., Critchley, H.D.: Novel therapeutic application of galvanic skin response (GSR) biofeedback to a neurological disorder: mechanisms underlying biofeedback in epilepsy management. In: New Research on Biofeedback, pp. 1–31. Nova Science, Hauppauge (2007) Google Scholar
  21. 21.
    Pan, X., Gillies, M., Slater, M.: Male bodily responses during an interaction with a virtual woman. In: Prendinger, H., Lester, J.C., Ishizuka, M. (eds.) Intell. Virtual Agents, pp. 89–96. Springer, Berlin (2008) CrossRefGoogle Scholar
  22. 22.
    Pertaub, D.P., Slater, M., Barker, C.: An experiment on public speaking anxiety in response to three different types of virtual audience. Presence: Teleoper. Virtual Environ. 11(1), 68–78 (2002) CrossRefGoogle Scholar
  23. 23.
    Slater, M.: Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Phil. Trans. R. Soc. B 364(1535), 3549–3557 (2009) CrossRefGoogle Scholar
  24. 24.
    Slater, M., Antley, A., Davison, A., Swapp, D., Guger, C., Barker, C., Pistrang, N., Sanchez-Vives, M.V.: A virtual reprise of the Stanley Milgram obedience experiments. PLoS ONE. http://www.plosone.org/article/fetchArticle.action?articleURI=info%3Adoi%2F10.1371%2Fjournal.pone.0000039 (2006). Accessed 12 January 2010
  25. 25.
    Slater, M., Guger, C., Edlinger, G., Leeb, R., Pfurtscheller, G., Antley, A., Garau, M., Brogni, A., Friedman, D.: Analysis of physiological responses to a social situation in an immersive virtual environment. Presence: Teleoper. Virtual Environ. 15(5), 553–569 (2006) CrossRefGoogle Scholar
  26. 26.
    Slater, M., Pérez Marcos, D., Ehrsson, H., Sanchez-Vives, M.V.: Towards a digital body: the virtual arm illusion. Front. Hum. Neurosci. 2(6), 1–8 (2008) Google Scholar
  27. 27.
    Slater, M., Spanlang, B., Sanchez-Vives, M.V., Blanke, O.: First person experience of body transfer in virtual reality. Plos ONE (2010, in press) Google Scholar
  28. 28.
    Spanlang, B.: HALCA Hardware Accelerated Library for Character Animation. Technical report 2009-1, Event Lab (2009) Google Scholar
  29. 29.
    Tarvainen, M.P., Koistinen, A.S., Valkonen-Korhonen, M., Partanen, J., Karjalainen, P.A.: Analysis of galvanic skin responses with principal components and clustering techniques. IEEE Biomed. Eng. 48(10), 1071–1079 (2001) CrossRefGoogle Scholar
  30. 30.
    Slater, M., Usoh, M., Steed, A.: Taking steps: the influence of a walking technique on presence in virtual reality. ACM Trans. Comput.-Hum. Interact. 2(3), 201–219 (1995) CrossRefGoogle Scholar
  31. 31.
    Venables, P.H., Christie, M.J.: Electrodermal activity. In: Martin, I., Venables, P.H. (eds.) Techniques in Psychopsychology, pp. 2–67. Wiley, New York (1980) Google Scholar

Copyright information

© Springer-Verlag 2010

Authors and Affiliations

  • Christoph Groenegress
    • 1
  • Bernhard Spanlang
    • 1
  • Mel Slater
    • 1
    • 2
  1. 1.EVENT Lab, Departament de Personalitat, Avaluació i Tractaments PsicològicsUniversitat de BarcelonaBarcelonaSpain
  2. 2.ICREA—Institució Catalana de Recerca i Estudis AvançatsBarcelonaSpain

Personalised recommendations