Identifying Relationships between Physiological Measures and Evaluation Metrics for 3D Interaction Techniques

  • Rafael Rieder
  • Christian Haag Kristensen
  • Márcio Sarroglia Pinho
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6948)


This project aims to present a methodology to study the relationships between physiological measures and evaluation metrics for 3D interaction techniques using methods for multivariate data analysis. Physiological responses, such as heart rate and skin conductance, offer objective data about the user stress during interaction. This could be useful, for instance, to evaluate qualitative aspects of interaction techniques without relying on solely subjective data. Moreover, these data could contribute to improve task performance analysis by measuring different responses to 3D interaction techniques. With this in mind, we propose a methodology that defines a testing protocol, a normalization procedure and statistical techniques, considering the use of physiological measures during the evaluation process. A case study comparison between two 3D interaction techniques (ray-casting and HOMER) shows promising results, pointing to heart rate variability, as measured by the NN50 parameter, as a potential index of task performance. Further studies are needed in order to establish guidelines for evaluation processes based on well-defined associations between human behaviors and human actions realized in 3D user interfaces.


usability metrics physiological measures interaction techniques 


  1. 1.
    American College of Sports Medicine: ACSM’s Advanced Exercise Physiology. Lippincott Williams & Wilkins, Philadelphia (2005)Google Scholar
  2. 2.
    Bisbal, J., Lawless, D., Wu, B., Grimson, J.: Legacy Information Systems: Issues and directions. IEEE Software 16(5), 103–111 (2002)CrossRefGoogle Scholar
  3. 3.
    Bolt, R.A.: “Put-That-There”: Voice and Gesture at the Graphics Interface. In: Proceedings of the 7th Annual Conference on Computer Graphics and Interactive Techniques, pp. 262–270. ACM, New York (1980)Google Scholar
  4. 4.
    Bowman, D.A., Hodges, L.F.: An Evaluation of Techniques for Grabbing and Manipulating Remote Objects in Immersive Virtual Environments. In: Proceedings of the 1997 Symposium on Interactive 3D Graphics, pp. 35–38. ACM, New York (1997)CrossRefGoogle Scholar
  5. 5.
    Bowman, D.A., Gabbard, J.L., Hix, D.: A Survey of Usability Evaluation in Virtual Environments: classification and comparison of methods. Presence: Teleoperators and Virtual Environments 11(4), 404–424 (2002)CrossRefGoogle Scholar
  6. 6.
    Bowman, D.A., Kruijff, E., LaViola, J.J., Poupyrev, I.: 3D User Interfaces: theory and practice. Addison-Wesley, Boston (2004)Google Scholar
  7. 7.
    Brogni, A., Vinayagamoorthy, V., Steed, A., Slater, M.: Variations in Physiological Responses of Participants during Different Stages of an Immersive Virtual Environment Experiment. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, pp. 376–382. ACM, New York (2006)CrossRefGoogle Scholar
  8. 8.
    Brogni, A., Vinayagamoorthy, V., Steed, A., Slater, M.: Responses of Participants during an Immersive Virtual Environment Experience. The International Journal of Virtual Reality 6(2), 1–10 (2007)Google Scholar
  9. 9.
    Combatalade, D.: Basics of Heart Rate Variability Applied to Psychophysiology. Technical report MAR953-00, Thought Technology Ltd. (2010)Google Scholar
  10. 10.
    Cronbach, L.J.: Coefficient Alpha and the Internal Structure of Tests. Psychometrika 16(3), 297–334 (1951)CrossRefGoogle Scholar
  11. 11.
    Guttman, L.: A Basis for Analyzing Test-Retest Reliability. Psychometrika 10(4), 255–282 (1945)MathSciNetMATHCrossRefGoogle Scholar
  12. 12.
    Guyton, A.C., Hall, J.E.: Textbook of Medical Physiology. Saunders, Philadelphia (2005)Google Scholar
  13. 13.
    Hair, J.F., Black, W.C., Babin, B.J., Anderson, R.E.: Multivariate Data Analysis. Prentice Hall, New Jersey (2005)Google Scholar
  14. 14.
    Hix, D., Hartson, H.: Developing User Interfaces: ensuring usability through product & process. John Wiley & Sons, New Jersey (1993)MATHGoogle Scholar
  15. 15.
    Karvonen, M.J., Kentala, E., Mustala, O.: The Effects of Training on Heart Rate: a longitudinal study. Annales Medicinae Experimentalis et Biologiae Fenniae 35(3), 307–315 (1957)Google Scholar
  16. 16.
    Kim, Y.Y., Kim, E.N., Park, M.J., Park, K.S., Ko, H.D., Kim, H.T.: The Application of Biosignal Feedback for Reducing Cybersickness from Exposure to a Virtual Environment. Presence: Teleoperators and Virtual Environments 17(1), 1–16 (2008)CrossRefGoogle Scholar
  17. 17.
    Lin, T., Omata, M., Hu, W., Imamiya, A.: Do physiological data relate to traditional usability indexes? In: Proceedings of the 17th Australia Conference on Computer-Human Interaction, pp. 1–10. Computer-Human Interaction Special Interest Group of Australia, Narrabundah (2005)Google Scholar
  18. 18.
    Lin, T., Imamiya, A., Omata, M., Hu, W.: An Empirical Study of Relationships Between Traditional Usability Indexes and Physiological Data. Australasian Journal of Information Systems 13(2), 105–117 (2006)Google Scholar
  19. 19.
    Lin, T., Imamiya, A.: Evaluating usability based on multimodal information: an empirical study. In: Proceedings of the 8th International Conference on Multimodal Interfaces, pp. 364–371. ACM, New York (2006)CrossRefGoogle Scholar
  20. 20.
    Lin, T., Imamiya, A., Mao, X.: Using Multiple Data Sources to get Closer Insights into User Cost and Task Performance. Interacting with Computers 20(3), 364–374 (2008)CrossRefGoogle Scholar
  21. 21.
    Malhotra, N.K.: Marketing Research: an applied orientation. Prentice Hall, New Jersey (2006)Google Scholar
  22. 22.
    Malik, M., Bigger, J.T., Camm, A.J., Kleiger, R.E., Malliani, A., Moss, A.J., Schwartz, P.J.: Heart Rate Variability: Standards of measurement, physiological interpretation, and clinical use. European Heart Journal 17(3), 354–381 (1996)Google Scholar
  23. 23.
    Meehan, M.F., Insko, B., Whitton, M., Brooks Jr, F.P.: Physiological Measures of Presence in Stressful Virtual Environments. In: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, pp. 645–652. ACM, New York (2002)Google Scholar
  24. 24.
    Meehan, M.F., Razzaque, S., Insko, B., Whitton, M., Brooks Jr, F.P.: Review for Four Studies on the Use of Physiological Reaction as a Measure of Presence in Stressful Virtual Environments. Applied Psychophysiology and Biofeedback 30(3), 239–258 (2005)CrossRefGoogle Scholar
  25. 25.
    Rosson, M., Carroll, J.: Usability Engineering: scenario-based development of human-computer interaction. Morgan Kaufmann, San Francisco (2001)Google Scholar
  26. 26.
    Slater, M., Guger, C., Edlinger, G., Leeb, R., Pfurtscheller, G., Antley, A., Garau, M., Brogni, A., Friedman, D.: Analysis of Physiological Responses to a Social Situation in an Immersive Virtual Environment. Presence: Teleoperators and Virtual Environments 15(5), 553–569 (2006)CrossRefGoogle Scholar
  27. 27.
    Tanaka, H., Monahan, K.D., Seals, D.R.: Age-predicted Maximal Heart Rate Revisited. Journal of the American College of Cardiology 37(1), 153–156 (2001)CrossRefGoogle Scholar
  28. 28.
    Tullis, T., Albert, W.: Measuring the User Experience: collecting, analyzing, and presenting usability metrics. Morgan Kaufmann, San Francisco (2008)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2011

Authors and Affiliations

  • Rafael Rieder
    • 1
    • 2
  • Christian Haag Kristensen
    • 1
  • Márcio Sarroglia Pinho
    • 1
  1. 1.Pontifical Catholic University of Rio Grande do SulPorto AlegreBrazil
  2. 2.University of Passo FundoPasso FundoBrazil

Personalised recommendations