Virtual Reality

, Volume 14, Issue 1, pp 43–53

Measuring presence with verbal versus pictorial scales: a comparison between online- and ex post-ratings

  • Bartholomäus Wissmath
  • David Weibel
  • Fred W. Mast
Original Article

Abstract

In this study, we compare subjective online- and post-immersion measures. Although its relevance appears obvious from a theoretical and applied research perspective, this question has not yet been addressed in previous studies. In addition, we also compare verbally and pictorially anchored scales. These factors were measured in different contents using a 2 × 2 × 2 design. We manipulated time of measure (online vs. ex post), type of measure (verbal vs. visual), and content (language vs. language-free). Participants (N = 162) evaluated two video clips in terms of presence. No differences between averaged online- and post-immersion measures were found and online judgments did not interfere with the sensation of presence. In line with findings from other areas of research, the use of pictorially anchored items has major advantages. Our results suggest that those items require less mental workload and assess the sensation of presence more directly than verbally anchored items. We discuss the theoretical implications of our findings.

Keywords

Presence Online measurement Post-rating Verbal measures Pictorial measures SAM 

References

  1. Baddeley AD (2000) Short-term and working memory. In: Tulving E, Craik FMI (eds) The Oxford handbook of memory. Oxford University Press, New York, pp 77–92Google Scholar
  2. Bracken CC (2005) Presence and image quality: the case of high definition television. Media Psychol 7:191–205CrossRefGoogle Scholar
  3. Bradley MM, Lang PJ (1994) Measuring emotion: the self-assessment manikin and the semantic differential. J Behav Ther Exp Psy 25:49–59CrossRefGoogle Scholar
  4. Campell DT, Fiske DW (1959) Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol Bull 56:81–105CrossRefGoogle Scholar
  5. Draper JV, Kaber DB, Usher JM (1998) Telepresence. Hum Factors 40(3):354–375CrossRefGoogle Scholar
  6. Freeman J, Avons S, Meddis R, Pearson D, IJsselsteijn W (2000) Using behavioural realism to estimate presence: a study of the utility of postural responses to motion stimuli. Presence Teleop Virt 9:149–164CrossRefGoogle Scholar
  7. Greenwald MK, Cook EW, Lang PJ (1989) Affective judgement and psychophysiological response: dimensional covariation in the evaluation of pictorial stimuli. J Psychophysiol 3:51–64Google Scholar
  8. Heeter C (1992) Being there: the subjective experience of presence. Presence Teleop Virt 1:262–271Google Scholar
  9. Hendrix C, Barfield W (1996) Presence within virtual environments as a function of visual display parameters. Presence Teleop Virt 5:274–289Google Scholar
  10. IJsselsteijn WA, De Ridder H, Hamberg R, Bouwhuis D, Freeman J (1998) Perceived depth and the feeling of presence in 3DTV. Displays 18:207–214CrossRefGoogle Scholar
  11. IJsselsteijn WA, De Ridder H, Freeman J, Avons SE (2000) Presence: concept, determinants and measurement. Proc SPIE 3959:520–529CrossRefGoogle Scholar
  12. Insko B (2003) Measuring presence: subjective, behavioral and physiological methods. In: Riva G, Davide F, IJsselsteijn WA (eds) Being there: concepts, effects, and measurement of user presence in synthetic environments. Ios Press, Amsterdam, pp 211–222Google Scholar
  13. Jex H (1988) Measuring mental workload: problems, progress, and promises. In: Hancock PA, Meshkati, N (eds) Human mental workload. Elsevier, North-Holland, pp 5–39Google Scholar
  14. Kim T, Biocca F (1997) Telepresence via television: two dimensions of telepresence may have different connections on memory and persuasion. J Comput Mediat Comm 3(2). Available at http://jcmc.indiana.edu/vol3/issue2/kim.html. Accessed 14 Aug 2005
  15. Lang P (1985) The cognitive psychophysiology of emotion: anxiety and the anxiety disorders. Lawrance Erlbaum, HillsdaleGoogle Scholar
  16. Lang A (2000) Self assessment Manikin (SAM) measure. Available at http://www.temple.edu/ispr/frame_measure_t.htm. Accessed 11 Oct 2002
  17. Lang PJ, Greenwald MK, Bradley MM, Hamm AO (1993) Looking at pictures: affective, facial, visceral and behavioural reactions. Psychophysiology 30:261–273CrossRefGoogle Scholar
  18. Lavie N (2005) Distracted and confused? Selective attention under load. Trends Cogn Sci 9:75–82CrossRefGoogle Scholar
  19. Lavie N, Cox S (1997) On the efficiency of attentional selection: efficient visual search results in inefficient rejection of distraction. Psy Sci 8:395–398CrossRefGoogle Scholar
  20. Lombard M (2005) Temple presence inventory (TPI) questionnaire items and factor structures. Available at http://astro.temple.edu/~lombard/research/P2qstnre.doc. Accessed 08 Sep 2008
  21. Lombard M (2008) Presence and telepresence scholarship: challenges ahead. Keynote presentation at When Media Environments Become Real (WMEBR). University of Bern, SwitzerlandGoogle Scholar
  22. Lombard M, Ditton TB (1997) At the heart of it all: The concept of presence. J Comput-Mediat Comm 3(2). Available at http://jcmc.indiana.edu/vol3/issue2/lombard.html. Accessed 30 Jul 2000
  23. Lombard M, Reich RD, Grabe ME, Bracken CC, Ditton TB (2000) Presence and television: the role of screen size. Hum Comm Res 26(1):75–98Google Scholar
  24. McCulloch CE, Searle SR (2000) Generalized, linear, and mixed models. Wiley, New YorkCrossRefGoogle Scholar
  25. Minsky M (1980) Telepresence. Omni 2(9):45–51Google Scholar
  26. Sadowsky W, Stanney K (2002) Measuring and managing presence in virtual environments. In: Stanney KM (ed) Handbook of virtual environments technology. Lawrence Erlbaum Associates, HillsdaleGoogle Scholar
  27. Schloerb DW (1995) A quantitative measure of telepresence. Presence Teleop Virt 4:64–80Google Scholar
  28. Schneider EF, Lang A, Shin M, Bradley SD (2004) Death with a story: how story impacts emotional, motivational, and physiological responses to first-person shooter video games. Hum Comm Res 30:361–375Google Scholar
  29. Sheridan T (1992) Musings on telepresence and virtual presence. Presence Teleop Virt 1:120–126Google Scholar
  30. Slater M (1999) Measuring presence: a response to the Witmer and Singer questionnaire. Presence Teleop Virt 8:560–566CrossRefGoogle Scholar
  31. Slater M (2004) How colorful was your day? Why questionnaires cannot assess presence in virtual environments. Presence Teleop Virt 13:484–493CrossRefGoogle Scholar
  32. Slater M, Garau M (2007) The use of questionnaire data in presence studies: do not seriously Likert. Presence Teleop Virt 16:447–456CrossRefGoogle Scholar
  33. Slater M, Wilbur S (1997) A framework for immersive virtual environments (FIVE): speculations on the role of presence in virtual environments. Presence Teleop Virt 6:603–616Google Scholar
  34. Snow MP, Williges RC (1998) Empirical models based on free-modulus magnitude estimation of perceived presence in virtual environments. Hum Factors 40:386–402CrossRefGoogle Scholar
  35. Sternberg RJ (2000) Implicit theories of intelligence as exemplar stories of success: why intelligence test validity is in the eye of the beholder. Psychol Public Pol L 6:159–167CrossRefGoogle Scholar
  36. Steuer J (1992) Defining virtual reality: dimensions determining telepresence. J Comm 42:72–92Google Scholar
  37. Szalma JL, Warm JS, Matthews G, Dember WN, Weiler EM, Meier A, Eggemeier FT (2004) Effects of sensory modality and task duration on performance, workload, and stress in sustained attention. Hum Factors 46:219–233CrossRefGoogle Scholar
  38. van Baren J, IJsselsteijn WA (2004) Measuring presence: a guide to current measurement approaches. IST-FET OMNIPRES project, deliverable 5. Available at: http://www.informatik.umu.se/~jwworth/PresenceMeasurement.pdf. Accessed 11 Nov 2008
  39. Welch RB (1997) The presence of aftereffects. In: Salvendy G, Smith MJ, Koubek RJ (eds) Designs of computing systems: cognitive considerations. Elsevier, Amsterdam, pp 271–276Google Scholar
  40. Welch RB, Blackmon TT, Liu A, Mellers BA, Stark LW (1996) The effects of pictorial realism, delay of visual feedback, and observer interactivity on the subjective sense of presence. Presence Teleop Virt 5:263–273Google Scholar
  41. Wirth W, Hartmann T, Böcking S, Vorderer P, Klimmt C, Schramm H et al (2007) A process model of the formation of spatial presence experiences. Media Psychol 9:493–525Google Scholar
  42. Witmer B, Singer M (1998) Measuring presence in virtual environments: a presence questionnaire. Presence Teleop Virt 7:225–240CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London Limited 2009

Authors and Affiliations

  • Bartholomäus Wissmath
    • 1
    • 2
  • David Weibel
    • 1
    • 2
  • Fred W. Mast
    • 1
  1. 1.Department of PsychologyUniversity of BernBern 9Switzerland
  2. 2.Swiss Universitary Institute of Distance EducationBrigSwitzerland

Personalised recommendations