Using Visualizations to Support Design and Debugging in Virtual Reality

  • Cara Winterbottom
  • Edwin Blake
  • James Gain
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4291)


We present a visualization system that helps designers conceptualise interactions in a virtual environment (VE). We use event-condition-action triads (triggersets) for specifying interactions, and provide multiple visualizations: sequence diagrams, floorplans and timelines. We present a two part study: sequencing VE interactions accurately and debugging mistakes. Subjects were divided into two groups: one received visualizations and triggersets and the other (a control group) received triggersets only. The visualization group described 72.5% of the sequence correctly on average, compared to 56.4% by the non-visualization group. The visualization group also detected more than twice as many errors as the control group. The visualization group worked well with multiple, linked windows to create an understanding of the design. Floorplans were most useful for an overview, timelines for understanding specific sequences and sequence diagrams for sequencing and finding mistakes.


Virtual Reality Virtual Environment Sequence Diagram Information Visualization Support Design 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Blackwell, A.F., Whitley, K.N., Good, J., Petre, M.: Cognitive factors in programming with diagrams. Artificial Intelligence Review 15, 95–113 (2001)MATHCrossRefGoogle Scholar
  2. 2.
    Card, S., Mackinlay, J., Shneiderman, B.E.: Readings in Information Visualization: Using Vision to Think. Morgan Kaufmann Publishers, San Francisco (1999)Google Scholar
  3. 3.
    Shu, N.C.: Visual Programming. Van Nostrand Reinhold Company, New York (1988)Google Scholar
  4. 4.
    van Wijk, J.: The value of visualization. In: Silva, C., Groeller, E., Rushmeier, H. (eds.) Proceedings of IEEE Visualization, pp. 79–86. IEEE, Los Alamitos (2005)Google Scholar
  5. 5.
    Romero, P., Cox, R., du Boulay, R., Lutz, R.: A survey of external representations employed in object-oriented programming environments. Journal of Visual Languages and Computing 14, 387–419 (2003)CrossRefGoogle Scholar
  6. 6.
    Myers, B.: Taxonomies of visual programming and program visualization. Journal of Visual Languages and Computing 1, 97–123 (1990)CrossRefGoogle Scholar
  7. 7.
    Ko, A., Myers, B.: Designing the whyline: A debugging interface for asking questions about program behaviour. In: Proceedings of CHI 2004, pp. 151–158 (2004)Google Scholar
  8. 8.
    Kavakli, M., Suwa, M., Gero, J., Purcell, T.: Sketching interpretation in novice and expert designers. In: Gero, J., Tversky, B. (eds.) Visual and Spatial Reasoning in Design, Australia, pp. 209–220. Key Centre of Design Computing and Cognition (1999)Google Scholar
  9. 9.
    Eastman, C.: New directions in design cognition: studies of representation and recall. In: Eastman, C., McCracken, M., Newsletter, W. (eds.) Design Knowing and Learning: Cognition in Design Education, Elsevier Science, Amsterdam (2000)Google Scholar
  10. 10.
    Petre, M., Blackwell, A.: Mental imagery in program design and visual programming. International Journal of Human-Computer Studies 51, 7–30 (1999)CrossRefGoogle Scholar
  11. 11.
    Baldonado, M., Woodruff, A., Kuchinsky, A.: Guidelines for using multiple views in information visualization. In: Proceedings of AVI, ACM Press, New York (2000)Google Scholar
  12. 12.
    Harada, K., Tanaka, E., Ogawa, R., Hara, Y.: Anecdote: A multimedia storyboarding system with seamless authoring support. In: ACM Multimedia, pp. 341–351. ACM Press, New York (1996)Google Scholar
  13. 13.
    Coleburne, A., Rodden, T., Palfreyman, K.: VR-MOG: A toolkit for building shared virtual worlds. In: Slater, M. (ed.) Proceedings of FIVE (Framework for immersive virtual environments) Working Group Conference, pp. 109–122 (1995)Google Scholar
  14. 14.
    Tufte, E.R.: The Visual Display of Quantitative Information. Graphics Press, Cheshire (1983)Google Scholar
  15. 15.
    Harel, D.: On visual formalisms. Communications of the ACM 31, 514–530 (1988)CrossRefMathSciNetGoogle Scholar
  16. 16.
    Banister, P., Burman, E., Parker, I., Taylor, M., Tindall, C.: Qualitative Methods in Psychology: A Research Guide. Open University Press, Buckingham (1994)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Cara Winterbottom
    • 1
  • Edwin Blake
    • 1
  • James Gain
    • 1
  1. 1.Collaborative Visual Computing Laboratory, Department of Computer ScienceUniversity of Cape TownRondeboschSouth Africa

Personalised recommendations