Abstract
Information-rich virtual environments (IRVEs) have been described as environments in which perceptual information is enhanced with abstract (or symbolic) information, such as text, numbers, images, audio, video, or hyperlinked resources. Desktop virtual environment (VE) applications present similar information design and layout challenges as immersive VEs, but, in addition, they may also be integrated with external windows or frames commonly used in desktop interfaces. This paper enumerates design approaches for the display of enhancing information both internal and external to the virtual world’s render volume. Using standard Web-based software frameworks, we explore a number of implicit and explicit spatial layout methods for the display and linking of abstract information, especially text. Within the VE view, we demonstrate both heads-up-displays (HUDs) and encapsulated scenegraph behaviors we call semantic objects. For desktop displays, which support information display venues external to the scene, we demonstrate the linking and integration of the scene with Web browsers and external visualization applications. Finally, we describe the application of these techniques in the PathSim visualizer, an IRVE interface for the biomedical domain. These design techniques are relevant to instructional and informative interfaces for a wide variety of VE applications.
Similar content being viewed by others
References
Baldonado M, Woodruff A, Kuchinsky A (2000) Guidelines for using multiple views in information visualization. In: Proceedings of the conference on advanced visual interfaces (AVI2000), Palermo, Italy, May 2000
Bederson BB, Hollan JD, Perlin K, Meyer J, David B, Furnas G (1996) Pad++: a zoomable graphical sketchpad for exploring alternate interface physics. J Visual Lang Comput 7(1):3–32
Bertin J (1981) Berg W, Scott P (trans) Graphics and graphic information processing. Walter de Gruyter, Berlin New York
Bowman D, North C, Chen J, Polys N, Pyla P, Yilmaz U (2003) Information-rich virtual environments: theory, tools, and research agenda. In: Proceedings of the conference on virtual reality software and technology (VRST2003), Osaka, Japan, October 2003
Card S, Mackinlay J, Shneiderman B (1999) Information visualization: using vision to think. Morgan Kaufmann, San Francisco
Chen J, Pyla P, Bowman D (2004) Testbed evaluation of navigation and text display techniques in an information-rich virtual environment. In: Proceedings of the IEEE VR 2004 conference, Chicago, Illinois, March 2004
Convertino G, Chen J, Yost B, Young-Sam R, North C (2003) Exploring context switching and cognition in dual-view coordinated visualizations. In: Proceedings of the international conference on coordinated and multiple views in exploratory visualization (CMV2003), London, UK, July 2003, 15:57–66
Duca K, Laubenbacher R (2003) PathSim. Virginia Bioinformatics Institute, http://www.vbi.vt.edu/~pathsim
Fauconnier G (1997) Mappings in thought and language. Cambridge University Press, Cambridge
Feiner S, Macintyre B, Haupt M, Solomon E (1993) Windows on the world: 2D windows for 3D augmented reality. In: Proceedings of the 6th ACM symposium on user interface software and technology (UIST1993), Atlanta, Georgia, November 1993, pp 145–155
Friedhoff R, Peercy Mark (2000) Visual computing. Scientific American Library, New York
Furnas GW (1981) The FISHEYE view: a new look at structured files. AT&T Bell Laboratories, Murray Hill, New Jersey
Furnas GW (1986) Generalized Fisheye views: visualizing complex information spaces. In: Proceedings of the ACM conference on human factors in computing systems (CHI’86), Boston, Massachusetts, April 1986, pp 16–23
Goguen J (2000) Information visualizations and semiotic morphisms. University of California, San Diego, http://citeseer.ist.psu.edu/goguen00information.html
Keller PR (1993) Visual cues: practical data visualization. IEEE Computer Society Press, Los Alamitos, California
Norman DA (1986) Cognitive engineering. In: Norman DA, Draper SD (eds) User centered system design: new perspectives on human–computer interaction. Lawrence Erlbaum Associates, Hillsdale, New Jersey, pp 31–61
North C (2001) Multiple views and tight coupling in visualization: a language, taxonomy, and system. In: Proceedings of the CSREA CISST 2001 workshop of fundamental issues in visualization, June 2001 pp 626–632
North C, Shneiderman B (2000) Snap-together visualization: can users construct and operate coordinated views? Int J Hum Comput St 53(5):715–739
Perkins D (2000) Archimedes’ bathtub. Norton, New York
Pickett RM, Grinstein G, Levkowitz H, Smith S (1995) Harnessing preattentive processes in visualization. In: Grinstein G, Levkoitz H (eds) Perceptual issues in visualization. Springer, Berlin Heidelberg New York
Polys, NF (2003) The VirtuPortal: opening new dimensions on the Web,http://www.3DeZ.net
Polys N, North C, Bowman D, Ray A, Moldenhauer M, Dandekar C (2004a) Snap2Diverse: coordinating information visualizations and virtual environments. In: Proceedings of the SPIE conference on visualization and data analysis (VDA2004), San Jose, California, January 2004
Polys N, Bowman D, North C, Laubenbacher R, Duca K (2004b) PathSim visualizer: an information-rich virtual environment for systems biology. In: Proceedings of the 9th international conference on 3D Web technology (Web3D2004), Monterey, California, April 2004
Reynolds CW (1987) Flocks, herds, and schools: a distributed behavioral model. Computer Graphics (SIGGRAPH 1987) 21(4):25–34
Salzman MC, Dede C, Bowen LR, Chen J (1999) A model for understanding how virtual reality aids complex conceptual learning. Presence-Teleop Virt 8(3):293–316
Shneiderman B (1996) The eyes have it: a task by data type taxonomy for information visualizations. In: Proceedings of the IEEE symposium on Visual Languages, Boulder, Colorado, September 1996, pp 336–343
Stroop J (1935) Studies of interference in serial verbal reactions. J Exp Psychol 18:643–662
Sutcliffe A, Faraday P (1994) Designing presentation in multimedia interfaces. In: Proceedings of the ACM conference on computer–human interaction, Boston, Massachusetts
Tufte E (1990) Envisioning information. Graphics Press, Cheshire, Connecticut
Vanderdonckt J, Gillo X (1994) Visual techniques for traditional and multimedia layouts. In: Proceedings of the ACM conference on advanced visual interfaces, Bari, Italy
Ware C (2003) Design as applied perception. In: Carrol JM (ed) HCI models, theories, and frameworks: towards a multidisciplinary science. Morgan Kaufmann, San Francisco, California
Watzman S (2002) Visual design principles for usable interfaces. In: Stanney K (ed) Computer interaction handbook: design, implementations, and applications. Lawrence Erlbaum Associates, Mahwah, New Jersey
Web3D Consortium (2004) Specifications: http://www.web3d.org/fs_specifications.htm
Acknowledgements
The authors would like to thank members of the 3D Interaction Group at Virginia Tech’s Center for Human Computer Interaction for their review of and input to this manuscript, especially Chad Wingrave and Jian Chen. In addition, the people involved with the PathSim project: Dr. Karen Duca, Dr. Reinhard Laubenbacher and their research team at the Virginia Bioinformatics Institute: Jignesh Shah, Rohan Luktuke, and John McGee. All screenshots are captured from a Windows desktop using the ParallelGraphics Cortona VRML plugin with Internet Explorer (http://www.parallelgraphics.com). All trademarks are the property of their owners.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Polys, N.F., Bowman, D.A. Design and display of enhancing information in desktop information-rich virtual environments: challenges and techniques. Virtual Reality 8, 41–54 (2004). https://doi.org/10.1007/s10055-004-0134-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-004-0134-0