Abstract
Designing a user interface for military situation awareness presents challenges for managing information in a useful and usable manner. We present an integrated set of functions for the presentation of and interaction with information for a mobile augmented reality application for military applications. Our research has concentrated on four areas. We filter information based on relevance to the user (in turn based on location), evaluate methods for presenting information that represents entities occluded from the user’s view, enable interaction through a top-down map view metaphor akin to current techniques used in the military, and facilitate collaboration with other mobile users and/or a command center. In addition, we refined the user interface architecture to conform to requirements from subject matter experts. We discuss the lessons learned in our work and directions for future research.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
In keeping with practice for psychophysical experiments, we did not attempt to find domain experts to serve as subjects. Depth perception and relative depth judgments do not require military experience to perceive.
References
Ai Z, Livingston MA (2009) Integration of georegistered information on a virtual globe. In: International symposium on mixed and augmented reality
Avery B, Sandor C, Thomas BH (2009) Improving spatial perception for augmented reality X-ray vision. In: IEEE virtual reality, pp 79–82
Azuma R, Neely III H, Daily M, Leonard J (2006) Performance analysis of an outdoor augmented reality tracking system that relies upon a few mobile beacons. In: International symposium on mixed and augmented reality (ISMAR), pp 101–104
Bajura M, Fuchs H, Ohbuchi R (1992) Merging virtual objects with the real world: seeing ultrasound imagery within the patient. In: Computer graphics (SIGGRAPH ’ 92 proceedings), vol 26, pp 203–210
Bane R, Höllerer T (2004) Interactive tools for virtual x-ray vision in mobile augmented reality. In: International Symposium on Mixed and Augmented Reality, pp 231–239
Benford S, Fahlen L (1993) A spatial model of interaction in large virtual environments. In: Proceedings of ECSCW’93
Bolstad CA, Endsley MR (2002) Tools for supporting team sa and collaboration in army operations. Technical report, SA Technologies
Cutting J (2003) Reconceiving perceptual space. In: Perceiving pictures: an interdisciplinary approach to pictorial space. MIT Press, Cambrdige, pp 215–238
DISA Standards Management Branch (2008) Department of defense interface standard: common warfighting symbology. http://assist.daps.dla.mil/quicksearch/basic_profile.cfm?ident_number=114934
Feiner S, Seligmann D (1992) Cutaways and ghosting: satisfying visibility constraints in dynamic 3D illustrations. Vis Comput 8(5–6):292–302
Feiner S, MacIntyre B, Höllerer T, Webster A (1997) A touring machine: prototyping 3D mobile augmented reality systems for exploring the urban environment. In: First international symposium on wearable computing (ISWC), pp 74–81
Furness III LTA (1969) The application of head-mounted displays to airborne reconnaissance and weapon delivery. In: Proceedings of symposium for image display and recording, US Air Force Avionics Laboratory, Wright-Patterson AFB, OH
Höllerer T, Feiner S, Terauchi T, Rashid G, Hallaway D (1999) Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system. Comput Graph 23(6):779–785
Julier S, Lanzagorta M, Baillot Y, Brown D (2002) Information filtering for mobile augmented reality. IEEE Comput Graph Appl 22(5):12–15
Julier SJ, Livingston MA, Swan II JE, Baillot Y, Brown D (2003) Adaptive user interfaces in augmented reality. In: Workshop on software technology for augmented reality systems (STARS)
Livingston MA, Swan II JE, Gabbard JL, Höllerer TH, Hix D, Julier SJ, Baillot Y, Brown D (2003) Resolving multiple occluded layers in augmented reality. In: IEEE and ACM international symposium on mixed and augmented reality (ISMAR 2003), pp 56–65
Livingston MA, Brown D, Julier SJ, Schmidt GS (2006) Military applications of augmented reality. In: NATO human factors and medicine panel workshop on virtual media for military applications
Piekarski W, Thomas BH (2002) The tinmith system—demonstrating new techniques for mobile augmented reality modelling. In: 3rd Australasian user interfaces conference, pp 61–70
Sandor C, Klinker G (2007) Lessons learned in designing ubiquitous augmented reality user interfaces. In: Emerging technologies of augmented reality: interfaces and design, chap XI. Idea Group Publishing, Hershey
Tsuda T, Yamamoto H, Kameda Y, Ohta Y (2006) Visualization methods for outdoor see-through vision. IEICE Trans Inf Syst E E89-D(6):1781–1789
Acknowledgments
This work was supported in part by the NRL Base Program and in part by DARPA under the ULTRA-Vis Program for work as a performing member of the Lockheed Martin team, contract # FA8650-09-C-7908.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Livingston, M.A., Ai, Z., Karsch, K. et al. User interface design for military AR applications. Virtual Reality 15, 175–184 (2011). https://doi.org/10.1007/s10055-010-0179-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-010-0179-1