Skip to main content

An Augmented Reality Command and Control Sand Table Visualization of the User Interface Prototyping Toolkit (UIPT)

  • Conference paper
  • First Online:
HCI International 2020 – Late Breaking Papers: Virtual and Augmented Reality (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12428))

Included in the following conference series:

  • 1018 Accesses

Abstract

The User Interface Prototyping Toolkit (UIPT) constitutes a software application for the design and development of futuristic stylized user interfaces (UIs) for collaborative exploration and validation with regards to decision making and situational awareness by end users. The UIPT toolkit effort is targeted to Command, Control, Communications, Computers, Intelligence, Surveillance and Reconnaissance (C4ISR) and Cyber missions for the U.S. Navy. UIPT enables the Navy to significantly reduce the risks associated with pursuing revolutionary technology such as autonomous vehicles, artificial intelligence and distributed sensing in terms of the design of the user interface. With this in mind, augmented reality is examined to determine if this technology can be useful to the Navy’s mission in supporting the warfighter in the future vision of the Navy. This work examines the development and evaluation of an augmented reality virtual sand table presentation overlaid over the same set of information presented in the UIPT displayed on a large touch table. This new way to present the same information allows for a unique collaborative setting to be evaluated as a potential future user interface for the Navy. This is applied in the context where a group of warfighters gather in collaborative virtual space for decision making and situational awareness. The development and experimentation with an augmented reality interface initiates the means to validate a futuristic Navy vision of user interfaces that support the warfighter in a Command and Control environment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Van Orden, K.F., Gutzwiller, R.S.: Making user centered design a cornerstone for navy systems. In: Proceedings, vol. 144, pp. 10–1388, October 2018

    Google Scholar 

  2. Campbell, N., Osga, G., Kellmeyer, D., Lulue, D., Williams, E.: A human-computer interface vision for naval transformation. In: Space and Naval Warfare Center Technical Document, vol. 3183, June 2013

    Google Scholar 

  3. Osga, G.: Building goal-explicit work interface systems. In: Human Systems Integration Symposium, Tysons Corner, VA, June 2003

    Google Scholar 

  4. Goldman, K.H., Gonzalez, J.: Open exhibits multitouch table use finding. In: Ideum Open Exhibits Papers, July 2014

    Google Scholar 

  5. Hinckley, K., Guimbretiere, F., Agrawala, G., Apitz, G., Chen, N..: Phrasing techniques for multi-stroke selection gestures. In: Ideum Open Exhibits Papers (2006)

    Google Scholar 

  6. Schoning. F., Steomocle. F., Kruger, A., Hinrichs, K.: Interscopic multi-touch surfaces: using bimanual interactive for intuitive manipulation of spatial data. In: Ideum Open Exhibits Papers (2009)

    Google Scholar 

  7. Cossairt, O., Nayar, S., Ramamoorthi, R.: Light field transfer: global illumination between real and synthetic objects. ACM Trans. Graph. 27(3), 1–6 (2008). https://doi.org/10.1145/1360612.1360656

    Article  Google Scholar 

  8. Agusanto, K., Li, L., Chuangui, Z., Sing, N.W.: Photorealistic rendering for augmented reality using environment illumination. In: Proceedings of the 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2003) (2003). https://doi.org/10.1109/ismar.2003.1240704

  9. Guo, X., Wang, C., Qi, Y.: Real-time augmented reality with occlusion handling based on RGBD images. In: 2017 International Conference on Virtual Reality and Visualization (ICVRV 2017) (2017). https://doi.org/10.1109/icvrv.2017.00069

  10. Lira dos Santos, A., Lemos, D., Falcao Lindoso, J.E., Teichrieb, V.: Real time ray tracing for augmented reality. In: 2012 14th Symposium on Virtual and Augmented Reality (2012). https://doi.org/10.1109/svr.2012.8

  11. Next-Generation Threat System (NGTS): Published by NAVAIRSYSCOM on December 9th 2014

    Google Scholar 

  12. Unity. https://unity3d.com

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Bryan Croft , Jeffrey D. Clarkson , Eric Voncolln , Alex Campos , Scott Patten or Richard Roots .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Croft, B., Clarkson, J.D., Voncolln, E., Campos, A., Patten, S., Roots, R. (2020). An Augmented Reality Command and Control Sand Table Visualization of the User Interface Prototyping Toolkit (UIPT). In: Stephanidis, C., Chen, J.Y.C., Fragomeni, G. (eds) HCI International 2020 – Late Breaking Papers: Virtual and Augmented Reality. HCII 2020. Lecture Notes in Computer Science(), vol 12428. Springer, Cham. https://doi.org/10.1007/978-3-030-59990-4_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-59990-4_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-59989-8

  • Online ISBN: 978-3-030-59990-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics