Skip to main content

Augmented Reality Space Informatics System

Part of the Communications in Computer and Information Science book series (CCIS,volume 1294)


The Augmented Reality Space Informatics System (ARSIS) is a Microsoft HoloLens application developed for the NASA SUITS (Spacesuit User Interfaces for Students) challenge that provides an augmented reality (AR) interface for information display and communication to be used by astronauts during extravehicular activity (EVA) procedures. Astronauts are required to deal with complex and changing circumstances on EVA. The current status quo requires heavy reliance on voice communication with Mission Control Centers (MCCs) for everything from biometric data to assistance with procedures. ARSIS is designed with the dual purpose of increasing astronaut autonomy and making communication with MCCs more effective. Features of ARSIS include voice and gaze user interface (UI) navigation, anchored menus, planetary navigation aids, biometric information display, procedure instructions, and a suite of tools for enhanced communication with Mission Control including spatial telestration. User experience (UX) testing results for ARSIS have been generally positive overall, with the biggest takeaway being that users would prefer alternative modes of UI navigation to voice control. Eye tracking for UI navigation is a promising area of exploration in the future.


  • Augmented reality
  • Mixed reality
  • Virtual reality
  • Aerospace
  • Computer supported collaborative work
  • Telestration
  • Telepresence

This is a preview of subscription content, access via your institution.

Buying options

USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-60703-6_28
  • Chapter length: 8 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
USD   109.00
Price excludes VAT (USA)
  • ISBN: 978-3-030-60703-6
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   149.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.
Fig. 3.


  1. Dourish, P.: Where the Action Is. MIT Press, Cambridge (2001)

    CrossRef  Google Scholar 

  2. Wexelblat, A.: Virtual Reality: Applications and Explorations. Academic Press, Cambridge (1993)

    Google Scholar 

  3. NASA EMU Hardware Data Book. Accessed 14 June 2020

  4. NASA General EVA Guidelines. Accessed 14 June 2020

  5. Cometti, C., Païzis, C., Casteleira, A., Pons, G., Babault, N.: Effects of mixed reality head-mounted glasses during 90 minutes of mental and manual tasks on cognitive and physiological functions. PeerJ 6, e5847 (2018)

    CrossRef  Google Scholar 

  6. Leonard, S., Fitzgerald, R.: Holographic learning: a mixed reality trial of Microsoft HoloLens in an Australian secondary school. Res. Learn. Technol. 2160(26), 1–12 (2018)

    Google Scholar 

  7. Former Astronaut Steve Swanson, personal interview

    Google Scholar 

  8. NASA SUITS Challenge Descriptions. Accessed 14 June 2020

  9. Astronauts adopt Mozilla speech tech to control Moon robots. Accessed 14 June 2020

  10. Boudoin, P., Otmane, S., Mallem, M.: Design of a 3D navigation technique supporting VR interaction. In: AIP Conference Proceedings, vol. 1019, no. 1, pp. 149–153 (2008)

    Google Scholar 

  11. Zhu, D., Gedeon, T., Taylor, K.: “Moving to the centre”: a gaze-driven remote camera control teleperation. Interact. Comput. 23(1), 85–95 (2011)

    CrossRef  Google Scholar 

  12. Jarc, A.M., et al.: Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J. Robotic Surg. 10(2), 103–109 (2016).

    CrossRef  Google Scholar 

  13. Kato, H., Billinghurst, M.: Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR), San Francisco, CA, USA, pp. 85–94 (1999)

    Google Scholar 

  14. Arora, R., Kazi, R.H., Anderson, F., Grossman, T., Sign, K., Fitzmaurice, G.: Experimental evaluation of sketching on surfaces in VR. In: Proceedings of the CHI, Denver, CO, USA (2017)

    Google Scholar 

Download references


Special thanks to our faculty advisors, Dr. Karen Doty and Dr. Steve Swanson, as well as our community advisor Charles Burnell.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Olivia Thomas .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Thomas, O., Lambert, D., Dayrit, B. (2020). Augmented Reality Space Informatics System. In: Stephanidis, C., Antona, M., Ntoa, S. (eds) HCI International 2020 – Late Breaking Posters. HCII 2020. Communications in Computer and Information Science, vol 1294. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-60702-9

  • Online ISBN: 978-3-030-60703-6

  • eBook Packages: Computer ScienceComputer Science (R0)