Testing Augmented Reality Systems for Spotting Sub-Surface Impurities

  • Kasper Hald
  • Matthias Rehm
  • Thomas B. Moeslund
Conference paper
Part of the IFIP Advances in Information and Communication Technology book series (IFIPAICT, volume 544)


To limit musculoskeletal disorders we are working towards implementing collaborative robotics in strenuous or repetitive production work. Our objective is to evaluate augmented reality (AR) devices for assisting in near-distance tasks before applying and testing the displays in the context of human-robot collaboration in a production setting. This chapter describes the hardware setup and procedure for testing AR systems for showing sub-surface positions of foreign elements in an opaque mass. The goal is it test four types of setup in terms of user accuracy and speed, the four setups being a head-mounted see-through display, a mounted tablet-based see-through display, top-down surface projection and overlays on a static monitor. The experiment is carried out using a tracked HTC Vive controller with a needle attachment. Precision tasks are performed by 48 participants and each display is evaluated using the System Usability Scale and the NASA Task Load Index.


Augmented reality Usability testing Human-robot collaboration 


  1. 1.
    Avery, B., Sandor, C., Thomas, B.H.: Improving spatial perception for augmented reality X-Ray vision. In: 2009 IEEE Virtual Reality Conference, pp. 79–82. IEEE, March 2009.,
  2. 2.
    Brooke, J., et al.: Sus-a quick and dirty usability scale. Usability Eval. Ind. 189(194), 4–7 (1996)Google Scholar
  3. 3.
    Elia, V., Gnoni, M.G., Lanzilotto, A.: Evaluating the application of augmented reality devices in manufacturing from a process point of view: an AHP based model. Expert Syst. Appl. 63, 187–197 (2016). Scholar
  4. 4.
    Hart, S.G., Staveland, L.E.: Development of NASA-TLX (task load index): results of empirical and theoretical research. In: Advances in Psychology, vol. 52, pp. 139–183. Elsevier (1988)Google Scholar
  5. 5.
    Hayes, B., et al.: HRI workshop on human-robot teaming. In: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts - HRI 2015 Extended Abstracts, pp. 255–256. ACM Press, New York (2015).,
  6. 6.
    Kruijff, E., Swan, J.E., Feiner, S.: Perceptual issues in augmented reality revisited. In: 2010 IEEE International Symposium on Mixed and Augmented Reality, pp. 3–12. IEEE, October 2010.,
  7. 7.
    Punnett, L., Wegman, D.H.: Work-related musculoskeletal disorders: the epidemiologic evidence and the debate. J. Electromyogr. Kinesiol. 14(1), 13–23 (2004). Scholar
  8. 8.
    Schwerdtfeger, B., Pustka, D., Hofhauser, A., Klinker, G.: Using laser projectors for augmented reality. In: Proceedings of the 2008 ACM symposium on Virtual Reality Software and Technology - VRST 2008, p. 134. ACM Press, New York (2008).,
  9. 9.
    Singh, G., Swan, J.E., Jones, J.A., Ellis, S.R.: Depth judgment measures and occluding surfaces in near-field augmented reality. In: Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization - APGV 2010, p. 149. ACM Press, New York (2010).,
  10. 10.
    Swan, J., et al.: A perceptual matching technique for depth judgments in optical, see-through augmented reality. In: IEEE Virtual Reality Conference (VR 2006), pp. 19–26. IEEE.,

Copyright information

© IFIP International Federation for Information Processing 2019

Authors and Affiliations

  • Kasper Hald
    • 1
  • Matthias Rehm
    • 1
  • Thomas B. Moeslund
    • 1
  1. 1.Department of Architecture, Design and Media TechnologyAalborg UniversityAalborgDenmark

Personalised recommendations