Skip to main content
SpringerLink
Log in
Book cover

Recent Trends of Mobile Collaborative Augmented Reality Systems pp 69–82Cite as

Design Recommendations for Augmented Reality based Training of Maintenance Skills

  • Conference paper
  • First Online:

Abstract

Training for service technicians in maintenance tasks is a classical ­application field of Augmented Reality explored by different research groups. Mostly technical aspects (tracking, visualization etc.) have been in focus of this research field. In this chapter we present results of interdisciplinary research based on the fusion of cognitive science, psychology and computer science. We focus on analyzing the improvement of Augmented Reality based training of skills which are relevant for maintenance and assembly tasks. The skills considered in this work comprise sensorimotor skills as well as cognitive skills. Different experiments have been conducted in order to find recommendations for the design of Augmented Reality training systems which overcome problems of existing approaches. The suggestions concern the fields of content visualization and multimodal feedback.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. M. Agrawala, D. Phan, J. Heiser, J. Haymaker, J. Klingner, P. Hanrahan, and B. Tversky. Designing effective step-by-step assembly instructions. ACM Trans. Graph., 22(3):828–837, 2003.

    Article  Google Scholar 

  2. A. Antolí, J. F. Quesada, F. D. Psicología, J. J. Cañas, and J. J. Cañas. The role of working memory on measuring mental models of physical systems. In Psicológica, volume 22, pages 25–42, 2001.

    Google Scholar 

  3. T. Blum, S. M. Heining, O. Kutter, and N. Navab. Advanced training methods using an augmented reality ultrasound simulator. In ISMAR ’09: Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality, pages 177–178, Washington, DC, USA, 2009. IEEE Computer Society.

    Google Scholar 

  4. D. G. Brown, J. T. Coyne, and R. Stripling. Augmented reality for urban skills training. In VR ’06: Proceedings of the IEEE conference on Virtual Reality, pages 249–252, Washington, DC, USA, 2006. IEEE Computer Society.

    Google Scholar 

  5. R. M. Fein, G. M. Olson, and J. S. Olson. A mental model can help with learning to operate a complex device. In CHI ’93: INTERACT ’93 and CHI ’93 conference companion on Human factors in computing systems, pages 157–158, New York, NY, USA, 1993. ACM.

    Google Scholar 

  6. D. Feygin, M. Keehner, and F. Tendick. Haptic guidance: Experimental evaluation of a haptic training method for a perceptual motor skill. In HAPTICS ’02: Proceedings of the 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, page 40, Washington, DC, USA, 2002. IEEE Computer Society.

    Google Scholar 

  7. N. Gavish and E. Yechiam. The disadvantageous but appealing use of visual guidance in procedural skills training. Proceedings of the Applied Human Factors and Ergonomics Conference (AHFE) ’10, 2010.

    Google Scholar 

  8. C. Ke, B. Kang, D. Chen, and X. Li. An augmented reality-based application for equipment maintenance. In ACII, pages 836–841, 2005.

    Google Scholar 

  9. D. Kieras. What mental model should be taught: Choosing instructional content for complex engineered systems. In Intelligent tutoring systems: Lessons learned, Lawrence Erlbaum, pages 85–111. Psotka, J., Massey, L.D., Mutter, S. (Eds.), 1988.

    Google Scholar 

  10. M. A. Livingston and Z. Ai. The effect of registration error on tracking distant augmented objects. In ISMAR ’08: Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pages 77–86, Washington, DC, USA, 2008. IEEE Computer Society.

    Google Scholar 

  11. L. Novick and D. Morse. Folding a fish, making a mushroom: The role of diagrams in executing assembly procedures. Memory & Cognition, 28(7):1242–1256, 2000.

    Article  Google Scholar 

  12. A. Olwal, J. Gustafsson, and C. Lindfors. Spatial augmented reality on industrial CNC-machines. In Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, volume 6804 of Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, Feb. 2008.

    Google Scholar 

  13. K. Pentenrieder and P. Meier. The need for accuracy statements in industrial Augmented Reality applications. In Proc. ISMAR Workshop: Industrial Augmented Reality, Santa Barbara, CA, USA, October 2006.

    Google Scholar 

  14. D. Reiners, D. Stricker, G. Klinker, and S. Müller. Augmented reality for construction tasks: Doorlock assembly. In Proc. IEEE and ACM IWAR98 (1st Int. Workshop on Augmented Reality, pages 31–46. AK Peters, 1998.

    Google Scholar 

  15. P. Rhienmora, K. Gajananan, P. Haddawy, S. Suebnukarn, M. N. Dailey, E. Supataratarn, and P. Shrestha. Haptic augmented reality dental trainer with automatic performance assessment. In IUI ’10: Proceeding of the 14th international conference on Intelligent user interfaces, pages 425–426, New York, NY, USA, 2010. ACM.

    Google Scholar 

  16. C. Robertson, B. MacIntyre, and B. Walker. An evaluation of graphical context when the graphics are outside of the task area. In Mixed and Augmented Reality, 2008. ISMAR 2008. 7th IEEE/ACM International Symposium on, pages 73–76, 15-18 2008.

    Google Scholar 

  17. C. M. Robertson, B. MacIntyre, and B. N. Walker. An evaluation of graphical context as a means for ameliorating the effects of registration error. IEEE Trans. Vis. Comput. Graph., 15(2):179–192, 2009.

    Article  Google Scholar 

  18. T. Salonen, J. Sääski, M. Hakkarainen, T. Kannetis, M. Perakakis, S. Siltanen, A. Potamianos, O. Korkalo, and C. Woodward. Demonstration of assembly work using augmented reality. In CIVR ’07: Proceedings of the 6th ACM international conference on Image and video retrieval, pages 120–123, New York, NY, USA, 2007. ACM.

    Google Scholar 

  19. S. Schätzle, T. Ende, T. Wüsthoff, and C. Preusche. VibroTac: An ergonomic and versatile usable vibrotactile feedback device. In RO-MAN ’10: 19th IEEE International Symposium on Robot and Human Interactive Communication, Principe di Piemonte - Viareggio, Italy, 2010. IEEE Computer Society.

    Google Scholar 

  20. B. Schwald, B. D. Laval, T. O. Sa, and R. Guynemer. An augmented reality system for training and assistance to maintenance in the industrial context. In The 11th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision 03, Plzen, Czech Republic, pages 425–432, 2003.

    Google Scholar 

  21. N. A. Taatgen, D. Huss, D. Dickison, and J. R. Anderson. The acquisition of robust and flexible cognitive skills. Journal of Experimental Psychology: General, 137(3):548–565, 2008.

    Article  Google Scholar 

  22. S. B. Thrun. Efficient exploration in reinforcement learning. Technical report, 1992.

    Google Scholar 

  23. J. Tümler, F. Doil, R. Mecke, G. Paul, M. Schenk, E. A. Pfister, A. Huckauf, I. Bockelmann, and A. Roggentin. Mobile augmented reality in industrial applications: Approaches for solution of user-related issues. In ISMAR ’08: Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pages 87–90, Washington, DC, USA, 2008. IEEE Computer Society.

    Google Scholar 

  24. J. Weidenhausen, C. Knoepfle, and S. D. Lessons learned on the way to industrial augmented reality applications, a retrospective on arvika. Computers and Graphics, 27:887–891(5), 2003.

    Google Scholar 

Download references

Acknowledgements

The presented results have been developed within the context of the European project SKILLS, that deals with the exploration of multimodal interfaces for capturing and transfer of human skills. We thank TECHNION (Israel Institute of Technology) for their experiments and contributions about important cognitive aspects. Furthermore, we thank DLR (German Aerospace Center) for developing and providing the vibrotactile bracelet and LABEIN Tecnalia and PERCRO (Perceptual Robotics Laboratory) for pushing the idea of this work and their contributions.

Author information

Authors and Affiliations

  1. Fraunhofer Institute for Computer Graphics Research IGD, Fraunhoferstr. 5, 64283, Darmstadt, Germany

    Sabine Webel, Ulrich Bockholt & Timo Engelke

  2. Technion Israel Institute of Technology, Technion City, Haifa, 32000, Israel

    Nirit Gavish

  3. PERCRO Laboratory - Scuola Superiore Sant’Anna, Viale R. Piaggio 34, 56025, Pontedera (Pisa), Italy

    Franco Tecchia

Authors
  1. Sabine Webel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ulrich Bockholt
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Timo Engelke
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nirit Gavish
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Franco Tecchia
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sabine Webel .

Editor information

Editors and Affiliations

  1. CSIRO ICT Centre, Cnr Vimiera and Pembroke Roads, Marsfield, 2122, New South Wales, Australia

    Leila Alem

  2. CSIRO ICT Centre, Cnr Vimiera and Pembroke Roads, Marsfield, 2122, New South Wales, Australia

    Weidong Huang

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer Science+Business Media, LLC

About this paper

Cite this paper

Webel, S., Bockholt, U., Engelke, T., Gavish, N., Tecchia, F. (2011). Design Recommendations for Augmented Reality based Training of Maintenance Skills. In: Alem, L., Huang, W. (eds) Recent Trends of Mobile Collaborative Augmented Reality Systems. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-9845-3_5

Download citation

  • DOI: https://doi.org/10.1007/978-1-4419-9845-3_5

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4419-9844-6

  • Online ISBN: 978-1-4419-9845-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation