Skip to main content
SpringerLink
Log in

Augmented Reality in Maintenance: A Review of the State-of-the-Art and Future Challenges

  • Chapter
  • First Online:
Springer Handbook of Augmented Reality

Part of the book series: Springer Handbooks ((SHB))

Abstract

In maintenance, the use of augmented reality (AR) has often been perceived as a solution in resolving the various problems faced by the industrial sector. For any reliable production line, maintenance is crucial in order to ensure the safe, continued, and productive operation of the entire manufacturing process. However, the difficulty of maintaining modern machinery and products is increasing exponentially such that operators may not be able to cope. As a human-computer interaction (HCI) tool, AR can potentially provide the competitive advantage to the maintenance operators to keep up with this rate of increase. This chapter presents new research and application developments in AR in maintenance. The chapter provides a holistic literature review on the recent developments in the state of the art of AR in maintenance. Current research directions and future developments are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 309.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 399.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Higgins, L.R., Mobley, R.K., Smith, R.: Maintenance Engineering Handbook. McGraw-Hill Professional, New York (2002)

    Google Scholar 

  2. Lee, J., Holgado, M., Kao, H.A., Macchi, M.: New thinking paradigm for maintenance innovation design. IFAC-PapersOnline. 19, 7104–7109 (2014)

    Google Scholar 

  3. Henderson, S.J., Feiner, S.: Evaluating the benefits of augmented reality for task localization in maintenance of an Armored Personnel Carrier Turret. In: Proceedings of the 8th IEEE International Symposium on Mixed and Augmented Reality, Orlando, FL, pp. 135–144 (2009)

    Google Scholar 

  4. Nee, A.Y.C., Ong, S.K., Chryssolouris, G., Mourtzis, D.: Augmented reality applications in design and manufacturing. Ann. CIRP. 61, 657–679 (2012)

    Google Scholar 

  5. Azuma, R.: A survey of augmented reality. Presence Teleop. Virt. 6, 355–385 (1997)

    Google Scholar 

  6. Henderson, S.J., Feiner, S.: Exploring the benefits of augmented reality documentation for maintenance and repair. IEEE Trans. Vis. Comput. Graph. 17(10), 1355–1368 (2011)

    Google Scholar 

  7. De Crescenzio, F., Fantini, M.: Implementing augmented reality to aircraft maintenance: A daily inspection case study. In: Proceedings of the IDMME Virtual Concept Conference, Bordeaux, France, pp. 1–5 (2010)

    Google Scholar 

  8. Dalle, M., Roy, R., Dini, G.: Improving efficiency of industrial maintenance with context aware adaptive authoring in augmented reality. Ann. CIRP. 66, 465–468 (2017)

    Google Scholar 

  9. Zhu, J., Ong, S.K., Nee, A.Y.C.: A context-aware augmented reality system to assist the maintenance operators. Int. J. Interact. Des. Manuf. 8, 293–304 (2014)

    Google Scholar 

  10. Bottecchia, S., Cieutat, J.M., Jessel, J.P.: T.A.C: Augmented reality system for collaborative tele-assistance in the field of maintenance through internet. In: Proceedings of the 1st International Conference on Augmented Human, Megeve, France, pp. 1–14 (2010)

    Google Scholar 

  11. De Crescenzio, F., Fantini, M., Persiani, F., Di Stefano, L., Salti, S., Azzari, P.: Augmented reality for aircraft maintenance training and operations support. IEEE Comput. Graph. Appl. 31, 96–101 (2010)

    Google Scholar 

  12. Perdikakis, A., Araya, A., Kiritsis, D.: Introducing augmented reality in next generation industrial learning tools: a case study on electric and hybrid vehicles. Procedia Eng. 132, 251–258 (2015)

    Google Scholar 

  13. Caudell, T.P., Mizell, D.W.: Augmented reality: An application of heads-up display technology to manual manufacturing processes. In: Proceedings of the 25th International Conference on System Sciences, Hawaii, pp. 659–669 (1992)

    Google Scholar 

  14. Dünser, A., Grasset, R., Seichter, H., Billinghurst, M.: Applying HCI principles to AR systems design. In: Proceedings of the 2nd International Workshop on Mixed Reality User Interfaces: Specification, Authoring, Adaptation, Charlotte, NC, pp. 37–42 (2007)

    Google Scholar 

  15. Grabowski, M., Rowen, A., Rancy, J.P.: Evaluation of wearable immersive augmented reality technology in safety-critical systems. Saf. Sci. 103, 23–32 (2018)

    Google Scholar 

  16. Lamberti, F., Manuri, F., Sanna, A., Paravati, G., Pezzolla, P., Montuschi, P.: Challenges, opportunities, and future trends of emerging techniques for augmented reality-based maintenance. IEEE Trans. Emerg. Top. Comput. 2, 411–421 (2014)

    Google Scholar 

  17. Martinetti, A., Rajabalinejad, M., Van Dongen, L.: Shaping the future maintenance operations: reflections on the adoptions of augmented reality through problems and opportunities. Procedia CIRP. 59, 14–17 (2017)

    Google Scholar 

  18. Porcelli, I., Rapaccini, M., Espíndola, D.B., Pereira, C.E.: Technical and organizational issues about the introduction of augmented reality in maintenance and technical assistance services. IFAC Proc. Vols. 46(7), 257–262 (2013)

    Google Scholar 

  19. Dini, G., Mura, M.D.: Application of augmented reality techniques in through-life engineering services. Procedia CIRP. 38, 14–23 (2015)

    Google Scholar 

  20. Borsci, S., Lawson, G., Broome, S.: Empirical evidence, evaluation criteria and challenges for the effectiveness of virtual and mixed reality tools for training operators of car service maintenance. Comput. Ind. 67, 17–26 (2015)

    Google Scholar 

  21. Palmarini, R., Erkoyuncu, J.A., Roy, R., Torabmostaedi, H.: A systematic review of augmented reality applications in maintenance. Robot. Comput. Integr. Manuf. 49, 215–228 (2018)

    Google Scholar 

  22. Friedrich, W., Jahn, D., Schmidt, L.: ARVIKA: Augmented reality for development, production and service. In: Proceedings of the 1st International Symposium on Mixed and Augmented Reality, Darmstadt, Germany, pp. 3–4 (2002)

    Google Scholar 

  23. Weidenhausen, J., Knoepfle, C., Stricker, D.: Lessons learned on the way to industrial augmented reality applications. A retrospective on ARVIKA. Comput. Graph. 27, 887–891 (2003)

    Google Scholar 

  24. De Groote, P.: Maintenance performance analysis: a practical approach. J. Qual. Maint. Eng. 1, 4–24 (1995)

    Google Scholar 

  25. Regenbrecht, H.T., Specht, R.: A mobile passive augmented reality device – mPARD. In: Proceedings of the IEEE and ACM International Symposium on Augmented Reality, Munich, 2000, pp. 81–84 (2000)

    Google Scholar 

  26. García, A.A., Bobadilla, I.G., Figueroa, G.A., Ramírez, M.P., Román, J.M.: Virtual reality training system for maintenance and operation of high-voltage overhead power lines. Virtual Reality. 20, 27–40 (2016)

    Google Scholar 

  27. Fiorentino, M., Uva, A.E., Gattullo, M., Debernardis, S., Monno, G.: Augmented reality on large screen for interactive maintenance instructions. Comput. Ind. 65, 270–278 (2014)

    Google Scholar 

  28. Neges, M., Wolf, M., Abramovici, M.: Secure access augmented reality solution for Mobile maintenance support utilizing condition-oriented work instructions. Procedia CIRP. 38, 58–62 (2015)

    Google Scholar 

  29. Syberfeldt, A., Danielsson, O., Holm, M., Wang, L.: Dynamic operator instructions based on augmented reality and expert systems. Procedia CIRP. 41, 346–351 (2016)

    Google Scholar 

  30. Shim, J., Yang, Y., Kang, N., Seo, J., Han, T.D.: Gesture-based interactive augmented reality content authoring system using HMD. Virtual Reality. 20, 57–69 (2016)

    Google Scholar 

  31. Kim, K., Billinghurst, M., Bruder, G., Duh, H.B.L., Welch, G.F.: Revisiting trends in augmented reality research: a review of the 2nd decade of ISMAR (2008–2017). IEEE Trans. Vis. Comput. Graph. 24, 2947–2962 (2018)

    Google Scholar 

  32. Zhu, J., Ong, S.K., Nee, A.Y.C.: A context-aware augmented reality assisted maintenance system. Int. J. Comput. Integr. Manuf. 28(2), 213–225 (2015)

    Google Scholar 

  33. Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Comput. Graph. Appl. 21(6), 34–47 (2001)

    Google Scholar 

  34. Gattullo, M., Scurati, G.W., Fiorentino, M., Uva, A.E., Ferrise, F., Bordegoni, M.: Towards augmented reality manuals for industry 4.0: a methodology. Robot. Comput. Integr. Manuf. 56, 276–286 (2019)

    Google Scholar 

  35. Reardon, C., Lee, K., Rogers, J.G., Fink, J.: Augmented reality for human-robot teaming in field environments. In: Proceedings of the International Conference on Human-Computer Interaction, Orlando, pp. 79–92 (2019)

    Google Scholar 

  36. Castellanos, M.J., Navarro-Newball, A.A.: Prototyping an augmented reality maintenance and repairing system for a deep well vertical turbine pump. In: Proceedings of the International Conference on Electronics, Communications and Computers, Cholula, Mexico, pp. 36–40 (2019)

    Google Scholar 

  37. Wang, X., Ong, S.K., Nee, A.Y.C.: A comprehensive survey of ubiquitous manufacturing research. Int. J. Prod. Res. 56, 604–628 (2019). (2018)

    Google Scholar 

  38. Haritos, T., Macchiarella, N.D.: A mobile application of augmented reality for aerospace maintenance training. In: Proceedings of the AIAA/IEEE Digital Avionics Systems Conference, Washington, DC, pp. 5.B.3–5.1 (2005)

    Google Scholar 

  39. Bacca, J., Baldiris, S., Fabregat, R., Kinshuk, Graf, S.: Mobile augmented reality in vocational education and training. Procedia Comput. Sci. 75, 49–58 (2015)

    Google Scholar 

  40. Nakajima, C., Itho, N.: A support system for maintenance training by augmented reality. In: Proceedings of the 12th International Conference on Image Analysis and Processing, Mantova, Italy, pp. 158–163 (2003)

    Google Scholar 

  41. Webel, S., Bockholt, U., Engelke, T., Gavish, N., Olbrich, M., Preusche, C.: An augmented reality training platform for assembly and maintenance skills. Robot. Auton. Syst. 61, 398–403 (2013)

    Google Scholar 

  42. Macchiarella, N.D., Vincenzi, D.A.: Augmented reality in a learning paradigm for flight aerospace maintenance training. In: Proceedings of the 24th Digital Avionics Systems Conference, Avionics in Changing Market Place: Safe and Secure, Salt Lake City, Washington, DC, pp. 5.D.1–5.1-9 (2005)

    Google Scholar 

  43. Schwald, B., DeLaval, B.: An augmented reality system for training and assistance to maintenance in the industrial context. In: Proceedings of the 11th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, Czech Republic, pp. 425–432 (2003)

    Google Scholar 

  44. Segovia, D., Ramírez, H., Mendoza, M., Mendoza, M., Mendoza, E., González, E.: Machining and dimensional validation training using augmented reality for a Lean process. Procedia Comput. Sci. 75, 195–204 (2015)

    Google Scholar 

  45. Jo, G.S., Oh, K.J., Ha, I., Lee, K.S., Hong, M.D., Neumann, U., You, S.: A unified framework for augmented reality and knowledge-based systems in maintaining aircraft. In: Proceedings of the National Conference on Artificial Intelligence, Quebec City, pp. 2990–2997 (2014)

    Google Scholar 

  46. Neges, M., Adwernat, S., Abramovici, M.: Augmented Virtuality for maintenance training simulation under various stress conditions. Procedia Manuf. 19, 171–178 (2018)

    Google Scholar 

  47. Syberfeldt, A., Holm, M., Danielsson, O., Wang, L., Brewster, R.L.: Support systems on the industrial shop-floors of the future: Operators’ perspective on augmented reality. In: Proceedings of the 6th CIRP Conference on Assembly Technologies and Systems, Gothenburg, pp. 108–113 (2016)

    Google Scholar 

  48. Abdelnaby, M., Abd Elazem, M., Aly, H.A., Kaboudan, A.: Augmented reality maintenance training with intel depth camera. In: Proceedings of the International Conference on Machine Vision and Information Technology, Los Alamitos, pp. 116–122 (2017)

    Google Scholar 

  49. Wang, X., Ong, S.K., Nee, A.Y.C.: Real-virtual components interaction for assembly simulation and planning. Robot. Comput. Integr. Manuf. 41, 102–114 (2016)

    Google Scholar 

  50. Toro, C., Sanin, C., Vaquero, J., Posada, J., Szczerbicki, E.: Knowledge based industrial maintenance using portable devices and augmented reality. In: Proceedings of the International Conference on Knowledge-Based and Intelligent Information and Engineering Systems, Vietri sul Mare, Italy, pp. 295–302 (2007)

    Google Scholar 

  51. Nakagawa, T., Sano, T., Nakatani, Y.: Plant maintenance support system by augmented reality. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Tokyo, Japan, pp. I-768–I-773 (1999)

    Google Scholar 

  52. Lee, S., Akin, Ö.: Augmented reality-based computational fieldwork support for equipment operations and maintenance. Autom. Constr. 20, 338–352 (2011)

    Google Scholar 

  53. Savioja, O., Järvinen, P., Karhela, T., Siltanen, P., Woodward, C.: Developing a mobile, service-based augmented reality tool for modern maintenance work. In: Proceedings of the International Conference on Virtual Reality, Beijing, China, pp. 554–563 (2007)

    Google Scholar 

  54. Ke, C., Kang, B., Chen, D., Li, X.: An augmented reality-based application for equipment maintenance. In: Proceedings of the First International Conference on Affective Computing and Intelligent Interaction, Beijing, China, pp. 836–841 (2005)

    Google Scholar 

  55. Schlagowski, R., Merkel, L., Meitinger, C.: Design of an assistant system for industrial maintenance tasks and implementation of a prototype using augmented reality. In: Proceedings of the IEEE International Conference on Industrial Engineering and Engineering Management, Singapore, pp. 294–298 (2017)

    Google Scholar 

  56. Zenati, N., Zerhouni, N., Achour, K.: Assistance to maintenance in industrial process using an augmented reality system. In: Proceedings of the IEEE International Conference on Industrial Technology, Hammamet, Tunisia, pp. 848–852 (2004)

    Google Scholar 

  57. Benbelkacem, S., Belhocine, M., Bellarbi, A., Zenati-Henda, N., Tadjine, M.: Augmented reality for photovoltaic pumping systems maintenance tasks. Renew. Energy. 55, 428–437 (2013)

    Google Scholar 

  58. Tatić, D., Tešić, B.: The application of augmented reality technologies for the improvement of occupational safety in an industrial environment. Comput. Ind. 85, 1–10 (2017)

    Google Scholar 

  59. Garza, L.E., Pantoja, G., Ramírez, P., Ramírez, H., Rodríguez, N., González, E., Quintal, R., Pérez, J.A.: Augmented reality application for the maintenance of a Flapper valve of a Fuller-Kynion type M pump. Procedia Comput. Sci. 25, 154–160 (2013)

    Google Scholar 

  60. Mooser, J., Wang, L., You, S., Neumann, U.: An augmented reality interface for mobile information retrieval. In: Proceedings of the IEEE International Conference on Multimedia and Expo, Beijing, pp. 2226–2229 (2007)

    Google Scholar 

  61. Behringer, R., Chen, S., Sundareswaran, V., Wang, K., Vassiliou, M.: Novel interface for device diagnostics using speech recognition, augmented reality visualization and 3D audio auralization. In: Proceedings of the International Conference on Multimedia Computing and Systems, Florence, Italy, pp. 427–432 (1999)

    Google Scholar 

  62. Oliveira, A., Caetano, N., Botega, L.C., de Araújo, R.B.: A head-up display with augmented reality and gamification for an e-maintenance system: using interfaces and gamification to motivate workers in procedural tasks. In: Proceedings of the International Conference on Human Interface and the Management of Information, Los Angeles, 2015, pp. 499–510 (2015)

    Google Scholar 

  63. Aschenbrenner, D., Maltry, N., Kimmel, J., Albert, M., Scharnagl, J., Schilling, K.: ARTab – Using virtual and augmented reality methods for an improved situation awareness for telemaintenance. IFAC-PapersOnLine. 49(30), 204–209 (2016)

    Google Scholar 

  64. Aschenbrenner, D., Latoschik, M.E., Schilling, K.: Industrial maintenance with augmented reality: Two case studies. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, Munich, pp. 341–342 (2016)

    Google Scholar 

  65. Abramovici, M., Wolf, M., Adwernat, S., Neges, M.: Context-aware maintenance support for augmented reality assistance and synchronous multi-user collaboration. Procedia CIRP. 59, 18–22 (2016)

    Google Scholar 

  66. Zenati-Henda, N., Bellarbi, A., Benbelkacem, S., Belhocine, M.: Augmented reality system based on hand gestures for remote maintenance. In: Proceedings of the International Conference on Multimedia Computing and Systems, Marrakech, Morocco, pp. 5–8 (2014)

    Google Scholar 

  67. Regenbrecht, H., Baratoff, G., Wilke, W.: Augmented reality projects in the automotive and aerospace industries. IEEE Comput. Graph. Appl. 25(6), 48–56 (2005)

    Google Scholar 

  68. Wang, W., Qi, Y., Wang, Q.: An augmented reality application framework for complex equipment collaborative maintenance. In: Proceedings of the 8th International Conference on Cooperative Design, Visualization, and Engineering, Berlin, 2011, pp. 154–161 (2011)

    Google Scholar 

  69. Petersen, N., Stricker, D.: Cognitive augmented reality. Comput. Graph. 53, 82–91 (2015)

    Google Scholar 

  70. Chimienti, V., Iliano, S., Dassisti, M., Dini, G., Failli, F.: Guidelines for implementing augmented reality procedures in assisting assembly operations. In: Proceedings of the International Precision Assembly Seminar, Chamonix, pp. 174–179 (2010)

    Google Scholar 

  71. Macchiarella, N.D.: Augmented reality as a medium for job task training. J. Instr. Deliv. Syst. 19(1), 21–24 (2005)

    Google Scholar 

  72. Greenhalgh, P., Mullins, B., Grunnet-Jepsen, A., Bhowmik, A.K.: Industrial deployment of a full-featured head-mounted augmented-reality system and the incorporation of a 3D-sensing platform. In: Proceedings of the Society for Information Display Symposium Digest of Technical Papers, San Francisco, pp. 448–451 (2016)

    Google Scholar 

  73. Zhu, J., Nee, A.Y.C., Ong, S.K.: Online authoring for augmented reality remote maintenance. In: Proceedings of the 12th IASTED International Conference on Computer Graphics and Imaging, Innsbruck, Austria, pp. 87–94 (2011)

    Google Scholar 

  74. Masoni, R., Ferrise, F., Bordegoni, M., Gattullo, M., Uva, A.E., Fiorentino, M., Carrabba, E., Di Donato, M.: Supporting remote maintenance in industry 4.0 through augmented reality. Procedia Manuf. 11, 1296–1302 (2017)

    Google Scholar 

  75. Zhu, J., Ong, S.K., Nee, A.Y.C.: An Authorable context-aware augmented reality system to assist the maintenance technicians. Int. J. Adv. Manuf. Technol. 66, 1699–1714 (2013)

    Google Scholar 

  76. del Amo, I.F., Erkoyuncu, J.A., Roy, R., Wilding, S.: Augmented reality in maintenance: an information-centred design framework. Procedia Manuf. 19, 148–155 (2018)

    Google Scholar 

  77. Bauer, M., Bruegge, B., Klinker, G., MacWilliams, A., Reicher, T., Riß, S., Sandor, C., Wagner, M.: Design of a component-based augmented reality framework. In: Proceedings of the IEEE and ACM International Symposium on Augmented Reality, New York, pp. 45–54 (2001)

    Google Scholar 

  78. Benbelkacem, S., Zenati-Henda, N., Belhocine, M., Malek, S.: Augmented reality system for e-maintenance application. In: Proceedings of the 2nd Mediterranean Conference on Intelligent Systems and Automation, Zarzis, Tunisia, pp. 185–189 (2009)

    Google Scholar 

  79. Siew, C.Y., Ong, S.K., Nee, A.Y.C.: A practical augmented reality-assisted maintenance system framework for adaptive user support. Robot. Comput. Integr. Manuf. 59, 115–129 (2019)

    Google Scholar 

  80. Siltanen, S.: Theory and Applications of Marker-Based Augmented Reality. VTT Technical Research Centre of Finland, Espoo (2012)

    Google Scholar 

  81. Wang, X., Ong, S.K., Nee, A.Y.C.: A comprehensive survey of augmented reality assembly research. Adv. Manuf. 4, 1–22 (2016)

    Google Scholar 

  82. Kato, H., Billinghurst, M.: Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality, Francisco, pp. 85–94 (1999)

    Google Scholar 

  83. Wang, R., Paris, S., Popović, J.: 6D hands: Markerless hand-tracking for computer aided design. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, Santa Barbara, pp. 549–558 (2011)

    Google Scholar 

  84. Lee, T., Höllerer, T.: Hybrid feature tracking and user interaction for markerless augmented reality. In: Proceedings of the IEEE International Symposium on Virtual Reality, Reno, pp. 145–152 (2008)

    Google Scholar 

  85. Yu, L., Ong, S.K., Nee, A.Y.C.: A tracking solution for mobile augmented reality based on sensor-aided marker-less tracking and panoramic mapping. Multimed. Tools Appl. 75, 3199–3220 (2016)

    Google Scholar 

  86. Manuri, F., Pizzigalli, A., Sanna, A.: A state validation system for augmented reality based maintenance procedures. Appl. Sci. 9(10), 2115 (2019)

    Google Scholar 

  87. Lima, J.P., Roberto, R., Simões, F., Almeida, M., Figueiredo, L., Teixeira, J.M., Teichrieb, V.: Markerless tracking system for augmented reality in the automotive industry. Expert Syst. Appl. 82, 100–114 (2017)

    Google Scholar 

  88. Li, J., Fan, X.: Outdoor augmented reality tracking using 3D city models and game engine. In: Proceedings of the 7th International Congress on Image and Signal Processing, Dalian, China, pp. 104–108 (2014)

    Google Scholar 

  89. Zhou, F., Duh, H.B.L., Billinghurst, M.: Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. In: Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, Cambridge, pp. 193–202 (2008)

    Google Scholar 

  90. PTC. Vuforia. https://www.vuforia.com/ (2018)

  91. Google. ARCore. https://developers.google.com/ar/discover/ (2018)

  92. Apple. ARKit. https://developer.apple.com/arkit/ (2018)

  93. Flatt, H., Koch, N., Röcker, C., Günter, A., Jasperneite, J.: A context-aware assistance system for maintenance applications in smart factories based on augmented reality and indoor localization. In: Proceedings of the IEEE International Conference on Emerging Technologies and Factory Automation, Luxembourg, pp. 1–4 (2015)

    Google Scholar 

  94. Paz, A., Guenaga, M.L., Eguiluz, A.: Augmented reality for maintenance operator training using surf points and homography. In: Proceedings of the 9th International Conference on Remote Engineering and Virtual Instrumentation, Bilbao, Spain, pp. 1–4 (2012)

    Google Scholar 

  95. Stiefmeier, T., Ogris, G., Junker, H., Lukowicz, P., Troster, G.: Combining motion sensors and ultrasonic hands tracking for continuous activity recognition in a maintenance scenario. In: Proceedings of the 10th IEEE International Symposium on Wearable Computers, Montreux, pp. 97–104 (2006)

    Google Scholar 

  96. Welch, G., Foxlin, E.: Motion tracking: no silver bullet, but a respectable arsenal. IEEE Comput. Graph. Appl. 22, 24–38 (2002)

    Google Scholar 

  97. Natural Point: OptiTrack – Motion capture systems. http://optitrack.com/

  98. Leap Motion Inc.: Leap motion. https://www.leapmotion.com/

  99. Meta Motion: Gypsy 7 electro-mechanical motion capture system. http://metamotion.com/gypsy/gypsy-motion-capture-system.htm

  100. Noitom. Perception neuron by Noitom | Perception neuron motion capture for virtual reality, animation, sports, gaming and film. https://neuronmocap.com/

  101. Boessenkool, H., Thomas, J., Wildenbeest, J.G.W., Heemskerk, C.J.M., de Baar, M.R., Steinbuch, M., Abbink, D.A.: Where to improve in human-in-the-loop tele-operated maintenance? A phased task analysis based on video data of maintenance at JET. Fusion Eng. Des. 129, 309–319 (2018)

    Google Scholar 

  102. Siew, C.Y., Nee, A.Y.C., Ong, S.K.: Improving maintenance efficiency with an adaptive AR-assisted maintenance system. In: Proceedings of the 4th International Conference on Robotics, Control and Automation, Guangzhou, China, pp. 74–78 (2019)

    Google Scholar 

  103. Tsai, C.H., Huang, J.Y.: Augmented reality display based on user behaviour. Comput. Stand. Interf. 55, 171–181 (2018)

    Google Scholar 

  104. Golparvar-Fard, M., Ham, Y.: Automated diagnostics and visualization of potential energy performance problems in existing buildings using energy performance augmented reality models. J. Comput. Civ. Eng. 28, 17–29 (2013)

    Google Scholar 

  105. Scurati, G.W., Gattullo, M., Fiorentino, M., Ferrise, F., Bordegoni, M., Uva, A.E.: Converting maintenance actions into standard symbols for augmented reality applications in industry 4.0. Comput. Ind. 98, 68–79 (2018)

    Google Scholar 

  106. Westerfield, G., Mitrovic, A., Billinghurst, M.: Intelligent augmented reality training for motherboard assembly. Int. J. Artif. Intell. Educ. 25, 157–172 (2015)

    Google Scholar 

  107. Fiorentino, M., Uva, A.E., Monno, G., Radkowski, R.: Natural interaction for online documentation in industrial maintenance. Int. J. Comput. Aided Eng. Technol. 8(1/2), 56–79 (2016)

    Google Scholar 

  108. Goose, S., Sudarsky, S., Zhang, X., Navab, N.: Speech-enabled augmented reality supporting mobile industrial maintenance. IEEE Pervasive Comput. 2(1), 65–70 (2003)

    Google Scholar 

  109. Park, H.M., Lee, S.H., Choi, J.S.: Wearable augmented reality system using gaze interaction. In: Proceedings of the 7th IEEE International Symposium on Mixed and Augmented Reality, Cambridge, pp. 175–176 (2008)

    Google Scholar 

  110. Wang, X., Ong, S.K., Nee, A.Y.C.: Real-virtual interaction in AR assembly simulation based on component contact handling strategy. Assem. Autom. 35(4), 376–394 (2015)

    Google Scholar 

  111. Lee, A.S., Swift, M., Tang, J.C., Chen, H.: 3D collaboration method over HoloLens and Skype endpoints. In: Proceedings of the 3rd International Workshop on Immersive Media Experiences, Brisbane, pp. 27–30 (2015)

    Google Scholar 

  112. Pringle, A., Hutka, S., Mom, J., van Esch, R., Heffernan, N., Chen, P.: Ethnographic study of a commercially available augmented reality HMD App for industry work instruction. In: Proceedings of the 12th ACM International Conference on Pervasive Technologies Related to Assistive Environments, Rhodes, pp. 389–397 (2019)

    Google Scholar 

  113. van Krevelen, R., Poelman, R.: A survey of augmented reality technologies, applications and limitations. Int. J. Virtual Real. 9, 1–20 (2010)

    Google Scholar 

  114. Johnston, R.S., Willey, S.R.: Development of a commercial retinal scanning display. In: Proceedings of the Symposium on OE/Aerospace Sensing and Dual Use Photonics, Orlando, pp. 2–14 (1995)

    Google Scholar 

  115. Kiyokawa, K.: Trends and vision of head mounted display in augmented reality. In: International Symposium on Ubiquitous Virtual Reality, Daejeon, South Korea, pp. 14–17 (2012)

    Google Scholar 

  116. Factura, B., LaPerche, L., Reyneri, P., Jones, B., Karsch, K.: Lightform: Procedural effects for projected AR. In: Proceedings of the SIGGRAPH Special Interest Group on Computer Graphics and Interactive Techniques Conference, Vancouver, BC, pp. 6-1–6-2 (2018)

    Google Scholar 

  117. Lakshmprabha, N.S., Kasderidis, S., Mousouliotis, P., Petrou, L., Beltramello, O.: Augmented reality for maintenance application on a mobile platform. In: Proceedings of the IEEE Annual International Symposium on Virtual Reality, Arles, Camargue-Provence, pp. 355–356 (2015)

    Google Scholar 

  118. Fang, W., Zheng, L., Wu, X.: Multi-sensor based real-time 6-Dof pose tracking for wearable augmented reality. Comput. Ind. 92–93, 91–103 (2017)

    Google Scholar 

  119. Herold, R., Vogel, U., Richter, B., Kreye, D., Reckziegel, S., Scholles, M., Lakner, H.: OLED-on-CMOS integration for augmented-reality systems. In: Proceedings of the International Students and Young Scientists Workshop – Photonics and Microsystems, Wroclaw-Szklarska Poreba, Poland, pp. 19–22 (2008)

    Google Scholar 

  120. Lv, Z., Halawani, A., Feng, S., Ur Réhman, S., Li, H.: Touch-less interactive augmented reality game on vision-based wearable device. Pers. Ubiquit. Comput. 19, 551–567 (2015)

    Google Scholar 

  121. Haller, M., Thomas, B.H., Billinghurst, M.: Emerging Technologies of Augmented Reality. IGI Global, Hershey (2007)

    Google Scholar 

  122. Ohshima, T., Satoh, K., Yamamoto, H., Tamura, H.: RV-border guards: a multi-player mixed reality entertainment. Trans. Virtual Real. Soc. Jpn. 4(4), 699–705 (1999)

    Google Scholar 

  123. Sweller, J.: Cognitive load during problem solving: effects on learning. Cogn. Sci. 12(2), 257–285 (1988)

    Google Scholar 

  124. Tao, F., Cheng, J., Qi, Q., Zhang, M., Zhang, H., Sui, F.: Digital twin-driven product design, manufacturing and service with big data. Int. J. Adv. Manuf. Technol. 94, 3563–3576 (2018)

    Google Scholar 

  125. Faro, A., Giordano, D., Pino, C., Spampinato, C.: Visual attention for implicit relevance feedback in a content based image retrieval. In: Proceedings of the Symposium on Eye-Tracking Research & Applications, Austin, pp. 73–76 (2010)

    Google Scholar 

  126. Thayer, J.F., Åhs, F., Fredrikson, M., Sollers, J.J., Wager, T.D.: A meta-analysis of heart rate variability and neuroimaging studies: implications for heart rate variability as a marker of stress and health. Neurosci. Biobehav. Rev. 36(2), 747–756 (2012)

    Google Scholar 

  127. Tattersall, A.J., Hockey, G.R.: Level of operator control and changes in heart rate variability during simulated flight maintenance. Hum. Factors. 37(4), 682–698 (1995)

    Google Scholar 

  128. Kroemer, K.H.E., Grandjean, E.: Fitting the Task to the Human: A Textbook of Occupational Ergonomics, 5th edn. CRC Press, London (1997)

    Google Scholar 

  129. Colombini, D., Occhipinti, E.: Scientific basis of the OCRA method for risk assessment of biomechanical overload of upper limb, as preferred method in ISO standards on biomechanical risk factors. Scand. J. Work Environ. Health. 44(4), 436–438 (2018)

    Google Scholar 

  130. Stanton, N.A., Hedge, A., Brookhuis, K., Salas, E., Hendrick, H.W.: Handbook of Human Factors and Ergonomics Methods, 1st edn. CRC Press, London (2004)

    Google Scholar 

  131. Salvendy, N.G.: Handbook of Human Factors and Ergonomics, 4th edn. Wiley, Hoboken (2012)

    Google Scholar 

  132. Hoy, D., Brooks, P., Blyth, F., Buchbinder, R.: The epidemiology of low Back pain. Best Pract. Res. Clin. Rheumatol. 24(6), 769–781 (2010)

    Google Scholar 

  133. Siew, C.Y., Ong, S.K., Nee, A.Y.C.: Improving maintenance efficiency and safety through a human-centric approach. Adv. Manuf. 9(1), 104–114 (2021)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mechanical Engineering, National University of Singapore, Singapore, Singapore

    Soh Khim Ong & Andrew Yeh Ching Nee

  2. Mechanical Engineering Department, National University of Singapore, Singapore, Singapore

    C. Y. Siew

Authors
  1. Soh Khim Ong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. C. Y. Siew
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Andrew Yeh Ching Nee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Soh Khim Ong .

Editor information

Editors and Affiliations

  1. Department of Mechanical Engineering, National University of Singapore, Singapore, Singapore

    Andrew Yeh Ching Nee

  2. Department of Mechanical Engineering, National University of Singapore, Singapore, Singapore

    Soh Khim Ong

Rights and permissions

Reprints and permissions

Copyright information

© 2023 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Ong, S.K., Siew, C.Y., Nee, A.Y.C. (2023). Augmented Reality in Maintenance: A Review of the State-of-the-Art and Future Challenges. In: Nee, A.Y.C., Ong, S.K. (eds) Springer Handbook of Augmented Reality. Springer Handbooks. Springer, Cham. https://doi.org/10.1007/978-3-030-67822-7_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-67822-7_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-67821-0

  • Online ISBN: 978-3-030-67822-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation