Skip to main content
SpringerLink
Log in

Systematic Literature Review on Augmented Reality-Based Maintenance Applications in Manufacturing Centered on Operator Needs

  • Review
  • Published:
International Journal of Precision Engineering and Manufacturing-Green Technology Aims and scope Submit manuscript

Abstract

Smart manufacturing supported by emerging Industry 4.0 technologies is a key driver to realize mass product customizations. Augmented reality (AR) has been commonly applied to facilitate manual operations with ambient intelligence by overlaying virtual information on physical scenes. In most modern factories, maintenance remains an indispensable process that is difficult or yet to be fully automated. Several studies have previously reviewed AR-based maintenance across all industrial sectors, whereas those specific to manufacturing did not necessarily involve maintenance. Hence, this paper presents a systematic literature review on AR-assisted maintenance in manufacturing with a focus on the operator’s needs. A generic process has been proposed to classify the maintenance operations examined in the past studies into four sequential steps and to analyze the classification results based on the geographical location, maintenance type, AR technical elements, and integrated external sensors. The findings thus derived are expected to provide design guidelines for implementing AR applications with practical values to aid manual maintenance in future smart manufacturing environments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. A. Cachada et al. (2019). Using AR interfaces to support industrial maintenance procedures. In IECON Proceedings (Industrial Electronics Conference), 2019, pp. 3795–3800. https://doi.org/10.1109/IECON.2019.8927815.

  2. Manuri, F., Pizzigalli, A., & Sanna, A. (2019). A state validation system for augmented reality based maintenance procedures. Applied Sciences. https://doi.org/10.3390/app9102115

    Article  Google Scholar 

  3. S. Aromaa, A. Väätänen, M. Hakkarainen, & E. Kaasinen. (2018). User experience and user acceptance of an augmented reality based knowledge-sharing solution in industrial maintenance work. In Advances in Usability and User Experience. AHFE 2017. Advances in Intelligent Systems and Computing, vol. 607, T. Ahram and C. Falcão, Eds. Cham: Springer, pp. 145–156

  4. Kollatsch, C., & Klimant, P. (2021). Efficient integration process of production data into Augmented Reality based maintenance of machine tools. Production Engineering. https://doi.org/10.1007/s11740-021-01026-6

    Article  Google Scholar 

  5. Alvanchi, A., TohidiFar, A., Mousavi, M., Azad, R., & Rokooei, S. (2021). A critical study of the existing issues in manufacturing maintenance systems: Can BIM fill the gap? Computers in Industry, 131, 103484.

    Article  Google Scholar 

  6. Franciosi, C., Voisin, A., Miranda, S., Riemma, S., & Iung, B. (2020). Measuring maintenance impacts on sustainability of manufacturing industries: From a systematic literature review to a framework proposal. Journal of Cleaner Production, 260, 121065.

    Article  Google Scholar 

  7. Bottani, E., & Vignali, G. (2019). Augmented reality technology in the manufacturing industry: A review of the last decade. IISE Transactions, 51(3), 284–310. https://doi.org/10.1080/24725854.2018.1493244

    Article  Google Scholar 

  8. Egger, J., & Masood, T. (2020). Augmented reality in support of intelligent manufacturing—a systematic literature review. Computers & Industrial Engineering, 140, 106195.

    Article  Google Scholar 

  9. Sahu, C. K., Young, C., & Rai, R. (2020). Artificial intelligence (AI) in augmented reality (AR)-assisted manufacturing applications: A review. International Journal of Production Research. https://doi.org/10.1080/00207543.2020.1859636

    Article  Google Scholar 

  10. Wang, P., et al. (2020). A comprehensive survey of AR/MR-based co-design in manufacturing. Engineering Computations, 36(4), 1715–1738. https://doi.org/10.1007/s00366-019-00792-3

    Article  Google Scholar 

  11. M. Gattullo et al. (2020). Design preferences on industrial augmented reality: A survey with potential technical writers. In Adjunct Proceedings of the 2020 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2020, pp 172–177. https://doi.org/10.1109/ISMAR-Adjunct51615.2020.00054.

  12. Palmarini, R., Erkoyuncu, J. A., Roy, R., & Torabmostaedi, H. (2018). A systematic review of augmented reality applications in maintenance. Robotics and Computer-Integrated Manufacturing, 49, 215–228. https://doi.org/10.1016/j.rcim.2017.06.002

    Article  Google Scholar 

  13. del Amo, I. F., Erkoyuncu, J. A., Roy, R., Palmarini, R., & Onoufriou, D. (2018). A systematic review of Augmented Reality content-related techniques for knowledge transfer in maintenance applications. Computers in Industry, 103, 47–71.

    Article  Google Scholar 

  14. M. Gattullo, A. Evangelista, A. E. Uva, M. Fiorentino, & J. Gabbard. (2020). What, how, and why are visual assets used in industrial augmented reality; a systematic review and classification in maintenance, assembly, and training (from 1997 to 2019). In: IEEE Trans. Vis. Comput. Graph. https://doi.org/10.1109/TVCG.2020.3014614

  15. Byvaltsev, S. V. (2020). Review of the features of augmented reality application in the training of operators and maintenance staff. IOP Conference Series: Materials Science and Engineering. https://doi.org/10.1088/1757-899X/966/1/012121

    Article  Google Scholar 

  16. Koh, Y. S., et al. (2020). A review on augmented reality tracking methods for maintenance of robots. Jurnal Teknologi, 83(1), 37–43. https://doi.org/10.11113/jurnalteknologi.v83.14907

    Article  Google Scholar 

  17. Baroroh, D. K., Chu, C., & Wang, L. (2021). Systematic literature review on augmented reality in smart manufacturing: Collaboration between human and computational intelligence. Journal of Manufacturing Systems. https://doi.org/10.1016/j.jmsy.2020.10.017

    Article  Google Scholar 

  18. M. Lorenz, S. Knopp, & P. Klimant. (2018). Industrial augmented reality: requirements for an augmented reality maintenance worker support system. In Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018, pp. 151–153.https://doi.org/10.1109/ISMAR-Adjunct.2018.00055

  19. A. Prouzeau, Y. Wang, B. Ens, W. Willett, & T. Dwyer. (2020). Corsican twin: Authoring in situ augmented reality visualisations in virtual reality. In AVI ’20: Proceedings of the International Conference on Advanced Visual Interfaces. doi: https://doi.org/10.1145/3399715.3399743.

  20. Ong, S. K., & Zhu, J. (2013). A novel maintenance system for equipment serviceability improvement. The CIRP Journal of Manufacturing Science and Technology, 62(1), 39–42. https://doi.org/10.1016/j.cirp.2013.03.091

    Article  Google Scholar 

  21. Horejsi, P., Novikov, K., & Simon, M. (2020). A smart factory in a smart city: Virtual and augmented reality in a smart assembly line. IEEE Access, 8, 94330–94340. https://doi.org/10.1109/ACCESS.2020.2994650

    Article  Google Scholar 

  22. M. Fullen, A. Maier, A. Nazarenko, V. Aksu, S. Jenderny, & C. Rocker. (2019). Machine learning for assistance systems: Pattern-based approach to online step recognition. In IEEE International Conference on Industrial Informatics (INDIN), vol. 2019-July, pp. 296–302. https://doi.org/10.1109/INDIN41052.2019.8972122.

  23. Costal, C. M., et al. (2019). Modeling of video projectors in OpenGL for implementing a spatial augmented reality teaching system for assembly operations. IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), 2019, 1–8. https://doi.org/10.1109/ICARSC.2019.8733617

    Article  Google Scholar 

  24. Mourtzis, D., Angelopoulos, J., & Boli, N. (2018). Maintenance assistance application of engineering to order manufacturing equipment: A product service system (PSS) approach. IFAC-PapersOnLine, 51(11), 217–222. https://doi.org/10.1016/j.ifacol.2018.08.263

    Article  Google Scholar 

  25. Ariansyah, D., Rosa, F., & Colombo, G. (2020). Smart maintenance: A wearable augmented reality application integrated with CMMS to minimize unscheduled downtime. Computer-Aided Design and Applications, 17(4), 740–751. https://doi.org/10.14733/cadaps.2020.740-751

    Article  Google Scholar 

  26. T. Kuster, et al. (2019). A distributed architecture for modular and dynamic augmented reality processes. In IEEE International Conference on Industrial Informatics (INDIN), vol. 2019-July, pp. 663–670. https://doi.org/10.1109/INDIN41052.2019.8972101.

  27. F. Alves, et al. (2020). Deployment of a smart and predictive maintenance system in an industrial case study. In IEEE Int. Symp. Ind. Electron., vol. 2020, pp. 493–498. https://doi.org/10.1109/ISIE45063.2020.9152441.

  28. Park, K.-B., Kim, M., Choi, S. H., & Lee, J. Y. (2020). Deep learning-based smart task assistance in wearable augmented reality. Robotics and Computer-Integrated Manufacturing. https://doi.org/10.1016/j.rcim.2019.101887

    Article  Google Scholar 

  29. Hao, Y., & Helo, P. (2017). The role of wearable devices in meeting the needs of cloud manufacturing: A case study. Robotics and Computer-Integrated Manufacturing, 45, 168–179. https://doi.org/10.1016/j.rcim.2015.10.001

    Article  Google Scholar 

  30. A. Bastes, S. Ribeiro, A. Pinto, F. Marques, D. Baldissin, & F. Reis. (2021). Augmented reality for training and maintenance of reclosers: a case study of a wearable application. In 2021 IEEE 45th Annual Computers, Software, and Applications Conference (COMPSAC), pp. 532–537

  31. S. Suryavansh, C. Bothra, M. Chiang, C. Peng, & S. Bagchi. Tango of edge and cloud execution for reliability. In: MECC 2019 - Proceedings of the 2019 4th Workshop on Middleware for Edge Clouds and Cloudlets, Part of Middleware 2019, pp. 10–15. https://doi.org/10.1145/3366614.3368103

  32. H. Dhiman & C. Rocker. (2019). Worker assistance in smart production environments using pervasive technologies. In 2019 IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom Workshops 2019, pp. 95–100. https://doi.org/10.1109/PERCOMW.2019.8730771.

  33. C. Barreiros, N. Silva, V. Pammer-Schindler, & E. Veas. (2020). Nature at your service - nature inspired representations combined with eye-gaze features to infer user attention and provide contextualized support, vol. 12214 LNCS

  34. M. Neges, M. Wolf, & M. Abramovici. (2018). Enabling round-trip engineering between P&I diagrams and augmented reality work instructions in maintenance processes utilizing graph-based modelling. In Advances in Intelligent Systems and Computing, vol. 637, M. D. Burduk A., Ed. Cham: Springer, pp. 33–42

  35. Dvorak, P., Josth, R., & Delponte, E. (2017). Object state recognition for automatic AR-based maintenance guidance. IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2017, 1244–1250. https://doi.org/10.1109/CVPRW.2017.164

    Article  Google Scholar 

  36. Mourtzis, D., Vlachou, A., & Zogopoulos, V. (2017). Cloud-based augmented reality remote maintenance through shop-floor monitoring: A product-service system approach. Journal of Manufacturing Science and Engineering. https://doi.org/10.1115/1.4035721

    Article  Google Scholar 

  37. M. Abramovici, M. Wolf, S. Adwernat, & M. Neges (2016). Context-aware maintenance support for augmented reality assistance and synchronous multi-user collaboration. In Procedia CIRP, vol. 59, no. TESConf, pp. 18–22, 2017. https://doi.org/10.1016/j.procir.2016.09.042.

  38. Kalgren, P. W., Byington, C. S., Roemer, M. J., & Watson, M. J. (2006). Defining PHM, a lexical evolution of maintenance and logistics. IEEE Autotestcon, 2006, 353–358.

    Google Scholar 

  39. C. Scheuermann, F. Meissgeier, B. Bruegge, & S. Verclas. (2016). Mobile augmented reality based annotation system: A cyber-physical human system. In Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2016. Lecture Notes in Computer Science, vol. 9768, M. A. De Paolis L., Ed. Cham: Springer, pp. 267–280.

  40. D. Nguyen & G. Meixner. (2020). Comparison user engagement of gamified and non-gamified augmented reality assembly training, vol. 376 LNBIP

  41. Leutert, F., & Schilling, K. (2015). Augmented Reality for telemaintenance and -inspection in force-sensitive industrial robot applications. IFAC-PapersOnLine, 28(10), 153–158. https://doi.org/10.1016/j.ifacol.2015.08.124

    Article  Google Scholar 

  42. Eder, M., Hulla, M., Mast, F., & Ramsauer, C. (2020). On the application of augmented reality in a learning factory working environment. Procedia Manufacturing, 45, 7–12. https://doi.org/10.1016/j.promfg.2020.04.030

    Article  Google Scholar 

  43. C. N. Deac, G. C. Deac, C. L. Popa, M. Ghinea, & C. E. Cotet. (2017). Using augmented reality in smartmanufacturing. In: Annals of DAAAM and Proceedings of the International DAAAM Symposium, pp. 727–732. https://doi.org/10.2507/28th.daaam.proceedings.102.

  44. M. Jayaweera, I. Wijesooriya, D. Wijewardana, T. De Silva, & C. Gamage. (2017). Demo abstract: Enhanced real-time machine inspection with mobile augmented reality for maintenance and repair. In Proceedings - 2017 IEEE/ACM 2nd International Conference on Internet-of-Things Design and Implementation, IoTDI 2017 (part of CPS Week), pp. 287–288. https://doi.org/10.1145/3054977.3057302.

  45. H. Flatt, N. Koch, C. Röcker, A. Günter, & J. Jasperneite. (2015). A context-aware assistance system for maintenance applications in smart factories based on augmented reality and indoor localization. In IEEE International Conference on Emerging Technologies and Factory Automation, ETFA, vol. 2015. https://doi.org/10.1109/ETFA.2015.7301586.

  46. C. Y. Siew, A. Y. C. Nee, & S. K. Ong. (2019). Improving maintenance efficiency with an adaptive AR-assisted maintenance system. In ACM International Conference Proceeding Series, pp. 74–78. https://doi.org/10.1145/3351180.3351203.

  47. S. Webel, U. Bockholt, & J. Keil. (2011). Design criteria for AR-based training of maintenance and assembly tasks, vol. 6773 LNCS, no. PART 1

  48. R. Schlagowski, L. Merkel, & C. Meitinger. (2017). Design of an assistant system for industrial maintenance tasks and implementation of a prototype using augmented reality. In IEEE International Conference on Industrial Engineering and Engineering Management, vol. 2017-Decem, pp. 294–298. https://doi.org/10.1109/IEEM.2017.8289899.

  49. A. Ivaschenko, V. Avsievich, & P. Sitnikov. (2020). AR Guides Implementation for industrial production and manufacturing, vol. 641 LNEE

  50. Kranzer, S., et al. (2017). An intelligent maintenance planning framework prototype for production systems. Proceedings of the IEEE International Conference on Industrial Technology. https://doi.org/10.1109/ICIT.2017.7915520

    Article  Google Scholar 

  51. J. Wolfartsberger, J. Zenisek, M. Silmbroth, & C. Sievi. (2017). Towards an augmented reality and sensor-based assistive system for assembly tasks. In ACM International Conference Proceeding Series, vol. Part F1285, pp. 230–231. https://doi.org/10.1145/3056540.3064969.

  52. S. Matsuzoe, S. Jiang, M. Ueki, & K. Okabayashi. (2017). Intuitive visualization method for locating off-screen objects inspired by motion perception in peripheral vision. In AH ’17: Proceedings of the 8th Augmented Human International Conference, pp. 1–4. https://doi.org/10.1145/3041164.3041198.

  53. H. Álvarez, I. Aguinaga, & D. Borro. (2011). Providing guidance for maintenance operations using automatic markerless augmented reality system. In 2011 10th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2011, pp. 181–190.https://doi.org/10.1109/ISMAR.2011.6092385

  54. Ortega, M., Ivorra, E., Juan, A., Venegas, P., Martínez, J., & Alcañiz, M. (2021). Mantra: An effective system based on augmented reality and infrared thermography for industrial maintenance. Applied Sciences, 11(1), 1–26. https://doi.org/10.3390/app11010385

    Article  Google Scholar 

  55. Y. Sun et al. (2019). Towards industrial IoT-AR systems using deep learning-based object pose estimation. In 2019 IEEE 38th International Performance Computing and Communications Conference, IPCCC 2019, 2019, pp. 1–8https://doi.org/10.1109/IPCCC47392.2019.8958753

  56. Huang, W., Alem, L., Tecchia, F., & Duh, H.B.-L. (2018). Augmented 3D hands: A gesture-based mixed reality system for distributed collaboration. J. Multimodal User Interfaces, 12(2), 77–89. https://doi.org/10.1007/s12193-017-0250-2

    Article  Google Scholar 

  57. Vorraber, W., Gasser, J., Webb, H., Neubacher, D., & Url, P. (2020). Assessing augmented reality in production: remote-assisted maintenance with HoloLens. Procedia CIRP, 88, 139–144. https://doi.org/10.1016/j.procir.2020.05.025

    Article  Google Scholar 

  58. Ariansyah, D., et al. (2022). A head mounted augmented reality design practice for maintenance assembly: toward meeting perceptual and cognitive needs of AR users. Applied Ergonomics, 98, 103597.

    Article  Google Scholar 

  59. Havard, V., Baudry, D., Jeanne, B., Louis, A., & Savatier, X. (2021). A use case study comparing augmented reality (AR) and electronic document-based maintenance instructions considering tasks complexity and operator competency level. Virtual Reality. https://doi.org/10.1007/s10055-020-00493-z

    Article  Google Scholar 

  60. Lavric, T., Bricard, E., Preda, M., & Zaharia, T. (2021). Exploring low-cost visual assets for conveying assembly instructions in AR. International Conference on INnovations in Intelligent SysTems and Applications (INISTA), 2021, 1–6.

    Google Scholar 

  61. He, F., Ong, S. K., & Nee, A. Y. C. (2021). An integrated mobile augmented reality digital twin monitoring system. Computers, 10(8), 99.

    Article  Google Scholar 

  62. T. Perdpunya, S. Nuchitprasitchai, & P. Boonrawd. (2021). Augmented reality with mask R-CNN (ARR-CNN) inspection for Intelligent Manufacturing. In The 12th International Conference on Advances in Information Technology, pp. 1–7.

  63. Bottani, E., et al. (2021). Wearable and interactive mixed reality solutions for fault diagnosis and assistance in manufacturing systems: Implementation and testing in an aseptic bottling line. Computers in Industry, 128, 103429.

    Article  Google Scholar 

  64. J. Cavaleri, R. Tolentino, B. Swales, & L. Kirschbaum. (2021). Remote video collaboration during COVID-19. In 2021 32nd Annual SEMI Advanced Semiconductor Manufacturing Conference (ASMC), pp. 1–6. https://doi.org/10.1109/ASMC51741.2021.9435703.

  65. M. Lorenz, S. Shandilya, S. Knopp, & P. Klimant. (2021). Industrial augmented reality: connecting machine-, NC-and sensor-data to an AR maintenance support system. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), pp. 595–596

  66. B. Marques, S. Silva, A. Rocha, P. Dias, & B. S. Santos. (2021). Remote asynchronous collaboration in maintenance scenarios using augmented reality and annotations. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), pp. 567–568

  67. Ritucci, A. L., Frizziero, L., & Liverani, A. (2021). Maintainability approach: Hydraulic pump with external gears explored with design for disassembly and augmented reality. Applied Sciences, 11(2), 1–23. https://doi.org/10.3390/app11020666

    Article  Google Scholar 

  68. Rosales, J., Deshpande, S., & Anand, S. (2021). IIoT based augmented reality for factory data collection and visualization. Procedia Manufacturing, 53, 618–627.

    Article  Google Scholar 

  69. Wang, C.-H., Lo, W.-J., & Wang, M.-J.J. (2021). Usability evaluation of augmented reality-based maintenance instruction system. Human Factors and Ergonomics in Manufacturing & Service Industries. https://doi.org/10.1002/hfm.20942

    Article  Google Scholar 

  70. Chu, C.-H., & Ko, C.-H. (2021). An experimental study on augmented reality assisted manual assembly with occluded components. Journal of Manufacturing Systems. https://doi.org/10.1016/j.jmsy.2021.04.003

    Article  Google Scholar 

  71. R. Tanaka, T. Tanaka, & K. Konno. (2021). An examination of displaying reassembly procedure by recording disassembly procedure with AR markers. In International Workshop on Advanced Imaging Technology (IWAIT) 2021, vol. 11766, p. 117662J.

  72. Aschauer, A., Reisner-Kollmann, I., & Wolfartsberger, J. (2021). Creating an open-source augmented reality remote support tool for industry: Challenges and learnings. Procedia Computer Science, 180, 269–279.

    Article  Google Scholar 

  73. Mourtzis, D., Angelopoulos, J., & Zogopoulos, V. (2021). Integrated and adaptive AR maintenance and shop-floor rescheduling. Computers in Industry. https://doi.org/10.1016/j.compind.2020.103383

    Article  Google Scholar 

  74. C.-O. Ivascu, D. Ursutiu, & C. Samoila. (2021). Augmented reality production monitoring control room, vol. 1231 AISC

  75. Freddi, M., & Frizziero, L. (2020). Design for disassembly and augmented reality applied to a tailstock. Actuators, 9(4), 1–14. https://doi.org/10.3390/act9040102

    Article  Google Scholar 

  76. J. Izquierdo-Domenech, J. Linares-Pellicer, & J. Orta-Lopez. (2020). Supporting interaction in augmented reality assisted industrial processes using a CNN-based semantic layer. In Proceedings - 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2020, pp. 27–32. https://doi.org/10.1109/AIVR50618.2020.00014.

  77. J. Kim, M. Lorenz, S. Knopp, & P. Klimant. (2000). Industrial augmented reality: concepts and user interface designs for augmented reality maintenance worker support systems. In Adjunct Proceedings of the 2020 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2020, pp. 67–69. https://doi.org/10.1109/ISMAR-Adjunct51615.2020.00032.

  78. M. Lorenz, S. Knopp, J. Kim, & P. Klimant. (2020). Industrial augmented reality: 3D-content editor for augmented reality maintenance worker support system. In Adjunct Proceedings of the 2020 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2020, pp. 203–205. https://doi.org/10.1109/ISMAR-Adjunct51615.2020.00060.

  79. F. Bellalouna. (2020). Industrial use cases for augmented reality application. In 11th IEEE International Conference on Cognitive Infocommunications, CogInfoCom 2020 - Proceedings, pp. 11–18. https://doi.org/10.1109/CogInfoCom50765.2020.9237882

  80. B. Vogel-Heuser et al. (2020). Assisted safety test execution linking E-CAD and test management with augmented reality. In Proceedings - 2020 IEEE Conference on Industrial Cyberphysical Systems, ICPS 2020, pp. 196–202. https://doi.org/10.1109/ICPS48405.2020.9274747.

  81. Serras, M., García-Sardiña, L., Simões, B., Álvarez, H., & Arambarri, J. (2020). Dialogue enhanced extended reality: Interactive system for the operator 4.0. Applied Sciences. https://doi.org/10.3390/app10113960

    Article  Google Scholar 

  82. A. Burova et al. (2020). Utilizing VR and gaze tracking to develop AR solutions for industrial maintenance. In CHI ’20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–13. https://doi.org/10.1145/3313831.3376405.

  83. F. Obermair et al. (2020). Maintenance with augmented reality remote support in comparison to paper-based instructions: experiment and analysis. In 2020 IEEE 7th International Conference on Industrial Engineering and Applications, ICIEA 2020, pp. 942–947. https://doi.org/10.1109/ICIEA49774.2020.9102078.

  84. J. S. K. Patibandla, S. K. Adhikary, & J. Ukey. (2020). Augmented reality for assistive maintenance and real-time failure analysis in industries. In 2nd International Conference on Innovative Mechanisms for Industry Applications, ICIMIA 2020 - Conference Proceedings, 2020, pp. 149–153. https://doi.org/10.1109/ICIMIA48430.2020.9074846.

  85. Mourtzis, D., Siatras, V., & Angelopoulos, J. (2020). Real-time remote maintenance support based on augmented reality (AR). Applied Sciences. https://doi.org/10.3390/app10051855

    Article  Google Scholar 

  86. Morillo, P., García-García, I., Orduña, J. M., Fernández, M., & Juan, M. C. (2020). Comparative study of AR versus video tutorials for minor maintenance operations. Multimedia Tools and Applications, 79(11–12), 7073–7100. https://doi.org/10.1007/s11042-019-08437-9

    Article  Google Scholar 

  87. Gattullo, M., et al. (2020). Towards next generation technical documentation in augmented reality using a context-aware information manager. Applied Sciences. https://doi.org/10.3390/app10030780

    Article  Google Scholar 

  88. S. Coscetti, D. Moroni, G. Pieri, & M. Tampucci. (2020). Factory maintenance application using augmented reality. In APPIS 2020: Proceedings of the 3rd International Conference on Applications of Intelligent Systems, pp. 1–6. https://doi.org/10.1145/3378184.3378218.

  89. L. Gao, F. Wu, L. Liu, & X. Wan. (2020). Construction of equipment maintenance guiding system and research on key technologies based on augmented reality, vol. 634 LNEE

  90. Mourtzis, D., Angelopoulos, J., & Panopoulos, N. (2020). A framework for automatic generation of augmented reality maintenance and repair instructions based on convolutional Neural networks. Procedia CIRP, 93, 977–982. https://doi.org/10.1016/j.procir.2020.04.130

    Article  Google Scholar 

  91. Erkoyuncu, J., & Khan, S. (2020). Olfactory-based augmented reality support for industrial maintenance. IEEE Access, 8, 30306–30321. https://doi.org/10.1109/ACCESS.2020.2970220

    Article  Google Scholar 

  92. E. Yigitbas, I. Jovanovikj, S. Sauer, & G. Engels. (2020). On the development of context-aware augmented reality applications, vol. 11930 LNCS

  93. D. Brice, K. Rafferty, & S. McLoone. (2020). AugmenTech: The usability evaluation of an ar system for maintenance in industry, vol. 12243 LNCS

  94. Schmiedinger, T., Petke, M., von Czettritz, L., Wohlschläger, B., & Adam, M. (2020). Augmented reality as a tool for providing informational content in different production domains. Procedia Manufacturing, 45, 423–428. https://doi.org/10.1016/j.promfg.2020.04.047

    Article  Google Scholar 

  95. P. Fleck, F. Reyes-Aviles, C. Pirchheim, C. Arth, & D. Schmalstieg. (2020). Maui: Tele-assistance for maintenance of cyber-physical systems. In VISIGRAPP 2020 - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, vol. 5, pp. 800–812.

  96. Boonbrahm, S., Boonbrahm, P., & Kaewrat, C. (2020). The use of marker-based augmented reality in space measurement. Procedia Manufacturing, 42, 337–343. https://doi.org/10.1016/j.promfg.2020.02.081

    Article  Google Scholar 

  97. Zhukovskiy, Y. L., & Koteleva, N. I. (2019). Electrical equipment maintenance system with elements of augmented reality technology. IOP Conference Series: Materials Science and Engineering. https://doi.org/10.1088/1757-899X/643/1/012024

    Article  Google Scholar 

  98. S. Coscetti, D. Moroni, G. Pieri, & M. Tampucci. (2019). Augmented reality for tissue converting maintenance. In Proceedings - 15th International Conference on Signal Image Technology and Internet Based Systems, SISITS 2019, pp. 585–590. https://doi.org/10.1109/SITIS.2019.00098.

  99. P. Zhao, H. Wu, X. Shi, J. Li, X. Yi, & S. Liu. (2019). Research on maintenance guiding system based on augmented reality. In Proc. - 2019 Int. Conf. Sensing, Diagnostics, Progn. Control. SDPC 2019, pp. 944–949. https://doi.org/10.1109/SDPC.2019.00180.

  100. L. Gao, Z. Gao, F. Wu, S. Liu, & L. Liu. (2019). Research on visual monitoring and auxiliary maintenance technology of equipment based on augmented reality. In Proceedings—2019 11th International Conference on Intelligent Human-Machine Systems and Cybernetics, IHMSC 2019, 2019, vol. 1, pp. 93–97. https://doi.org/10.1109/IHMSC.2019.00030.

  101. M. Khalil, C. Bergs, T. Papadopoulos, R. Wuchner, K.-U. Bletzinger, & M. Heizmann. (2019). IIoT-based fatigue life indication using augmented reality. In IEEE International Conference on Industrial Informatics (INDIN), vol. 2019-July, pp. 746–751. https://doi.org/10.1109/INDIN41052.2019.8972114.

  102. N. Prajapat, A. Tiwari, D. Tiwari, C. Turner, & W. Hutabarat (2019) A framework for next generation interactive and immersive des models. In IEEE International Conference on Industrial Informatics (INDIN), vol. 2019-July, pp. 671–676. https://doi.org/10.1109/INDIN41052.2019.8972266.

  103. Zubizarreta, J., Aguinaga, I., & Amundarain, A. (2019). A framework for augmented reality guidance in industry. International Journal of Advanced Manufacturing Technology, 102(9–12), 4095–4108. https://doi.org/10.1007/s00170-019-03527-2

    Article  Google Scholar 

  104. M. Kostolani, J. Murin, & S. Kozak. (2019). Intelligent predictive maintenance control using augmented reality. In Proceedings of the 2019 22nd International Conference on Process Control, PC 2019, pp. 131–135. https://doi.org/10.1109/PC.2019.8815042.

  105. Tran, B., & Sastry, S. (2019). Mapping a virtual view to the physical world to guide the completion of complex task sequences. IEEE International Systems Conference (SysCon), 2019, 1–8. https://doi.org/10.1109/SYSCON.2019.8836724

    Article  Google Scholar 

  106. V. Rajan, N. V. Sobhana, & R. Jayakrishnan. (2019) Machine fault diagnostics and condition monitoring using augmented reality and IoT. In Proceedings of the 2nd International Conference on Intelligent Computing and Control Systems, ICICCS 2018, pp. 910–914. https://doi.org/10.1109/ICCONS.2018.8663135.

  107. L. Liu, C. Jiang, Z. Gao, & Y. Wang. (2019). Research on real-time monitoring technology of equipment based on augmented reality. In Advanced Manufacturing and Automation VIII. IWAMA 2018. Lecture Notes in Electrical Engineering, vol. 484, Y. T. Wang K., Wang Y., Strandhagen J., Ed. Singerpore: Springer, pp. 141–150

  108. Aschenbrenner, D., et al. (2019). Comparing human factors for augmented reality supported single-user and collaborative repair operations of industrial robots. Frontiers in Robotics and AI. https://doi.org/10.3389/frobt.2019.00037

    Article  Google Scholar 

  109. De Pace, F., Manuri, F., Sanna, A., & Zappia, D. (2019). A comparison between two different approaches for a collaborative mixed-virtual environment in industrial maintenance. Frontiers in Robotics and AI. https://doi.org/10.3389/frobt.2019.00018

    Article  Google Scholar 

  110. D. Phillips, A. Pooransingh, & S. Guven. (2019) ORB-based multiple fixed resolution approach for on-board visual recognition, vol. 11516 LNCS

  111. He, F., Ong, S. K., & Nee, A. Y. C. (2019). A mobile solution for augmenting a manufacturing environment with user-generated annotations. Information. https://doi.org/10.3390/info10020060

    Article  Google Scholar 

  112. S. Mohan, K. Ramea, B. Price, M. Shreve, H. Eldardiry, & L. Nelson. (2019). Building Jarvis—A learner-aware conversational trainer. In CEUR Workshop Proceedings, vol. 2327.

  113. R. Hamidane, L. H. Mouss, A. Bellarbi, & R. Mahdaoui. (2018). Implementation of a preventive maintenance system based on augmented reality. In 2018 3rd International Conference on Pattern Analysis and Intelligent Systems (PAIS), pp. 1–6. https://doi.org/10.1109/PAIS.2018.8598510

  114. Häkkilä, J., Väyrynen, J., Suoheimo, M., & Colley, A. (2018). Exploring head mounted display based augmented reality for factory workers. ACM International Conference Proceeding Series. https://doi.org/10.1145/3282894.3289745

    Article  Google Scholar 

  115. A. Cachada et al. (2018). Maintenance 4.0: Intelligent and predictive maintenance system architecture. In IEEE Int. Conf. Emerg. Technol. Fact. Autom. ETFA, vol. 2018-Septe, pp. 139–146. https://doi.org/10.1109/ETFA.2018.8502489

  116. K. Kammerer, R. Pryss, K. Sommer, & M. Reichert. (2018). Towards context-aware process guidance in cyber-physical systems with augmented reality. In Proceedings - 2018 4th International Workshop on Requirements Engineering for Self-Adaptive, Collaborative, and Cyber Physical Systems, RESACS 2018, pp. 44–51. https://doi.org/10.1109/RESACS.2018.00013.

  117. B. Zhou, S. Guven, S. Tao, & F. Ye. (2018). Poster: Pose-assisted active visual recognition in mobile augmented reality. In Proceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM, pp. 756–758. https://doi.org/10.1145/3241539.3267771.

  118. S. Aromaa, A. Väätänen, E. Kaasinen, M. Uimonen, & S. Siltanen. (2018). Human factors and ergonomics evaluation of a tablet based augmented reality system in maintenance work. In ACM International Conference Proceeding Series, pp. 118–125. https://doi.org/10.1145/3275116.3275125

  119. A. Princle et al. (2018). Using an industry-ready AR HMD on a real maintenance task: AR benefits performance on certain task steps more than others. In Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018, pp. 236–241.https://doi.org/10.1109/ISMAR-Adjunct.2018.00075

  120. Crivellaro, A., Rad, M., Verdie, Y., Yi, K. M., Fua, P., & Lepetit, V. (2018). Robust 3D object tracking from monocular images using stable parts. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(6), 1465–1479. https://doi.org/10.1109/TPAMI.2017.2708711

    Article  Google Scholar 

  121. A. Seitz, D. Henze, J. Nickles, M. Sauer, & B. Bruegge. (2018). Augmenting the industrial Internet of Things with Emojis. In 2018 3rd International Conference on Fog and Mobile Edge Computing, FMEC 2018, pp. 240–245. https://doi.org/10.1109/FMEC.2018.8364073.

  122. Vignali, G., Bertolini, M., Bottani, E., Di Donato, L., Ferraro, A., & Longo, F. (2018). Design and testing of an augmented reality solution to enhance operator safety in the food industry. International Journal of Food Engineering. https://doi.org/10.1515/ijfe-2017-0122

    Article  Google Scholar 

  123. Leutert, F., & Schilling, K. (2018). Projector-based augmented reality for telemaintenance support. IFAC-PapersOnLine, 51(11), 502–507. https://doi.org/10.1016/j.ifacol.2018.08.368

    Article  Google Scholar 

  124. A. Setti, P. Bosetti, & M. Ragni. (2018). ARTool—augmented reality human-machine interface for machining setup and maintenance. In Intelligent Systems and Applications. IntelliSys 2016. Studies in Computational Intelligence, vol. 751, B. R. Bi Y., Kapoor S., Ed. Cham: Springer, pp. 131–155

  125. Rabah, S., et al. (2018). Towards improving the future of manufacturing through digital twin and augmented reality technologies. Procedia Manufacturing, 17, 460–467. https://doi.org/10.1016/j.promfg.2018.10.070

    Article  Google Scholar 

  126. M. Heinz, H. Dhiman, & C. Röcker. (2018). A multi-device assistive system for industrial maintenance operations, vol. 11015 LNCS

  127. Mourtzis, D., Vlachou, E., & Zogopoulos, V. (2018). Mobile apps for providing product-service systems and retrieving feedback throughout their lifecycle: A robotics use case. International Journal of Product Lifecycle Management, 11(2), 116–130. https://doi.org/10.1504/IJPLM.2018.092821

    Article  Google Scholar 

  128. H. Vincent, J. Benoit, S. Xavier, & B. David. (2017). Inoovas—Industrial ontology for operation in virtual and augmented scene: The architecture. In 2017 4th International Conference on Control, Decision and Information Technologies, CoDIT 2017, vol. 2017-Janua, pp. 300–305. https://doi.org/10.1109/CoDIT.2017.8102608.

  129. Lamberti, F., Manuri, F., Paravati, G., Piumatti, G., & Sanna, A. (2017). Using semantics to automatically generate speech interfaces for wearable virtual and augmented reality applications. IEEE Transactions on Human-Machine Systems, 47(1), 152–164. https://doi.org/10.1109/THMS.2016.2573830

    Article  Google Scholar 

  130. R. Perla, G. Gupta, R. Hebbalaguppe, & E. Hassan. (2017). InspectAR: An augmented reality inspection framework for industry. In Adjunct Proceedings of the 2016 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016, pp. 355–356. https://doi.org/10.1109/ISMAR-Adjunct.2016.0119.

  131. Yew, A. W. W., Ong, S. K., & Nee, A. Y. C. (2017). Immersive augmented reality environment for the teleoperation of maintenance robots. Procedia CIRP, 61, 305–310. https://doi.org/10.1016/j.procir.2016.11.183

    Article  Google Scholar 

  132. D. Mourtzis, E. Vlachou, V. Zogopoulos, & X. Fotini. (2017). Integrated production and maintenance scheduling through machine monitoring and augmented reality: An industry 4.0 approach. In Advances in Production Management Systems. The Path to Intelligent, Collaborative and Sustainable Manufacturing. APMS 2017. IFIP Advances in Information and Communication Technology, vol. 513, K. D. Lödding H., Riedel R., Thoben KD., von Cieminski G., Ed. Cham: Springer, pp. 354–362

  133. Quint, F., Loch, F., & Bertram, P. (2017). The challenge of introducing AR in industry—results of a participative process involving maintenance engineers. Procedia Manufacturing, 11, 1319–1323. https://doi.org/10.1016/j.promfg.2017.07.260

    Article  Google Scholar 

  134. H. Hiraoka, A. Nagasawa, Y. Fukumashi, & Y. Fukunaga. (2017). Replacement of parts by part agents to promote reuse of mechanical parts. In Product Lifecycle Management and the Industry of the Future. PLM 2017. IFIP Advances in Information and Communication Technology, vol. 517, F. S. Ríos J., Bernard A., Bouras A., Ed. Cham: Springer, pp. 394–403

Download references

Acknowledgements

This work was financially support by Ministry of Science and Technology of Taiwan under the Grant number 109-2221-E-007-064-MY3.

Author information

Authors and Affiliations

  1. Department of Industrial Engineering and Engineering Management, National Tsing Hua University, Hsinchu, Taiwan

    Joel Murithi Runji, Yun-Ju Lee & Chih-Hsing Chu

Authors
  1. Joel Murithi Runji
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yun-Ju Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chih-Hsing Chu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chih-Hsing Chu.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Runji, J.M., Lee, YJ. & Chu, CH. Systematic Literature Review on Augmented Reality-Based Maintenance Applications in Manufacturing Centered on Operator Needs. Int. J. of Precis. Eng. and Manuf.-Green Tech. 10, 567–585 (2023). https://doi.org/10.1007/s40684-022-00444-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40684-022-00444-w

Keywords

Search

Navigation