A Flexible AR-based Training System for Industrial Maintenance

  • Andrea Sanna
  • Federico ManuriEmail author
  • Giovanni Piumatti
  • Gianluca Paravati
  • Fabrizio Lamberti
  • Pietro Pezzolla
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9254)


Augmented Reality (AR) has been proved to be an effective tool to improve and enhance the learning experience of students. On the other hand, issues regarding the inflexibility of AR contents can strongly limit the usability of AR applications in education. This paper presents results obtained by using the AR framework designed and developed for the EASE-R\(^{3}\) European project and focused on the generation of maintenance procedures for machine tools. The high system flexibility allows instructors to easily make maintenance procedures suitable for the skill level of technicians to be trained. A case study is presented and results gathered so far analyzed and assessed.


Augmented Reality Maintenance Training system 


  1. 1.
    Abhari, K., Baxter, J.S.H., Chen, E.C.S., Khan, A.R., Peters, T.M., de Ribaupierre, S., Eagleson, R.: Training for planning tumour resection: augmented reality and human factors. IEEE Trans. Biomed. Eng. 62(6), 1466–1477 (2014)CrossRefGoogle Scholar
  2. 2.
    Amrit, M., Bansal, H., Yammiyavar, P.: Studies in application of augmented reality in E-learning courses. In: Chakrabarti, A. (ed.) ICoRD 2015 Research into Design Across Boundaries. Smart Innovation, Systems and Technologies, vol. 2, pp. 375–384. Springer, India (2015)Google Scholar
  3. 3.
    Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Comput. Graph. Appl. 21(6), 34–47 (2001)CrossRefGoogle Scholar
  4. 4.
    Behzadana, A.H., Kamatb, V.R.: Enabling discovery-based learning in construction using telepresent augmented reality. Autom. Constr. 33, 3–10 (2013)CrossRefGoogle Scholar
  5. 5.
    Billinghurst, M., Kato, H., Poupyrev, I.: The MagicBook - moving seamlessly between reality and virtuality. IEEE Comput. Graph. Appl. 21(3), 6–8 (2002)Google Scholar
  6. 6.
    Billinghurst, M., Anders, H.: Mobile architectural augmented reality. In: Wang, X., Schnabel, M.A. (eds.) Mixed Reality in Architecture, Design and Construction, pp. 93–104. Springer, Netherlands (2009)CrossRefGoogle Scholar
  7. 7.
    Chae, C., Ko, K.: Introduction of physics simulation in augmented reality. In: International Symposium on Ubiquitous Virtual Reality, pp. 37–40 (2008)Google Scholar
  8. 8.
    Chen, T.C.: A study of comparing the use of augmented reality and physical models in chemistry education. In: Proceedings of the 2006 ACM International Conference on Virtual Reality Continuum and Its Applications, pp. 369–372 (2006)Google Scholar
  9. 9.
    Cheok, A.D., Fong, S.W., Goh, K.H., Yang, X., Liu, W., Farzbiz, F., Li, Y.: Human Pacman: a mobile entertainment system with ubiquitous computing and tangible interaction over a wide outdoor area. In: Chittaro, L. (ed.) Mobile HCI 2003. LNCS, vol. 2795, pp. 209–223. Springer, Heidelberg (2003) CrossRefGoogle Scholar
  10. 10.
    Cook, J., Gibson, S., Howard, T., Hubbold, R.: Real-time photo-realistic augmented reality for interior design. In: ACM SIGGRAPH 2003 Sketches & Applications. ACM (2003)Google Scholar
  11. 11.
    Datcu, D., Cidota, M., Lukosch, S., Oliveira, D.M., Wolff, M.: Virtual co-location to support remote assistance for inflight maintenance in ground training for space missions. In: Proceedings of the 15th International Conference on Computer Systems and Technologies, pp. 134–141 2014Google Scholar
  12. 12.
    De Crescenzio, F., Fantini, M., Persiani, F., Di Stefano, L., Azzari, P., Salti, S.: Augmented reality for aircraft maintenance training and operations support. IEEE Comput. Graph. Appl. 31(1), 96–101 (2011)CrossRefGoogle Scholar
  13. 13.
    Deliyiannis, I., Papaioannou, G.: Augmented reality for aecheological environments on mobile devices: a novel open framework. Mediterr. Archaeol. Archaeometry 14(4), 1–10 (2014)Google Scholar
  14. 14.
    Di Serio, A., Ibáñez, M.B., Kloos, C.D.: Impact of an augmented reality system on students’ motivation for a visual art course. Comput. Educ. 68, 586–596 (2013)CrossRefGoogle Scholar
  15. 15.
    Dunleavy, M., Dede, C., Mitchell, R.: Affordances and limitations of immersive participatory augmented reality simulations for teaching and learning. J. Sci. Educ. Technol. 18(1), 7–22 (2009)CrossRefGoogle Scholar
  16. 16.
    EASE-R\(^{3}\) project web site.
  17. 17.
    Feiner, S., Blair, M., Dorée, S.: Knowledge-based augmented reality. Commun. ACM 36(7), 52–62 (1993)CrossRefGoogle Scholar
  18. 18.
    Goose, S., Sudarsky, S., Zhang, X., Navab, N.: Speech-enabled augmented reality supporting mobile industrial maintenance. IEEE Pervasive Comput. 2(1), 65–70 (2003)CrossRefGoogle Scholar
  19. 19.
    Gomes, L., Martins, V.F., Dias, D.C., de Paiva Guimaraẽs, M.: Music-AR: augmented reality in teaching the concept of sound loudness to children in pre-school. In: Proceedings of the XVI Symposium on Virtual and Augmented Reality, pp. 114–117 (2014)Google Scholar
  20. 20.
    Henderson, S., Feiner, S.: Exploring the benefits of augmented reality documentation for maintenance and repair. IEEE Trans. Vis. Comput. Graph. 17(10), 1355–1368 (2011)CrossRefGoogle Scholar
  21. 21.
    Ivanova, G., Aliev, Y., Ivanov, A.: Augmented reality textbook for future blended education. In: Proceedings of the International Conference on E-Learning, vol. 14, pp. 130–136 (2014)Google Scholar
  22. 22.
    Johnson, L.F., Levine, A., Smith, R.S., Haywood, K.: Key emerging technologies for elementary and secondary education. Educ. Digest 76(1), 36–40 (2010)Google Scholar
  23. 23.
    Johnson, L.F., Levine, A., Smith, R.S., Haywood, K.: Key emerging technologies for postsecondary education. Educat. Digest 76(2), 34–38 (2010)Google Scholar
  24. 24.
    Kaufmann, H.: Construct3D: an augmented reality application for mathematics and geometry education. In: Proceedings of the Tenth ACM International Conference on Multimedia, pp. 656–657 (2002)Google Scholar
  25. 25.
    Kaufmann, H., Schmalstieg, D.: Mathematics and geometry education with collaborative augmented reality. Comput. Graph. 27(3), 339–345 (2003)CrossRefGoogle Scholar
  26. 26.
    Kaufmann, H., Meyer, B.: Simulating educational physical experiments in augmented reality. In: ACM SIGGRAPH ASIA 2008 Educators Programme Article No. 3 (2008)Google Scholar
  27. 27.
    Kerawalla, L., Luckin, R., Seljeflot, S., Woolard, A.: Making it real: exploring the potential of augmented reality for teaching primary school science. Virtual Reality 10(3), 163–174 (2006)CrossRefGoogle Scholar
  28. 28.
    Kim, H., Yoon, O., Han, J., Nam, K.: Distributed cognition-applied smart learning environment: designa DN implementation. In: Porceedings of the 6th International Conference on Education and New Learning Technologies (2014)Google Scholar
  29. 29.
    Lamberti, F., Manuri, F., Sanna, A., Paravati, G., Pezzolla, P., Montuschi, P.: Challenges, opportunities and future trends of emerging techniques for augmented reality-based maintenance. IEEE Trans. Emerg. Top. Comput. 2(4), 411–421 (2014). doi: 10.1109/TETC.2014.2368833 CrossRefGoogle Scholar
  30. 30.
    Liarokapis, F., Petridis, P., Lister, P.F., White, M.: Multimedia augmented reality interface for e-learning (MARIE). World Trans. Eng. Technol. Educ. 1, 173–176 (2002)Google Scholar
  31. 31.
    Liarokapis, F., Mourkoussis, N., White, M., Darcy, J., Sifniotis, M., Petridis, P., Basu, A., Lister, P.F.: Web3D and augmented reality to support engineering education. World Trans. Eng. Technol. Educ. 3(1), 11–14 (2004)Google Scholar
  32. 32.
    Liu, D., Jenkins, S.A., Sanderson, P.M., Fabian, P., Russell, W.J.: Monitoring with head-mounted displays: performance and safety in a full-scale simulator and part-task trainer. Anesth Analg. 109, 1135–46 (2009)CrossRefGoogle Scholar
  33. 33.
    Manuri, F., Sanna, A., Lamberti, F., Paravati, G., Pezzolla, P.: A workflow analysis for implementing AR-based maintenance procedures. In: De Paolis, L.T., Mongelli, A. (eds.) AVR 2014. LNCS, vol. 8853, pp. 185–200. Springer, Heidelberg (2014) Google Scholar
  34. 34.
    Martin-Gutierrez, J., Fabiani, P., Benesova, W., Meneses-Fernandez, M.D., Mora, C.E.: Augmented reality to promote collaborative and autonomous learning in higher education. Computers in Human Behavior (2014). doi: 10.1016/j.chb.2014.11.093
  35. 35.
    Metaio SDK web site.
  36. 36.
    Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. E77–D(12), 1321–1329 (1994)Google Scholar
  37. 37.
    Mitchell, R.: Alien contact!: exploring teacher implementation of an augmented reality curricular unit. J. Comput. Math. Sci. Teach. 30(3), 271–302 (2011)Google Scholar
  38. 38.
    Neea, A.Y.C., Onga, S.K., Chryssolourisb, G., Mourtzisb, D.: Augmented reality applications in design and manufacturing. CIRP Ann. Manufact. Technol. 61, 657–679 (2012)CrossRefGoogle Scholar
  39. 39.
    Ong, S.K., Yuan, M.L., Nee, A.Y.C.: Augmented reality applications in manufacturing: a survey. Intl J. Prod. Res. 46, 2707–2742 (2008)zbMATHCrossRefGoogle Scholar
  40. 40.
    Ohshima, K.S., Yamamoto, H., Tamura, H.: AR\(^{2}\) hockey system: a collaborative mixed reality system. Trans. VRSJ 3(2), 55–60 (1998)Google Scholar
  41. 41.
    Pantoja, G., Garza, L.E., Mendivil, E.G.: Augmented reality in pneumatic conveying system: fuller pump dry material line charger. In: Proceedings of the 9th Iberian Conference on Information Systems and Technologies, pp. 1–5 (2014)Google Scholar
  42. 42.
    Shelton, B.E., Hedley, N.R.: Using augmented reality for teaching EarthSun relationships to Undergraduate Geography students. In: The First IEEE International Augmented Reality Toolkit Workshop (2002)Google Scholar
  43. 43.
    Sielhorst, T., Feuerstein, M., Navab, N.: Advanced medical displays: a literature review of augmented reality. J. Display Technol. 4(4), 451–467 (2008)CrossRefGoogle Scholar
  44. 44.
    Stanimirovic, D., Damasky, N., Webel, S., Koriath, D., Spillner, A., Kurz, D.: A mobile augmented reality system to assist auto mechanics. In: proceedings of the IEEE International Symposium on Mixed and Augmented Reality (2014)Google Scholar
  45. 45.
    Sumadio, D.D., Rambli, D.R.A.: Preliminary evaluation on user acceptance of the augmented reality use for education. In: Proceedings of the 2nd International Conference on Computer Engineering and Applications, vol. 2, pp. 461–465 (2010)Google Scholar
  46. 46.
    Sutherland, I.: A head-mounted three-dimensional display. In: Fall Joint Computer Conference on American Federation of Information Processing Societies (AFIPS) Conference Proceedings, vol. 33. Thompson Books, Washington, D.C., pp. 757–764 (1968)Google Scholar
  47. 47.
    Thomas, B., Close, B., Donoghue, J., Squires, J., De Bondi, P., Morris, M., Piekarski, W.: ARQuake: an outdoor/indoor augmented reality first person application. In: Proceedings of the 4th International Symposium on Wearable Computers, pp 139–146 (2000)Google Scholar
  48. 48.
    Tsai, C.H., Huang, J.Y.: A mobile augmented reality based scaffolding platform for outdoor fieldtrip learning. In: Proceedings of the 3rd International Conference on Advanced Applied Informatics, pp. 307–312 (2014)Google Scholar
  49. 49.
    Wang, J., Feng, Y., Zeng, C., Li, S.: An augmented reality based system for remote collaborative maintenance instruction of complex products. In: Proceedings of IEEE International Conference on the Automation Science and Engineering, pp. 309–314 (2014)Google Scholar
  50. 50.
    Wu, H.K., Lee, S.W.Y., Chang, H.Y., Liang, J.C.: Current status, opportunities and challenges of augmented reality in education. Comput. Educ. 62, 41–49 (2013)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Andrea Sanna
    • 1
  • Federico Manuri
    • 1
    Email author
  • Giovanni Piumatti
    • 1
  • Gianluca Paravati
    • 1
  • Fabrizio Lamberti
    • 1
  • Pietro Pezzolla
    • 2
  1. 1.Politecnico di Torino, Dipartimento di Automatica e InformaticaTurinItaly
  2. 2.Fidia S.p.A.San Mauro Torinese TOItaly

Personalised recommendations