Skip to main content

Evaluation Design for Learning with Mixed Reality in Mining Education Based on a Literature Review

  • Conference paper
  • First Online:
Learning and Collaboration Technologies: Games and Virtual Environments for Learning (HCII 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12785))

Included in the following conference series:


Mixed Reality technologies are on the rise in the educational sector. However, research shows that there is still a lack in knowledge concerning the evaluation of these technologies. In this paper we present a research on current practices in evaluation for Mixed Reality. For this purpose, we selected 94 publications from between 2015 and 2021 and reduced them to 45 which included formal evaluation processes. We then adapted a classification scheme by Duenser et al. [5] and categorized these papers according to their evaluation methods. We present our overall findings and explain some examples more detailed. The results are then compared to previous work outside and within the MiReBooks project and applied on the didactical framework. This allows us to illustrate the development of this sector over the last years and it helps us to enhance our own evaluation approaches. First results also show that there is a rise in evaluation approaches recently and that the overall goals for these processes did not change much from 2008.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others


  1. Kommetter, C., Ebner, M.: A pedagogical framework for mixed reality in classrooms based on a literature review. In: Bastiaens, J.T. (ed.) Proceedings of EdMedia + Innovate Learning, pp. 901–911. Association for the Advancement of Computing in Education (AACE), Amsterdam, Netherlands (2019)

    Google Scholar 

  2. Wagner, H.: How to address the crisis of mining engineering education in the western world? Min. Res. Eng. 8(04), 471–481 (1999)

    Article  Google Scholar 

  3. Daling, L., Eck, C., Abdelrazeq, A., Hees, F.: Potentials and challenges of using mixed reality in mining education. A Europe-wide interview study. In: Augmented Reality in Education, A New Technology for Teaching and Learning, pp. 185–195, Aachen, Germany (2020)

    Google Scholar 

  4. Kalkofen, D., Mori, S., Ladinig, T., Daling, L.: Tools for teaching mining student in virtual reality based on 360° video experiences. In: IEEE VR Fifth Workshop on K-12+ Embodied Learning through Virtual & Augmented Reality, Atlanta, USA (2020)

    Google Scholar 

  5. Duenser, A., Billinghurst, M., Grasset, R.: A Survey of Evaluation Techniques Used in Augmented Reality Studies. University of Canterbury, Human Interface Technology Laboratory New Zealand (2008)

    Book  Google Scholar 

  6. Tang, Y.M., et al.: Evaluating the effectiveness of learning design with mixed reality (MR) in higher education. Virtual Reality 24, 797–807 (2020)

    Article  Google Scholar 

  7. Granic, A., Nakic, J., Marangunic, N.: Scenario-based group usability testing as a mixed methods approach to the evaluation of three-dimensional virtual-learning environments. J. Educ. Comput. Res. 58(3), 616–639 (2020)

    Article  Google Scholar 

  8. Calvo-Ferrer, J.: Educational games as stand-alone learning tools and their motivational effect on L2 vocabulary acquisition and perceived learning gains. Br. J. Edu. Technol. 48(2), 264–278 (2017)

    Article  Google Scholar 

  9. Scullion, J., Baxter, G., Stansfield, M.: UNITE: enhancing student’s elf-efficacy through the use of a 3D virtual world. J. Univ. Comput. Sci. 21(12), 1635–1653 (2015)

    Google Scholar 

  10. Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. 77(12), 1321–1329 (1994)

    Google Scholar 

  11. Dede, C., Jacobson, J., Richards, J.: Introduction: virtual augmented and mixed realities in education. In: Liu, D., Dede, C., Huang, R., Richards, J.: Virtual, Augmented, and Mixed Realities in Education. Singapore: Springer, pp. 1–19 (2017).

  12. Dawley, L., Dede, C.: Situated learning in virtual worlds and immersive simulations. In: Handbook of Research on Educational Communications and Technology. New York: Springer (2014).

  13. Schiffeler, N., Stehling, V., Haberstroh, M., Isenhardt, I.: Collaborative augmented reality in engineering education. In: Auer, M.E., Ram B.K. (eds.) REV2019 2019. LNNS, vol. 80, pp. 719–732. Springer, Cham (2020).

    Chapter  Google Scholar 

  14. Daling, L., Kommetter, C., Abdelrazeq, A., Ebner, M., Ebner, M.: Mixed reality books: applying augmented and virtual reality in mining engineering education. In: Geroimenko, V. (ed.) Augmented Reality in Education. SSCC, pp. 185–195. Springer, Cham (2020).

    Chapter  Google Scholar 

  15. Bertignoll, H., Ortega, M.L., Feiel, S.: MiReBooks – mixed reality Lehrbücher für das Bergbau-Studium (MiReBooks – mixed reality handbooks for mining education. Berg Huettenmaenn Monatsh. 164, 178–182 (2019)

    Article  Google Scholar 

  16. Swan, J., Gabbard, J.: Survey of user-based experimentation in augmented reality. In: 1st International Conference on Virtual Reality, Las Vegas, Nevada (2005)

    Google Scholar 

  17. Oliver, M.: An introduction to the evaluation of learning technology. international forum of educational technology and society. J. Educ. Technol. Soc. 3(4), 20–30 (2000)

    Google Scholar 

  18. Galvin, J., Roxborough, F.: Mining Engineering Education in the 21st Century – Will Universities Still Be Relevant? The AusIMM Annual Conference Ballarat (1997)

    Google Scholar 

  19. Kazanin, O., Drebenstedt, C.: Mining education in the 21st century: global challenges and prospects. Mining education: traditions and perspectives in the 21st Century. J. Mining Institute 225, 369–375 (2017)

    Google Scholar 

  20. Lee, K.: Augmented reality in education and training. TechTrends 56(2), 13–21 (2012)

    Article  Google Scholar 

  21. Winn, W.: A conceptual basis for educational applications of virtual reality. human interface technology laboratory. University of Washington. Accessed 08 Jan 2021 (1993)

  22. Radu, I.: Augmented reality in education: a meta-review and cross-media analysis. Pers. Ubiquit. Comput. 18(6), 1533–1543 (2014)

    Article  Google Scholar 

  23. Santos, M., Chen, A., Taketomi, T., Yamamoto, G., Miyazaki, J., Kato, H.: Augmented reality learning experiences: survey of prototype design and evaluation. IEEE Trans. Learn. Technol. 7(1), 38–56 (2014)

    Article  Google Scholar 

  24. Bloom, B.S., Engelhart, M.D., Furst, E.J., Hill, W.H., Krathwohl, D.R.: Taxonomy of Educational Objectives: the Classification of Educational Goals, Handbook I: Cognitive Domain. David McKay, New York (1956)

    Google Scholar 

  25. Khodaei, S., Sieger, J, Abdelrazeq, A., Isenhardt, I.: Learning goals in 360° virtual excursion - media creation guideline for mixed-reality-based classes. In: ICERI 2020 Proceedings, pp. 2552–2561

    Google Scholar 

  26. Kolb, D.A., Boyatzis, R.E., Mainemelis, C.: Experiential learning theory: previous research and new directions. In: Perspectives on Thinking, Learning and Cognitive Styles, NJ: Lawrence Erlbaum, pp. 227–247 (2001)

    Google Scholar 

  27. Brooke, J: SUS: A Quick and Dirty Usability Scale. In: Usability Evaluation in Industry. Taylor and Francis, London, pp. 107–114 (1996)

    Google Scholar 

  28. Lee, P.Y., Lau, K.W., Kann, C.W.: Doing textiles experiments in game-based virtual reality. A design of the stereoscopic chemical laboratory (SCL) for textiles education. Int. J. Inf. Learn. Technol. 34(3), 242–258 (2017)

    Google Scholar 

  29. Takala, T.M., Malmi, L., Pugliese, R., Takala, T.: Empowering students to create better virtual reality applications: a longitudinal study of a VR capstone course. Inf. Educ. 15(2), 287–317 (2016)

    Google Scholar 

  30. Marengo, A., Pagano, A., Ladisa, L.: Towards a mobile augmented reality prototype for corporate training: a new perspective. In: 14th International Conference Mobile Learning, pp. 129–135 (2018)

    Google Scholar 

  31. Thanyadit, S., Punpongsanon, P., Pong, T.: Investigating visualization techniques for observing a group of virtual reality users using augmented reality. In: 2019 IEEE Conference on Virtual Reality and 3D User Interfaces. Osaka, Japan, pp. 1189–1190 (2019)

    Google Scholar 

  32. Summers, B.J., Schwartzberg, A.C., Wilhelm, S.: A virtual reality study of cognitive biases in body dysmorphic disorder. J. Abnorm. Psychol. 130(1), 26–33 (2021).

  33. Pombo, L, Marques, M.: The EduPark mobile augmented reality game: learning value and usability. In: 14th Conference Mobile Learning, pp. 23–30 (2018)

    Google Scholar 

  34. Shahriari-Rad, A., Cox, M., Woolford, M.: Clinical skills acquisition: rethinking assessment using a virtual haptic simulator. Technol. Knowl. Learn. 22(2), 185–197 (2017).

    Article  Google Scholar 

  35. Lozada-Yánez, R., La-Serna-Palomino, N., Molina-Granja, F.: Augmented reality and MS-kinect in the learning of basic mathematics: KARMLS case. Int. Educ. Stud. 12(9), 54–69 (2019)

    Article  Google Scholar 

  36. Caputo, F., Mendes, D., Bonetti, A., Saletti, G., Andrea, G.: Smart choices for deviceless and device-based manipulation in immersive virtual reality. In: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces. Reutlingen, Germany, pp. 519–520 (2018)

    Google Scholar 

  37. Lemheney, A., Bond, W., Padon, J., LeClair, M., Miller, J., Susko, M.: Developing virtual reality simulations for office-based medical emergencies. J. Virtual Worlds Res. 9(1), 1–18 (2016)

    Google Scholar 

  38. Cujitarom, W., Piriyasurawong, P.: Animation augmented reality book model (AAR book model) to enhance teamwork. Int. Educ. Stud. 10(7), 59–64 (2017)

    Article  Google Scholar 

  39. Nuanmeesri, S., Kadmateekarun, P., Poomhiran, L.: Augmented reality to teach human heart anatomy and blood flow. TOJET: Turkish Online J. Educ. Technol. 18(1), 15–24 (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations


Corresponding author

Correspondence to Martin Ebner .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Thurner, S., Daling, L., Ebner, M., Ebner, M., Schön, S. (2021). Evaluation Design for Learning with Mixed Reality in Mining Education Based on a Literature Review. In: Zaphiris, P., Ioannou, A. (eds) Learning and Collaboration Technologies: Games and Virtual Environments for Learning. HCII 2021. Lecture Notes in Computer Science(), vol 12785. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-77942-9

  • Online ISBN: 978-3-030-77943-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics