Abstract
This chapter discusses the capabilities of extended reality technology in informal learning environments, such as museums and cultural heritage sites. Recent developments in extended reality technologies have led to increased integration into these informal learning spaces and have heightened the need for a systematic investigation into the affordances of modern multimedia representations spanning tangible to virtual mediums. These affordances vary across settings, ranging from personalizing learning experiences, increasing engagement through interactive activities, and augmenting exhibits with rich multimedia content. The chapter critically appraises several affordances of extended reality technologies while expanding on these notions by outlining the cognitive theory of multimedia learning to inform practical instructional design principles. Drawing on case examples from their own research with tangible and virtual museum objects in these settings, the authors explore and discuss how extended reality technologies can serve to both collect and analyze ambient data in real time. The authors claim that ambient data will become increasingly prevalent in such settings and critical to gain insights into visitor experience and promote meaningful and engaging learning experiences. They discuss the implications of their findings for practice and suggest directions for future research.
This is a preview of subscription content, access via your institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Adams JW, Paxton L et al (2015) 3d printed reproductions of orbital dissections: A novel mode of visualising anatomy for trainees in ophthalmology or optometry. Br J Ophthalmol 99(9):1162–1167. https://doi.org/10.1136/bjophthalmol-2014-306189
Ainsworth S, Vanlabeke N (2004) Multiple forms of dynamic representation. Learn Instr 14(3):241–255. https://doi.org/10.1016/j.learninstruc.2004.06.002
Arsenault R, Ware C (2004) The importance of stereo and eye-coupled perspective for eye-hand coordination in fish tank vr. Presence Teleop Virt Environ 13(5):549–559. https://doi.org/10.1162/1054746042545300
Baddeley AD (1986) Working memory. Oxford University Press, New York, NY
Baker R (2016) Stupid tutoring systems, intelligent humans. Int J Artif Int Educ 26(2):600–614. https://doi.org/10.1007/s40593-016-0105-0
Baker R, Rossi L (2013) Assessing the disengaged behaviors of learners. Des Rec Tut Sys 1:153
Barrett T, Hegarty M (2014) Interaction design and the role of spatial ability in moderating virtual molecule manipulation performance. Paper presented at the Proceedings of the Annual Meeting of the Cognitive Science Society.
Bartie PJ, Mackaness WA (2006) Development of a speech-based augmented reality system to support exploration of cityscape. Transactions in GIS 10(1):63–86. https://doi.org/10.1111/j.1467-9671.2006.00244.x
Bekele M, Champion E (2019) A comparison of immersive realities and interaction methods: cultural learning in virtual heritage. Front Rob Ai 6:1–14. https://doi.org/10.3389/frobt.2019.00091
Bekele M, Pierdicca R et al (2018) A survey of augmented, virtual, and mixed reality for cultural heritage. J Comp Cult Herit 11(2):1–36. https://doi.org/10.1145/3145534
Bell DR, Smith JK (2020) Inside the digital learning laboratory: new directions in museum education. Curator 63(3):371–386. https://doi.org/10.1111/cura.12376
Bowman D, Coquillart S et al (2008) 3d user interfaces: new directions and perspectives. IEEE Comput Graphics Appl 28(6):20–36
Bowman D, Kruijff E, et al (2004) 3d user interfaces: theory and practice, coursesmart etextbook, Addison-Wesley
Bressler DM (2013) Gateways to mobile learning. In: ZL Berge, L Muilenburg (eds) Handbook of Mobile Learning. New York, NY, pp 224–234
Butcher KR (2006) Learning from text with diagrams: promoting mental model development and inference generation. J Educ Psychol 98(1):182–197. https://doi.org/10.1037/0022-0663.98.1.182
Butcher KR (2014) The multimedia principle. In: Mayer R (ed) Cambridge Handbook of Multimedia Learning. Cambridge, UK, pp 174–205
Butcher KR, Davies S (2015) Inference generation during online study and multimedia learning. In: EJ O’Brien, AE Cook, RF Lorch (eds) Inferences During Reading. New York, p 321
Butcher KR, Orr MP (in preparation) The impact of physicality on model-based learning
Cahill C, Kuhn A, et al (2011) Mobile learning in museums: how mobile supports for learning influence student behavior. Paper presented at the Proceedings of the 10th International Conference on International Design and Children
Card SK (1999) Readings in information visualization: using vision to think. San Fransisco, Morgan Kaufmann Publishers
Carrozzino M, Bergamasco M (2010) Beyond virtual museums: experiencing immersive virtual reality in real museums. J Cult Herit 11(4):452–458. https://doi.org/10.1016/j.culher.2010.04.001
Christidou D (1990) Pierroux P (2018) Art, touch and meaning making: an analysis of multisensory interpretation in the museum. Museum Mgmt Cur 34(1):96–115. https://doi.org/10.1080/09647775.2018.1516561
Clough GW (2013) Best of both worlds: museums, libraries, and archives in a digital age. Smithsonian Institution, Washington, DC
Conaway W, Zorn-Arnold B (2015) The keys to online learning for adults: the six principles of andragogy. Distance Learning 12(4):37
Davis M (2020) Towards frictionless augmented reality (Date Accessed: Oct 12, 2020). https://www.aam-us.org/2020/06/15/towards-frictionless-augmented-reality/
Desmarais M, Baker R (2012) A review of recent advances in learner and skill modeling in intelligent learning environments. User Model User-Adap Inter 22(1–2):9–38
Di Franco PDG, Camporesi C et al (2015) 3d printing and immersive visualization for improved perception of ancient artifacts. Presence 24(3):243–264. https://doi.org/10.1162/PRES_a_00229
Dunleavy M, Dede C et al (2008) Affordances and limitations of immersive participatory augmented reality simulations for teaching and learning. JSEdT 18(1):7–22. https://doi.org/10.1007/s10956-008-9119-1
Dutke S, Rinck M (2006) Multimedia learning: working memory and the learning of word and picture diagrams. Learn Instr 16(6):526–537. https://doi.org/10.1016/j.learninstruc.2006.10.002
Fau M, Cornette R et al (2016) Photogrammetry for 3d digitizing bones of mounted skeletons: potential and limits. CR Palevol 15(8):968–977. https://doi.org/10.1016/j.crpv.2016.08.003
Fiorenza L, Yong R et al (2018) Technical note: the use of 3d printing in dental anthropology collections. Am. J. Phys. Anthropol. 167(2):400–406. https://doi.org/10.1002/ajpa.23640
Hammady R, Ma M et al (2020) Ambient information visualization and visitors’ technology acceptance of mixed reality in museums. J Comput Cult Herit 13(2):1–22. https://doi.org/10.1145/3359590
Han I (2019) Immersive virtual field trips in education: a mixed-methods study on elementary students’ presence and perceived learning. Br J Educat Tech 51(2):420–435. https://doi.org/10.1111/bjet.12842
Han I, Black JB (2011) Incorporating haptic feedback in simulation for learning physics. Comp Ed 57(4):2281–2290. https://doi.org/10.1016/j.compedu.2011.06.012
Hari Narayanan N, Hegarty M (2002) Multimedia design for communication of dynamic information. Int J Hum Comp Stud 57(4):279–315. https://doi.org/10.1006/ijhc.2002.1019
Harley JM, Poitras EG et al (2016) Comparing virtual and location-based augmented reality mobile learning: emotions and learning outcomes. Educational Tech Dev 64(3):359–388. https://doi.org/10.1007/s11423-015-9420-7
Hatz CR, Msallem B et al (2020) Can an entry-level 3d printer create high-quality anatomical models? accuracy assessment of mandibular models printed by a desktop 3d printer and a professional device. Int J Oral Maxillofac Surg 49(1):143–148. https://doi.org/10.1016/j.ijom.2019.03.962
He Z, Wu L et al (2018) When art meets tech: the role of augmented reality in enhancing museum experiences and purchase intentions. Tourism Management 68:127–139
Hegarty M (2004) Dynamic visualizations and learning: getting to the difficult questions. Learn Instr 14(3):343–351. https://doi.org/10.1016/j.learninstruc.2004.06.007
Hegarty M, Smallman HS et al (2012) Choosing and using geospatial displays: effects of design on performance and metacognition. J Exp Psychol Appl 18(1):1–17. https://doi.org/10.1037/a0026625
Hewitt D (2015) Please touch the art: 3-d printing helps visually impaired appreciate paintings (Date Accessed: Oct 12, 2020). https://www.smithsonianmag.com/innovation/please-touch-art-3-d-printing-helps-visually-impaired-appreciate-paintings-180954420/
Holtrop E, Downey S (2019) Taking a museum education study from research to practice (Date Accessed: Oct 12, 2020). https://www.aam-us.org/2019/07/24/taking-a-museum-education-study-from-research-to-practice/
Hoyek N, Collet C et al (2014) Effectiveness of three—dimensional digital animation in teaching human anatomy in an authentic classroom context. Anat Sci Educ 7(6):430–437. https://doi.org/10.1002/ase.1446
Hudson LN, Blagoderov V et al (2015) Inselect: automating the digitization of natural history collections. PLoS ONE 10(11):e0143402. https://doi.org/10.1371/journal.pone.0143402
Hughes CE, Smith E, et al (2004) Augmenting museum experiences with mixed reality. Paper presented at the Proceedings of KSCE 2004
Huk T (2006) Who benefits from learning with 3d models? the case of spatial ability. J Comput Assisted Learn 22(6):392–404. https://doi.org/10.1111/j.1365-2729.2006.00180.x
Hutchins EL, Hollan JD et al (1985) Direct manipulation interfaces. Human-Computer Interaction 1(4):311–338. https://doi.org/10.1207/s15327051hci0104_2
Jones MG, Childers G, et al (2014) The efficacy of haptic simulations to teach students with visual impairments about temperature and pressure. (research reports). J Visual Imp, 108(1):55
Kalantari M, Rauschnabel P (2018) Exploring the early adopters of augmented reality smart glasses: the case of microsoft hololens. In: Augmented reality and virtual reality, pp 229–245
Katsionis G, Virvou M (2008) Personalised e-learning through an educational virtual reality game using web services. Multimed. Tools App 39(1):47–71
Kay J, McCalla G (2012) Coming of age: Celebrating a quarter century of user modeling and personalization: Guest editors’ introduction. User Model User-Adap Inter 22(1–2):1–7
Keil J, Pujol L, et al (2013) A digital look at physical museum exhibits: Designing personalized stories with handheld augmented reality in museums. Paper presented at the 2013 Digital Heritage International Congress
Knowles MS, Holton EFIII, et al (2015) Andragogy: A theory of adult learning. In The adult learner (8th ed.) (pp. 312–320). New York, NY
Kretschmer U, Coors V, et al (2001) Meeting the spirit of history. Paper presented at the Proceedings of the 2001 conference on Virtual reality, archeology, and cultural heritage
Kyriakou P, Hermon S (2019) Can i touch this? Using natural interaction in a museum augmented reality system. Digital App Arch Cult Herit 12:00088. https://doi.org/10.1016/j.daach.2018.e00088
Leopardi A, Ceccacci S et al (2020) X-reality technologies for museums: A comparative evaluation based on presence and visitors experience through user studies. In Press, J Cult Herit
Lester J, Lobene E et al (2014) Serious games with gift: Instructional strategies, game design, and natural language in the generalized intelligent framework for tutoring. Design Rec Tutuor Sys 2:205–215
Li J, Nie L et al (2012) Maximizing modern distribution of complex anatomical spatial information: 3d reconstruction and rapid prototype production of anatomical corrosion casts of human specimens. Anat Sci Educ 5(6):330–339. https://doi.org/10.1002/ase.1287
Lukosch S, Billinghurst M et al (2015) Collaboration in augmented reality. Comput Support Coop Work 24(6):515–525. https://doi.org/10.1007/s10606-015-9239-0
Magnani M, Guttorm A, et al (2018) Three-dimensional, community-based heritage management of indigenous museum collections: archaeological ethnography, revitalization and repatriation at the sami museum siida. (report). J Cult Herit, 31, 162. doi:https://doi.org/10.1016/j.culher.2017.12.001
Makransky G, Andreasen NK, et al (2020) Immersive virtual reality increases liking but not learning with a science simulation and generative learning strategies promote learning in immersive virtual reality. J Educ Psychol (March 19, 2020), 1–17. doi:https://doi.org/10.1037/edu0000473
Makransky G, Terkildsen TS et al (2019) Adding immersive virtual reality to a science lab simulation causes more presence but less learning. Learn Instr 60:225–236. https://doi.org/10.1016/j.learninstruc.2017.12.007
Mayer RE (1989) Systematic thinking fostered by illustrations in scientific text. J Educ Psychol 81(2):240–246. https://doi.org/10.1037/0022-0663.81.2.240
Mayer RE (2014) The cambridge handbook of multimedia learning (Second Edition ed.). New York, Cambridge University Press
Mayer RE (2017) Using multimedia for e-learning. J Comput Assisted Learn 33(5):403–423. https://doi.org/10.1111/jcal.12197
Mayer RE, Gallini J (1990) When is an illustration worth ten thousand words? J Educ Psychol 82(4):715–726. https://doi.org/10.1037/0022-0663.82.4.715
McMenamin P, Quayle M et al (2014) The production of anatomical teaching resources using three-dimensional (3d) printing technology. Anat Sci Educ 7(6):479–486. https://doi.org/10.1002/ase.1475
McNeil NM, Uttal DH (2009) Rethinking the use of concrete materials in learning: perspectives from development and education. Child Dev Persp 3(3):137–139. https://doi.org/10.1111/j.1750-8606.2009.00093.x
Merchant ZG, Ernest T, Cifuentes L, Keeney-Kennicutt W, Davis TJ (2014) Effectiveness of virtual reality- based instruction on students’ learning outcomes in k-12 and higher education: a meta-analysis. Comp Ed 70:29–40. https://doi.org/10.1016/j.compedu.2013.07.033
Merritt E (2016) Museums and personalized learning (Date Accessed: Oct 12, 2020). https://www.aam-us.org/2016/03/22/museums-and-personalized-learning/
Neely L, Langer M (2013) Please feel the museum. the emergence of 3d printing and scanning. In: N Proctor, R e Cherry (eds) Museums and the Web. Silver Spring, MD
Orr M, Aina D, et al (2021) Embodied learning with virtual reality: gesture clustering and forecasting. Paper presented at the American Educational Research Association (AERA), Orlando, Florida
Orr M, Butcher KR (in preparation) The impact of tangible materials and functional prompts on learning with 3d models
Padalkar S, Hegarty M (2015) Models as feedback: developing representational competence in chemistry. J Educ Psychol 107(2):451–467. https://doi.org/10.1037/a0037516
Paivio A (1986) Mental representations: a dual coding approach. Oxford University Press, New York
Patterson R, Silzars A (2009) Immersive stereo displays, intuitive reasoning, and cognitive engineering. J Soci Inf Disp 17(5):443–448. https://onlinelibrary.wiley.com/doi/abs/10.1889/1.1828693
Plecher DA, Wandinger M, et al (2019) Mixed reality for cultural heritage. Paper presented at the 2019 IEEE Conference on Virtual Reality and 3D User Interfaces
Poitras E, Butcher KR, et al (2020) Modeling interactive behaviors while learning with digitized objects in virtual reality environments. In: Cognitive and Affective Perspectives on Immersive Technology in Education, pp 215–234
Preece D, Williams S et al (2013) “Let’s get physical”: advantages of a physical model over 3d computer models and textbooks in learning imaging anatomy. Anat Sci Educ 6(4):216–224. https://doi.org/10.1002/ase.1345
Primary Research G (2015) Survey of library & museum digitization projects (2016 edition ed.). New York, Primary Research Group Inc
Pujol L, Katifori A, et al (2013) From personalization to adaptivity: creating immersive visits through interactive digital storytelling at the acropolis museum. Paper presented at the Workshop Proceedings of the 9th International Conference on Intelligent Environments, Athens, Greece
Rahaman H, Champion E et al (2019) From photo to 3d to mixed reality: a complete workflow for cultural heritage visualisation and experience. Digit Appl Archaeol Cult Herit 13:e00102. https://doi.org/10.1016/j.daach.2019.e00102
Ramasundaram V, Grunwald S et al (2005) Development of an environmental virtual field laboratory. Comp Ed 45(1):21–34. https://doi.org/10.1016/j.compedu.2004.03.002
Rennie LJ, Johnston DJ (2004) The nature of learning and its implications for research on learning from museums. Sci Educ 88(S1):S4–S16. https://doi.org/10.1002/sce.20017
Richards DT, Meredith, (2015) A comparison of learning gains when using a 2d simulation tool versus a 3d virtual world: An experiment to find the right representation involving the marginal value theorem. Comp Ed 86:157–171. https://doi.org/10.1016/j.compedu.2015.03.009
Sampaio AZ, Ferreira MM et al (2010) 3d and vr models in civil engineering education: construction, rehabilitation and maintenance. Autom Constr 19(7):819–828. https://doi.org/10.1016/j.autcon.2010.05.006
Schofield G, Beale G, et al (2018) Viking vr: designing a virtual reality experience for a museum. Paper presented at the Proceedings of the 2018 Designing Interactive Systems Conference
Schüler A, Arndt J et al (2015) Processing multimedia material: dsoes integration of text and pictures result in a single or two interconnected mental representations? Learn Instr 35:62–72. https://doi.org/10.1016/j.learninstruc.2014.09.005
Schwan S, Dutz S (2020) How do visitors perceive the role of authentic objects in museums? Curator (New York, NY), 63(2), 217–237. https://doi.org/10.1111/cura.12365
Shah P, Miyake A (1996) The separability of working memory resources for spatial thinking and language processing: an individual differences approach. J Exp Psychol Gen 125(1):4–27. https://doi.org/10.1037/0096-3445.125.1.4
Shute VJ, Zapata-Rivera D (2012) Adaptive Educational Systems. Adaptive Tech 7(27):1–35
Siemens, G, Baker, R S d (2012) Learning analytics and educational data mining: towards communication and collaboration. Paper presented at the Proceedings of the 2nd international conference on learning analytics and knowledge
Singh H, Kalani M et al (2013) History of simulation in medicine: from resusci annie to the ann myers medical center. Neurosurgery 73(Suppl 1):S9–S14. https://doi.org/10.1227/NEU.0000000000000093
Stull A, Barrett T, et al (2012) Design of a virtual reality system for the study of diagram use in organic chemistry. Paper presented at the Workshop on technology enhanced diagrams research
Stull A, Hegarty M et al (2012) Representational translation with concrete models in organic chemistry. Cogn Instr 30(4):404–434. https://doi.org/10.1080/07370008.2012.719956
Sugiura A, Kitama T et al (2019) The use of augmented reality technology in medical specimen museum tours. Anat Sci Educ 12(5):561–571. https://doi.org/10.1002/ase.1822
Tesoriero R, Gallud JA et al (2014) Enhancing visitors’ experience in art museums using mobile technologies. Inf Sys Front 16(2):303–327. https://doi.org/10.1007/s10796-012-9345-1
Venigalla AS M, Chimalakonda S (2019) Towards enhancing user experience through a web-based augmented reality museum. Paper presented at the 2019 IEEE 19th ICALT
Vlahakis V, Karigiannis J, et al (2001) Archeoguide: first results of an augmented reality, mobile computing system in cultural heritage sites. VR, Arch, Cult Herit, 9(10.1145), 584993–585015
Ware C, Rose J (1999) Rotating virtual objects with real handles. TOCHI 6(2):162–180. https://doi.org/10.1145/319091.319102
Wilson PF, Stott J, et al (2017) Evaluation of touchable 3d‐printed replicas in museums. Curator: Mus.M J. 60(4): 445–465. https://doi.org/10.1111/cura.12244
Winne PH, Baker RS (2013) The potentials of educational data mining for researching metacognition, motivation and self-regulated learning. JEDM 5(1):1–8
Wu B, Klatzky RL et al (2005) Psychophysical evaluation of in-situ ultrasound visualization. IEEE Trans Visual Comput Graph 11(6):684–693. https://doi.org/10.1109/TVCG.2005.104
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Orr, M., Poitras, E., Butcher, K.R. (2021). Informal Learning with Extended Reality Environments: Current Trends in Museums, Heritage, and Tourism. In: Geroimenko, V. (eds) Augmented Reality in Tourism, Museums and Heritage. Springer Series on Cultural Computing. Springer, Cham. https://doi.org/10.1007/978-3-030-70198-7_1
Download citation
DOI: https://doi.org/10.1007/978-3-030-70198-7_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-70197-0
Online ISBN: 978-3-030-70198-7
eBook Packages: Computer ScienceComputer Science (R0)