Skip to main content
Log in

An augmented virtuality system facilitating learning through nature walk

  • Track 1: General Multimedia Topics
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Augmented Virtuality (AV), the augmentation of a virtual environment with real-world objects or information, provides unique educational opportunities, such as photorealistic avatars (using content generation sensors) that convey natural gestures and body language, frames of reference for scale comparisons, and embodied cognition. In this research, we focus on the use of AV technologies for educational tours, such as nature walks, which are guided educational tours to teach students how to identify trees. Because additional content generation and tracking sensors require additional costs and logistics for educational deployment, we conducted a between-subjects experiment comparing AV systems with rear-only and front-and-rear Kinect sensor arrangements. While prior research indicates comparable tracking accuracies for such sensor conditions, we found significant differences between the two conditions. More importantly, we found evidence indicating that the rear-only sensor condition altered participant behavior and caused some participants to prioritize completing the educational tour quickly over correctly identifying trees and their features on the tour. However, we also found that both conditions afforded significant learning improvements, based on pre and post knowledge tests.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Albert A, Hallowell MR, Kleiner B, Chen A, Golparvar-Fard M (2014) Enhancing construction hazard recognition with high-fidelity augmented virtuality. J Construct Eng Manag 140(7):04014024. https://doi.org/10.1061/(asce)co.1943-7862.0000860

    Article  Google Scholar 

  2. Auvinet E, Multon F, Manning V, Meunier J, Cobb J (2017) Validity and sensitivity of the longitudinal asymmetry index to detect gait asymmetry using microsoft kinect data. Gait & Posture 51:162–168. https://doi.org/10.1016/j.gaitpost.2016.08.022

    Article  Google Scholar 

  3. Borst CW, Lipari NG, Woodworth JW (2018) Teacher-guided educational VR: assessment of live and prerecorded teachers guiding virtual field trips. In: 2018 IEEE conference on virtual reality and 3D user interfaces (VR). https://doi.org/10.1109/vr.2018.8448286. IEEE

  4. Brooke J (2013) Sus: a retrospective. J Usab Stud 8(2):29–40

    Google Scholar 

  5. Elmqaddem N (2019) Augmented reality and virtual reality in education myth or reality? International Journal of Emerging Technologies in Learning (iJET) 14(03):234. https://doi.org/10.3991/ijet.v14i03.9289https://doi.org/10.3991/ijet.v14i03.9289

    Article  Google Scholar 

  6. Galloway C (2017) Blink and they’re gone: PR and the battle for attention. Public Relat Rev 43(5):969–977. https://doi.org/10.1016/j.pubrev.2017.06.010

    Article  Google Scholar 

  7. Jones A, Swan JE, Singh G, Kolstad E (2008) The effects of virtual reality, augmented reality, and motion parallax on egocentric depth perception. In: 2008 IEEE virtual reality conference. https://doi.org/10.1109/vr.2008.4480794. IEEE

  8. Kavanagh S, Luxton-Reilly A, Wuensche B, Plimmer B (2017) A systematic review of virtual reality in education. Themes Sci Technol Educ 10(2):85–119

    Google Scholar 

  9. Kennedy RS, Lane NE, Berbaum KS, Lilienthal MG (1993) Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. Int J Aviation Psychol 3(3):203–220. https://doi.org/10.1207/s15327108ijap0303_3

    Article  Google Scholar 

  10. Kim J, Lee I, Kim J, LEE S (2015) Implementation of an omnidirectional human motion capture system using multiple kinect sensors. IEICE Trans Fund Electron Commun Comput Sci E98.A(9):2004–2008. https://doi.org/10.1587/transfun.e98.a.2004

    Article  Google Scholar 

  11. Koppelman H, Vranken H (2008) Experiences with a synchronous virtual classroom in distance education. ACM SIGCSE Bull 40(3):194–198. https://doi.org/10.1145/1597849.1384324

    Article  Google Scholar 

  12. Kumaravel BT, Anderson F, Fitzmaurice G, Hartmann B, Grossman T (2019) Loki. In: Proceedings of the 32nd annual ACM symposium on user interface software and technology. ACM. https://doi.org/10.1145/3332165.3347872

  13. Kurillo G, Bajcsy R (2012) 3d teleimmersion for collaboration and interaction of geographically distributed users. Virt Real 17(1):29–43. https://doi.org/10.1007/s10055-012-0217-2

    Article  Google Scholar 

  14. LaViola JJ Jr, Kruijff E, McMahan RP, Bowman D, Poupyrev IP (2017) 3d user interfaces: theory and practice addison-wesleyprofessional

  15. Milgram P, Takemura H, Utsumi A, Kishino F (1995) Augmented reality: a class of displays on the reality-virtuality continuum. In: Das H (ed) Telemanipulator and Telepresence Technologies. https://doi.org/10.1117/12.197321. SPIE

  16. Morato C, Kaipa KN, Zhao B, Gupta SK (2014) Toward safe human robot collaboration by using multiple kinects based real-time human tracking. J Comput Inform Sci Eng, 14(1). https://doi.org/10.1115/1.4025810https://doi.org/10.1115/1.4025810

  17. Nilsson NC, Serafin S, Nordahl R (2016) Walking in place through virtual worlds. In: Lecture notes in computer science, pp 37–48. https://doi.org/10.1007/978-3-319-39516-6_4. Springer International Publishing

  18. Raghuraman S (2017) i3DTI: Interactive 3D Tele-Immersion. PhD thesis

  19. Regenbrecht H, Lum T, Kohler P, Ott C, Wagner M, Wilke W, Mueller E (2004) Using augmented virtuality for remote collaboration. Presence: Teleoperators and Virtual Environments 13(3):338–354. https://doi.org/10.1162/1054746041422334

    Article  Google Scholar 

  20. Shin D-H (2017) The role of affordance in the experience of virtual reality learning: technological and affective affordances in virtual reality. Telematics Inform 34(8):1826–1836. https://doi.org/10.1016/j.tele.2017.05.013https://doi.org/10.1016/j.tele.2017.05.013

    Article  Google Scholar 

  21. Vellingiri S, McMahan RP, Prabhakaran B (2020) Sceve: a component-based framework to author mixed reality tours. ACM Trans Multimed Comput Commun Applic (TOMM) 16(2):1–23

    Article  Google Scholar 

  22. Vellingiri S, Prabhakaran B (2018) Quantifying group navigation experience in collaborative augmented virtuality tours. In: Proceedings of the 3rd international workshop on multimedia alternate realities. https://doi.org/10.1145/3268998.3269002. ACM

  23. Vellingiri S, White-Swift J, Vania G, Dourty B, Okamoto S, Yamanaka N, Prabhakaran B (2020) Experience with a trans-pacific collaborative mixed reality plant walk. In: 2020 IEEE conference on virtual reality and 3d user interfaces abstracts and workshops (VRW). https://doi.org/10.1109/vrw50115.2020.00051https://doi.org/10.1109/vrw50115.2020.00051. IEEE

  24. Wei T, Lee B, Qiao Y, Kitsikidis A, Dimitropoulos K, Grammalidis N (2015) Experimental study of skeleton tracking abilities from microsoft kinect non-frontal views. In: 2015 3DTV-conference: the true vision - capture, transmission and display of 3D video (3DTV-CON). https://doi.org/10.1109/3dtv.2015.7169367https://doi.org/10.1109/3dtv.2015.7169367. IEEE

  25. Yukselturk E, Altıok S, Başer Z (2018) Using game-based learning with kinect technology in foreign language education course. J Educ Technol Soc 21 (3):159–173

    Google Scholar 

Download references

Acknowledgements

This material is based upon work supported by the US Army Research Office (ARO) Grant W911NF-17-1-0299 and the National Science Foundation (NSF) under Grant No. 1626586. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the ARO and NSF.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shanthi Vellingiri.

Ethics declarations

Conflict of Interests

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vellingiri, S., McMahan, R.P., Johnson, V. et al. An augmented virtuality system facilitating learning through nature walk. Multimed Tools Appl 82, 1553–1564 (2023). https://doi.org/10.1007/s11042-022-13379-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13379-w

Keywords

Navigation