Skip to main content

A hybrid augmented reality guide for underwater cultural heritage sites

Abstract

Modern technologies allow us to experience cultural heritage sites in new and exciting ways. Recent improvements in mobile computing provide tools capable of running augmented reality in real-time performance. Augmented reality is the perfect medium for visualizing and interacting with cultural heritage sites including both buildings and artefacts. Currently, this is possible on land, but sites located in the sea under water are hard to access and present many challenges. In this paper, we present a novel augmented reality guide for divers to present ancient lost buildings at underwater archeological sites. The prototype system runs on a smartphone sealed in a waterproof case and uses a hybrid approach (markers and inertial sensors) to localize the diver on the site. Accuracy of the tracker is measured in a laboratory in a simulated underwater environment. The application was experimentally evaluated at an underwater archeological site in Italy in Baiae. A pilot study with ten expert divers was performed, and their feedback, obtained directly in water, showed that this new experience significantly enhances user experience in underwater archeological sites.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

References

  1. Bellarbi A, Domingues C, Otmane S, Benbelkacem S, Dinis A (2013) Augmented reality for underwater activities with the use of the DOLPHYN. In: 10th IEEE international conference on networking, sensing and control (ICNSC), pp 409–412. https://doi.org/10.1109/ICNSC.2013.6548773

  2. Bjørkli B, Ledas Š, Liestøl G, Stenarson T, Uleberg E (2018) Archaeology and augmented reality. Visualizing stone age sea level on location. In: Proceedings of the 44th conference on computer applications and quantitative methods in archaeology. Archaeopress Publishing Ltd, Oxford, pp 367–377

  3. Bruno F, Lagudi A, Barbieri L, Muzzupappa M, Ritacco G, Cozza A, Cozza M, Peluso R, Lupia M, Cario G (2016) Virtual and augmented reality tools to improve the exploitation of underwater archaeological sites by diver and non-diver tourists. In: Digital heritage. Progress in cultural heritage: documentation, preservation, and protection: 6th international conference, EuroMed 2016. https://doi.org/10.1007/978-3-319-48496-9_22. Springer International Publishing, Cham, pp 269–280

  4. Bruno F, Lagudi A, Ritacco G, Čejka J, Kouřil P, Liarokapis F, Agrafiotis P, Skarlatos D, Philpin-Briscoe O, Poullis C, Mudur S, Simon B (2017) Development and integration of digital technologies addressed to raise awareness and access to european underwater cultural heritage. an overview of the h2020 i-MARECULTURE project. In: OCEANS 2017 – Aberdeen, pp 1–10. https://doi.org/10.1109/OCEANSE.2017.8084984

  5. Doležal M, Vlachos M, Secci M, Demesticha S, Skarlatos D, Liarokapis F (2019) Understanding underwater photogrammetry for maritime archaeology through immersive virtual reality. ISPRS - International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences XLII-2/W10:85–91. https://doi.org/10.5194/isprs-archives-XLII-2-W10-85-2019

    Article  Google Scholar 

  6. Easydive: Diveshot. https://www.easydive.it/en/underwater-housing/smartphone/diveshot.384.html. Accessed 2019 07 24

  7. Galatis P, Gavalas D, Kasapakis V, Pantziou G, Zaroliagis C (2016) Mobile augmented reality guides in cultural heritage. In: Proceedings of the 8th EAI international conference on mobile computing, applications and services, MobiCASE’16. https://doi.org/10.4108/eai.30-11-2016.2266954. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), Brussels, pp 11–19

  8. Guth F, Silveira L, Botelho S, Drews P, Ballester P (2014) Underwater slam: challenges, state of the art, algorithms and a new biologically-inspired approach. In: 5th IEEE RAS/EMBS international conference on biomedical robotics and biomechatronics, pp 981–986. https://doi.org/10.1109/BIOROB.2014.6913908

  9. Guttentag D (2010) Virtual reality: applications and implications for tourism. Tour Manag 31(5):637–651. https://doi.org/10.1016/j.tourman.2009.07.003

    Article  Google Scholar 

  10. Hatsushika D, Nagata K, Yuki H (2018) Underwater VRr experience system for scuba training using underwater wired HMD. In: OCEANS 2018 MTS/IEEE Charleston, pp 1–7. https://doi.org/10.1109/OCEANS.2018.8604592

  11. Jung TH, Lee H, Chung N, Dieck MCT (2018) Cross-cultural differences in adopting mobile augmented reality at cultural heritage tourism sites. Int J Contemp Hosp Manag 30(3):1621–1645

    Article  Google Scholar 

  12. Kourouthanassis P, Boletsis C, Bardaki C, Chasanidou D (2015) Tourists responses to mobile augmented reality travel guides: the role of emotions on adoption behavior. Pervasive and Mobile Computing 18:71–87. https://doi.org/10.1016/j.pmcj.2014.08.009

    Article  Google Scholar 

  13. Kouřil P, Liarokapis F (2018) Simulation of underwater excavation using dredging procedures. IEEE Comput Graph Appl 38(2):103–111. https://doi.org/10.1109/MCG.2018.021951637

    Article  Google Scholar 

  14. Lavest JM, Rives G, Lapresté JT (2003) Dry camera calibration for underwater applications. Mach Vis Appl 13(5):245–253. https://doi.org/10.1007/s00138-002-0112-z

    Article  Google Scholar 

  15. Lee GA, Dünser A, Kim S, Billinghurst M (2012) CityViewAR: a mobile outdoor AR application for city visualization. In: 2012 IEEE international symposium on mixed and augmented reality - arts, media, and humanities (ISMAR-AMH), pp 57–64. https://doi.org/10.1109/ISMAR-AMH.2012.6483989

  16. Liarokapis F, Kouřil P, Agrafiotis P, Demesticha S, Chmelík J, Skarlatos D (2017) 3D modelling and mapping for virtual exploration of underwater archaeology assets. International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences - ISPRS Archives 42:425–431. https://doi.org/10.5194/isprs-archives-XLII-2-W3-425-2017

    Article  Google Scholar 

  17. von Lukas UF, Quarles J, Kaklis P, Dolereit T (2015) Virtual Realities: International Dagstuhl Seminar, Dagstuhl Castle, Germany, June 9-14, 2013, Revised selected papers, pp 56–76. In: Brunnett G, Coquillart S, van Liere R, Welch G, Váša L (eds). https://doi.org/10.1007/978-3-319-17043-5_4. Springer International Publishing, Cham

  18. Morales R, Keitler P, Maier P, Klinker G (2009) An underwater augmented reality system for commercial diving operations. In: Underwater intervention conference 2011, vol 1, pp 1–8

  19. Neunert M, Bloesch M, Buchli J (2016) An open source, fiducial based, visual-inertial motion capture system. In: 19th international conference on information fusion (FUSION) 2016, pp 1523–1530

  20. Oppermann L, Blum L, Lee JY, Seo JH (2013) Areef multi-player underwater augmented reality experience. In: 2013 IEEE International games innovation conference (IGIC), pp 199–202. https://doi.org/10.1109/IGIC.2013.6659137

  21. Osone H, Yoshida T, Ochiai Y (2018) Optimized HMD system for underwater VR experience. In: Cheok AD, Inami M, Romão T (eds) Advances in computer entertainment technology. Springer International Publishing, Cham, pp 451–461

  22. Panou C, Ragia L, Dimelli D, Mania K (2018) An architecture for mobile outdoors augmented reality for cultural heritage. ISPRS International Journal of Geo-Information 7(12). https://doi.org/10.3390/ijgi7120463

  23. Philbin-Briscoe O, Simon B, Mudur S, Poullis C, Rizvic S, Boskovic D, Liarokapis F, Katsouri I, Demesticha S, Skarlatos D (2017) A serious game for understanding ancient seafaring in the Mediterranean sea. In: 2017 9th international conference on virtual worlds and games for serious applications (VS-games), pp 1–5. https://doi.org/10.1109/VS-GAMES.2017.8055804

  24. Quarles J (2015) Shark punch: a virtual reality game for aquatic rehabilitation. In: 2015 IEEE virtual reality (VR), pp 265–266. https://doi.org/10.1109/VR.2015.7223397

  25. Romero-Ramirez FJ, Muñoz-Salinas R, Medina-Carnicer R (2018) Speeded up detection of squared fiducial markers. Image Vis Comput 76:38–47. https://doi.org/10.1016/j.imavis.2018.05.004

    Article  Google Scholar 

  26. Sendra S, Lloret J, Rodrigues JJPC, Aguiar JM (2013) Underwater wireless communications in freshwater at 2.4 GHz. IEEE Commun Lett 17(9):1794–1797. https://doi.org/10.1109/LCOMM.2013.072313.131214

    Article  Google Scholar 

  27. Seo BK, Kim K, Park J, Park JI (2010) A tracking framework for augmented reality tours on cultural heritage sites. In: Proceedings of the 9th ACM SIGGRAPH conference on virtual-reality continuum and its applications in industry, VRCAI ’10. ACM, New York, pp 169–174, DOI https://doi.org/10.1145/1900179.1900215, (to appear in print)

  28. Solà J (2017) Quaternion kinematics for the error-state Kalman filter. Computing Research Repository

  29. Sylaiou S, Kasapakis V, Dzardanova E, Gavalas D (2018) Leveraging mixed reality technologies to enhance museum visitor experiences. In: 2018 International conference on intelligent systems (IS), pp 595–601. https://doi.org/10.1109/IS.2018.8710530

  30. Sylaiou S, Liarokapis F, Kotsakis K, Patias P (2009) Virtual museums, a survey and some issues for consideration. J Cult Herit 10(4):520–528. https://doi.org/10.1016/j.culher.2009.03.003

    Article  Google Scholar 

  31. Tcha-Tokey K, Christmann O, Loup-Escande E, Richir S (2016) Proposition and validation of a questionnaire to measure the user experience in immersive virtual environments. The International Journal of Virtual Reality 16:33–48

    Article  Google Scholar 

  32. Tscheu F, Buhalis D (2016) Augmented reality at cultural heritage sites. In: Information and communication technologies in tourism. https://doi.org/10.1007/978-3-319-28231-2_44. Springer International Publishing, Switzerland, pp 607–619

  33. Čejka J, Bruno F, Skarlatos D, Liarokapis F (2019) Detecting square markers in underwater environments. Remote Sensing 11(4). https://doi.org/10.3390/rs11040459

  34. Čejka J, Žuži M, Agrafiotis P, Skarlatos D, Bruno F, Liarokapis F (2018) Improving marker-based tracking for augmented reality in underwater environments. In: Sablatnig R, Wimmer M (eds) Eurographics workshop on graphics and cultural heritage. The Eurographics Association. https://doi.org/10.2312/gch.20181337

  35. Vlahakis V, Ioannidis N, Karigiannis J, Tsotros M, Gounaris M, Stricker D, Gleue T, Daehne P, Almeida L (2002) Archeoguide: an augmented reality guide for archaeological sites. IEEE Comput Graph Appl 22:52–60. https://doi.org/10.1109/MCG.2002.1028726

    Article  Google Scholar 

  36. Wang J, Olson E (2016) Apriltag 2: Efficient and robust fiducial detection. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS)

  37. Yamashita S, Zhang X, Miyaki T, Rekimoto J (2016) AquaCAVE: an underwater immersive projection system for enhancing the swimming experience. In: Reiners D., Iwai D., Steinicke F. (eds) ICAT-EGVE 2016 – international conference on artificial reality and telexistence and eurographics symposium on virtual environments. The Eurographics Association. https://doi.org/10.2312/egve.20161430

Download references

Funding

This research is a part of the i-MareCulture project (Advanced VR, iMmersive Serious Games and Augmented REality as Tools to Raise Awareness and Access to European Underwater CULTURal heritagE, Digital Heritage) that has received funding from the European Union’s Horizon 2020 research and innovation program under Grant Agreement No. 727153.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jan Čejka.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Čejka, J., Zsíros, A. & Liarokapis, F. A hybrid augmented reality guide for underwater cultural heritage sites. Pers Ubiquit Comput 24, 815–828 (2020). https://doi.org/10.1007/s00779-019-01354-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-019-01354-6

Keywords

  • Augmented reality
  • Cultural heritage
  • Underwater
  • User experience