Advertisement

Image-Based Underwater 3D Reconstruction for Cultural Heritage: From Image Collection to 3D. Critical Steps and Considerations

Chapter
Part of the Springer Series on Cultural Computing book series (SSCC)

Abstract

Underwater Cultural Heritage (CH) sites are widely spread; from ruins in coastlines up to shipwrecks in deep. The documentation and preservation of this heritage is an obligation of the mankind, dictated also by the international treaties like the Convention on the Protection of the Underwater Cultural Heritage which fosters the use of “non-destructive techniques and survey methods in preference over the recovery of objects”. However, submerged CH lacks in protection and monitoring in regards to the land CH and nowadays recording and documenting, for digital preservation as well as dissemination through VR to wide public, is of most importance. At the same time, it is most difficult to document it, due to inherent restrictions posed by the environment. In order to create high detailed textured 3D models, optical sensors and photogrammetric techniques seems to be the best solution. This chapter discusses critical aspects of all phases of image based underwater 3D reconstruction process, from data acquisition and data preparation using colour restoration and colour enhancement algorithms to Structure from Motion (SfM) and Multi-View Stereo (MVS) techniques to produce an accurate, precise and complete 3D model for a number of applications.

Notes

Acknowledgements

Part of the work presented here conducted in the context of the iMARECULTURE project (Advanced VR, iMmersive Serious Games and Augmented REality asnTools to Raise Awareness and Access to European Underwater CULTURal heritagE, Digital Heritage) that has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 727153. Authors would like also to thank M.A.RE Lab from University of Cyprus and the lead archaeologist Prof. S. Demesticha for providing data from several underwater sites, and moreover challenging the authors to overcome problems and shortcomings of the 3D documentation process in underwater CH.

References

  1. Abdelaziz M, Elsayed M (2019) Underwater photogrammetry digital surface model (DSM) of the submerged site of the ancient lighthouse near Qaitbay Fort in Alexandria, Egypt. Int Arch Photogramm Remote Sens Spatial Inf Sci XLII-2/W10:1–8.  https://doi.org/10.5194/isprs-archives-XLII-2-W10-1-2019
  2. Agrafiotis P, Drakonakis GI, Georgopoulos A, Skarlatos D (2017) The effect of underwater imagery radiometry on 3D reconstruction and orthoimagery. Int Arch Photogramm Remote Sens Spatial Inf Sci XLII-2/W3:25–31.  https://doi.org/10.5194/isprs-archives-XLII-2-W3-25-2017, 2017
  3. Agrafiotis P, Skarlatos D, Forbes T, Poullis C, Skamantzari M, Georgopoulos A (2018a) Underwater photogrammetry in very shallow waters: main challenges and caustics effect removal. Int Arch Photogramm Remote Sens Spatial Inf Sci XLII-2:15–22.  https://doi.org/10.5194/isprs-archives-XLII-2-15-2018, 2018
  4. Agrafiotis P, Drakonakis GI, Skarlatos D, Georgopoulos A (2018b) Underwater image enhancement before three-dimensional (3D) reconstruction and orthoimage production steps: is it worth. In: Remondino F, Georgopoulos A, González-Aguilera D, Agrafiotis P (eds) Latest developments in reality-based 3d surveying and modellingGoogle Scholar
  5. Akkaynak D, Treibitz T (2018) A revised underwater image formation model. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6723–6732Google Scholar
  6. Akkaynak D, Treibitz T (2019) Sea-thru: a method for removing water from underwater images. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1682–1691Google Scholar
  7. Balletti C, Beltrame C, Costa E, Guerra F, Vernier P (2016) 3D reconstruction of marble shipwreck cargoes based on underwater multi-image photogrammetry. Digit Appl Archaeol Cult Herit 3(1):1–8Google Scholar
  8. Berman D, Treibitz T, Avidan S (2018) Single image dehazing using haze-lines. IEEE Trans Pattern Anal Mach IntellGoogle Scholar
  9. Bianco G, Muzzupappa M, Bruno F, Garcia R, Neumann L (2015) A new color correction method for underwater imaging. Int Arch Photogramm Remote Sens Spatial Inf Sci XL-5/W5:25–32.  https://doi.org/10.5194/isprsarchives-XL-5-W5-25-2015
  10. Bingham B, Foley B, Singh H, Camilli R, Delaporta K, Eustice R, … Sakellariou D (2010) Robotic tools for deep water archaeology: surveying an ancient shipwreck with an autonomous underwater vehicle. J Field Robot 27(6):702–717Google Scholar
  11. Bosch J, Ridao P, Ribas D, Gracias N (2015) Creating 360 underwater virtual tours using an omnidirectional camera integrated in an AUV. In: OCEANS 2015-Genova. IEEE, pp 1–7Google Scholar
  12. Bruno F, Gallo A, De Filippo F, Muzzupappa M, Petriaggi BD, Caputo P (2013) 3D documentation and monitoring of the experimental cleaning operations in the underwater archaeological site of Baia (Italy). In: 2013 digital heritage international congress (DigitalHeritage), vol 1. IEEE, pp 105–112Google Scholar
  13. Bruno F, Lagudi A, Gallo A, Muzzupappa M, Davidde Petriaggi B, Passaro S (2015) 3D documentation of archeological remains in the Underwater Park of Baiae. Int Arch Photogramm Remote Sens Spatial Inf Sci XL-5/W5:41–46.  https://doi.org/10.5194/isprsarchives-XL-5-W5-41-2015
  14. Bruno F, Lagudi A, Muzzupappa M, Lupia M, Cario G, Barbieri L, … Saggiomo R (2016) Project VISAS: virtual and augmented exploitation of submerged archaeological sites‐overview and first results. Mar Technol Soc J 50(4):119–129Google Scholar
  15. Bruno F, Lagudi A, Collina M, Medaglia S, Davidde Petriaggi B, Petriaggi R, Ricci S, Sacco Perasso C (2019) Documentation and monitoring of underwater archaeological sites using 3D imaging techniques: the case study of the “Nymphaeum of Punta Epitaffio” (Baiae, Naples). Int Arch Photogramm. Remote Sens Spatial Inf Sci XLII-2/W10:53–59.  https://doi.org/10.5194/isprs-archives-XLII-2-W10-53-2019
  16. Bryson M, Johnson-Roberson M, Pizarro O, Williams SB (2013) Colour-consistent structure-from-motion models using underwater imagery. Robot: Sci Syst VIII:33Google Scholar
  17. Constantinou C, Loizou S, Georgiades G, Potyagaylo S, Skarlatos D (2014) Adaptive calibration of an underwater robot vision system based on hemispherical optics. Oceanic Engineering Society—IEEE AUV 2014, Autonomous Underwater Vehicles 2014, 6–9 Oct., Oxford, Mississippi, USGoogle Scholar
  18. Costa E (2019) The progress of survey techniques in underwater sites: the case study of Cape Stoba Shipwreck. Int Arch Photogramm Remote Sens Spatial Inf Sci XLII-2/W10:69–75.  https://doi.org/10.5194/isprs-archives-XLII-2-W10-69-2019
  19. Demesticha S, Skarlatos D, Neophytou A (2014) The 4th-century BC shipwreck at Mazotos, Cyprus: new techniques and methodologies in the 3D mapping of shipwreck excavations. J Field Archaeol 39(2):134–150.  https://doi.org/10.1179/0093469014Z.00000000077CrossRefGoogle Scholar
  20. Derenne B, Nantet E, Verly G, Boone M (2019) Complementarity between in situ studies and photogrammetry: methodological feedback from a Roman Shipwreck in Caesarea, Israel. Int Arch Photogramm Remote Sens Spatial Inf Sci XLII-2/W10:77–83.  https://doi.org/10.5194/isprs-archives-XLII-2-W10-77-2019
  21. Drap P, Seinturier J, Hijazi B, Merad D, Boi JM, Chemisky B, … Long L (2015) The ROV 3D project: deep-sea underwater survey using photogrammetry: applications for underwater archaeology. J Comput Cult Herit (JOCCH) 8(4):21Google Scholar
  22. Forbes T, Goldsmith M, Mudur S, Poullis C (2018) DeepCaustics: classification and removal of caustics from underwater imagery. IEEE J Ocean EngGoogle Scholar
  23. Furukawa Y, Ponce J (2010) Accurate, dense, and robust multi-view stereopsis. IEEE Trans Pattern Anal Mach Intell 32(8):1362–1376CrossRefGoogle Scholar
  24. Georgopoulos A, Agrafiotis P (2012) Documentation of a submerged monument using improved two media techniques. In: 18th international conference on virtual systems and multimedia, Milan, pp 173–180.  https://doi.org/10.1109/vsmm.2012.6365922
  25. Getreuer P (2012) Automatic color enhancement (ACE) and its fast implementation. Image Process Line 2:266–277CrossRefGoogle Scholar
  26. Ghani ASA, Isa NAM (2014) Underwater image quality enhancement through composition of dual-intensity images and Rayleigh-stretching. SpringerPlus 3(1):757CrossRefGoogle Scholar
  27. Gracias N, Negahdaripour S, Neumann L, Prados R, Garcia R (2008) A motion compensated filtering approach to remove sunlight flicker in shallow water images. In: OCEANS 2008. IEEE, pp 1–7Google Scholar
  28. Hou W, Weidemann AD, Gray DJ, Fournier GR (2007) Imagery-derived modulation transfer function and its applications for underwater imaging. In: Optical engineering + applications. International Society for Optics and Photonics, pp 669622Google Scholar
  29. Johnson-Roberson M, Pizarro O, Williams SB, Mahon I (2010) Generation and visualization of large-scale three-dimensional reconstructions from underwater robotic surveys. J Field Robot 27(1):21–51CrossRefGoogle Scholar
  30. Johnson-Roberson M, Bryson M, Friedman A, Pizarro O, Troni G, Ozog P, Henderson JC (2017) High-resolution underwater robotic vision-based mapping and three-dimensional reconstruction for archaeology. J Field Robot 34(4):625–643CrossRefGoogle Scholar
  31. Kunz C, Singh H (2008) Hemispherical refraction and camera calibration in underwater vision. In: OCEANS, pp 1–7Google Scholar
  32. Lavest JM, Rives J, Lapreste JT (2000) Underwater camera calibration. In: ECCV ’00: proceedings of the 6th European conference on computer vision-Part II, pp 654–668Google Scholar
  33. Li C, Guo C, Ren W, Cong R, Hou J, Kwong S, Tao D (2019) An underwater image enhancement benchmark dataset and beyond. arXiv:1901.05495
  34. Liarokapis F, Kouřil P, Agrafiotis P, Demesticha S, Chmelík J, Skarlatos D (2017) 3D modelling and mapping for virtual exploration of underwater archaeology assets. Int Arch Photogramm Remote Sens Spatial Inf Sci XLII-2/W3:425–431.  https://doi.org/10.5194/isprs-archives-XLII-2-W3-425-2017
  35. Lourakis MIA, Argyros AA (2009) Sparse bundle adjustment. ACM Trans Math Softw 36(1):1–30.  https://doi.org/10.1145/1486525.1486527CrossRefzbMATHGoogle Scholar
  36. Ludvigsen M, Eustice R, Singh H (2006) Photogrammetric models for marine archaeology. In: OCEANS 2006. IEEE, pp 1–6Google Scholar
  37. Mahiddine A, Seinturier J, Boï DPJ, Drap P, Merad D, Long L (2012) Underwater image preprocessing for automated photogrammetry in high turbidity water: an application on the Arles-Rhone XIII roman wreck in the Rhodano river, France. In: Proceedings of the 2012 18th international conference on virtual systems and multimedia, Milan, Italy, 2–5 September 2012, pp 189–194Google Scholar
  38. Mahon I, Williams SB, Pizarro O, Johnson-Roberson M (2008) Efficient view-based SLAM using visual loop closures. IEEE Trans Rob 24(5):1002–1014CrossRefGoogle Scholar
  39. Mangeruga M, Cozza M, Bruno F (2018a) Evaluation of underwater image enhancement algorithms under different environmental conditions. J Mar Sci Eng 6(1):10CrossRefGoogle Scholar
  40. Mangeruga M, Bruno F, Cozza M, Agrafiotis P, Skarlatos D (2018b) Guidelines for underwater image enhancement based on benchmarking of different methods. Remote Sens 10(10):1652CrossRefGoogle Scholar
  41. McCarthy J, Benjamin J (2014) Multi-image photogrammetry for underwater archaeological site recording: an accessible, diver-based approach. J Marit Archaeol 9(1):95–114CrossRefGoogle Scholar
  42. Menna F, Agrafiotis P, Georgopoulos A (2018a) State of the art and applications in archaeological underwater 3D recording and mapping. J Cult Herit 33:231–248CrossRefGoogle Scholar
  43. Menna F, Nocerino E, Remondino F (2018b) Photogrammetric modelling of submerged structures: influence of underwater environment and lens ports on three-dimensional (3D) measurements. In: Latest developments in reality-based 3D surveying and modelling. MDPI Basel, Switzerland, pp 279–303Google Scholar
  44. Murai S, Kakiuchi H, Hano K, Tsuboi K, Tanabe S (1988) Computer generated mosaic of underwater photographs of ancient amphorae, Offshore the Syria. Int Arch Photogramm Remote Sens Spat Info Sci XXVII (Part B5)Google Scholar
  45. Rebikoff DI (1966) Mosaic and strip scanning photogrammetry of large areas underwater regardless of transparency limitations. In: Underwater photo optics I, vol 7. International Society for Optics and Photonics, pp 105–115Google Scholar
  46. Roman C, Inglis G, Rutter J (2010) Application of structured light imaging for highresolution mapping of underwater archaeological sites. In: OCEANS 2010 IEEE-Sydney. IEEE, pp 1–9Google Scholar
  47. Schechner YY, Karpel N (2004) Attenuating natural flicker patterns. In: OCEANS ’04. MTTS/IEEE TECHNO-OCEAN ’04, vol 3. IEEE, pp 1262–1268Google Scholar
  48. Sedlazeck A, Koch R (2012) Perspective and non-perspective camera models in underwater imaging—overview and error analysis. In: Dellaert F, Frahm J-M, Pollefeys M, Leal-Taix L, Rosenhahn B (eds) Book perspective and non-perspective camera models in underwater imaging—overview and error analysis. Springer Berlin Heidelberg, pp 212–242Google Scholar
  49. Shihavuddin ASM, Gracias N, Garcia R (2012) Online sunflicker removal using dynamic texture prediction. In: VISAPP, vol 1, pp 161–167Google Scholar
  50. Shortis M (2015) Calibration techniques for accurate measurements by underwater cameras. Sensors 15(12):30810–30826CrossRefGoogle Scholar
  51. Shortis M (2019) Camera calibration techniques for accurate measurement underwater. In: McCarthy JK, Benjamin J, Winton T, van Duivenvoorde W (eds) 3D Recording and interpretation for maritime archaeology. Springer International Publishing, pp 11–27Google Scholar
  52. Skarlatos D, Agapiou A, Rova M (2010) Photogrammetric support on an underwater archaeological excavation site: the Mazotos shipwreck case. In: 3rd international conference dedicated on digital heritage, Euromed 2010, Digital Heritage, 8–11 November, Lemesos. EuroMed2010, Arcaeolingua, pp 14–20Google Scholar
  53. Skarlatos D, Demestiha S, Kiparissi S (2012) An ‘open’ method for 3D modelling and mapping in underwater archaeological sites. Int J Herit Digit Era 1(1):1–24CrossRefGoogle Scholar
  54. Skarlatos D, Agrafiotis P, Balogh T, Bruno F, Castro F, Petriaggi BD, … Kikillos F (2016) Project iMARECULTURE: advanced VR, iMmersive serious games and augmented REality as tools to raise awareness and access to European underwater CULTURal heritagE. In: Euro-mediterranean conference. Springer, Cham, pp 805–813Google Scholar
  55. Skarlatos D, Menna F, Nocerino E, Agrafiotis P (2019) Precision potential of underwater networks for archaeological excavation through trilateration and photogrammetry. Int Arch Photogramm Remote Sens Spatial Inf Sci XLII-2/W10:175–180.  https://doi.org/10.5194/isprs-archives-XLII-2-W10-175-2019
  56. Snavely N, Seitz SM, Szeliski R (2006) Photo tourism. ACM SIGGRAPH 2006 papers on—SIGGRAPH ’06.  https://doi.org/10.1145/1179352.1141964
  57. Snavely N, Seitz SM, Szeliski R (2008a) Modeling the world from internet photo collections. Int J Comput Vision 80(2):189–210CrossRefGoogle Scholar
  58. Snavely N, Garg R, Seitz SM, Szeliski R (2008b) Finding paths through the world’s photos. ACM SIGGRAPH 2008 papers on—SIGGRAPH ’08.  https://doi.org/10.1145/1399504.1360614
  59. Telem G, Filin S (2010) Photogrammetric modeling of underwater environments. ISPRS J Photogramm Remote Sens 65(5):433–444CrossRefGoogle Scholar
  60. Trabes E, Jordan MA (2015) Self-tuning of a sunlight-deflickering filter for moving scenes underwater. 2015 XVI workshop on information processing and control (RPIC). IEEEGoogle Scholar
  61. Treibitz T, Schechner YY (2009) Active polarization descattering. IEEE Trans Pattern Anal Mach Intell 31(3):385–399CrossRefGoogle Scholar
  62. Treibitz T, Schechner Y, Singh H (2008) Flat refractive geometry. In: Proceedings of IEEE conference on computer vision and pattern recognition CVPR 2008, pp 1–8Google Scholar
  63. Westoby M, Brasington J, Glasser N, Hambrey M, Reynolds J (2012) ‘Structure-from-Motion’ photogrammetry: a low-cost, effective tool for geoscience applications. Geomorphology 179:300–314.  https://doi.org/10.1016/j.geomorph.2012.08.021CrossRefGoogle Scholar
  64. Yamafune K, Torres R, Castro F (2017) Multi-image photogrammetry to record and reconstruct underwater shipwreck sites. J Archaeol Method Theory 24(3):703–725CrossRefGoogle Scholar
  65. Zhukovsky MO, Kuznetsov VD, Olkhovsky SV (2013) Photogrammetric techniques for 3-D underwater record of the antique time ship from Phanagoria. Int Arch Photogramm Remote Sens Spat Inf Sci 40:717–721CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Lab of Photogrammetric Vision, Civil Engineering and Geomatics DepartmentCyprus University of TechnologyLimassolCyprus
  2. 2.Department of Topography, School of Rural and Surveying EngineeringNational Technical University of AthensAthensGreece

Personalised recommendations