Dynamic Narratives for Heritage Tour

  • Anurag Ghosh
  • Yash Patel
  • Mohak Sukhwani
  • C. V. Jawahar
Conference paper

DOI: 10.1007/978-3-319-46604-0_59

Volume 9913 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Ghosh A., Patel Y., Sukhwani M., Jawahar C.V. (2016) Dynamic Narratives for Heritage Tour. In: Hua G., Jégou H. (eds) Computer Vision – ECCV 2016 Workshops. ECCV 2016. Lecture Notes in Computer Science, vol 9913. Springer, Cham

Abstract

We present a dynamic story generation approach for the egocentric videos from the heritage sites. Given a short video clip of a ‘heritage-tour’ our method selects a series of short descriptions from the collection of pre-curated text and create a larger narrative. Unlike in the past, these narratives are not merely monotonic static versions from simple retrievals. We propose a method to generate on the fly dynamic narratives of the tour. The series of the text messages selected are optimised over length, relevance, cohesion and information simultaneously. This results in ‘tour guide’ like narratives which are seasoned and adapted to the participants selection of the tour path. We simultaneously use visual and gps cues for precision localization on the heritage site which is conceptually formulated as a graph. The efficacy of the approach is demonstrated on a heritage site, Golconda Fort, situated in Hyderabad, India. We validate our approach on two hours of data collected over multiple runs across the site for our experiments.

Keywords

Storytelling Digital heritage Egocentric perception 

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Anurag Ghosh
    • 1
  • Yash Patel
    • 1
  • Mohak Sukhwani
    • 1
  • C. V. Jawahar
    • 1
  1. 1.CVIT, IIIT HyderabadHyderabadIndia