Skip to main content
SpringerLink
Log in

Savanta—search, analysis, visualisation and navigation of temporal annotations

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this article, we present Savanta, an information gathering interface for temporal, semantic video annotations. In Savanta, we integrate various methods and paradigms for information gathering, including visualisation, filtering, data mining, navigation and search, in order to explore the possible advantages of doing so. We posit that a seamless integration of multiple access methods, combined with an improved interval visualisation scheme and dynamically generated metadata, will result in greater user satisfaction compared to conventional approaches for searching and querying video databases—despite the increased complexity that may result. We perform a formal usability evaluation comparing Savanta to systems based on traditional search/query paradigms, and conclude that Savanta outperforms them with regard to both power and usability, especially for complex and open-ended tasks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5.
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Notes

  1. http://www.w3c.org/RDF

  2. http://www.altavista.com/video

References

  1. Adali S, Candan KS, Chen S, Erol K, Subrahmanian VS (1996) The advanced video information system: data structures and query processing. Multimedia Syst 4–4:172–186

    Google Scholar 

  2. Ahlberg C, Williamson C, Shneiderman B (1992) Dynamic queries for information exploration: an implementation and evaluation. Proceedings of ACM CHI’92 Conference on Human Factors in Computer Systems, pp 619–626

  3. Allen JF (1983) Maintaining knowledge about temporal intervals. Commun ACM 26–11:832–843

    Article  Google Scholar 

  4. Anjulan A, Canagarajah N (2006) A novel framework for robust annotation and retrieval in video sequences, CIVR 2006, LNCS 4071, pp. 183–192

  5. Baeza-Yates RA, Ribeiro-Neto BA (1999) Modern information retrieval. ACM, Addison-Wesley

    Google Scholar 

  6. Carrer M, Ligresti L, Ahanger G, Little TDC (1997) An annotation engine for supporting video database population. Multimedia Tools Appl 5–3:233–258

    Article  Google Scholar 

  7. Chan SSM, Li Q, Wu Y, Zhuang Y (2002) Accommodating hybrid retrieval in a comprehensive video database management system. IEEE Trans Multimedia 4–2

  8. Chin JP, Diehl VA, Norman KL (1988) Development of an instrument measuring user satisfaction of the human-computer interface. In: Proceedings of ACM CHI’88 conference on human factors in computing systems, pp 213–218

  9. Christel MG, Kanade T, Mauldin M, Reddy R, Sirbu M, Stevens SM, Wactlar HD (1995) Informedia digital video library. Commun ACM 38–4:57–58

    Article  Google Scholar 

  10. Chua T, Chen L, Wang J (2002) Stratification approach to modeling video. Multimedia Tools Appl 16–1:79–97

    Article  Google Scholar 

  11. Dönderler ME, Saykol E, Ulusoy Ö, Güdükbay U (2003) BilVideo: a video database management system. IEEE MultiMedia 10–1:66–70

    Google Scholar 

  12. Dorado A, Calic J, Izquierdo E (2004) A rule-based video annotation system. IEEE Trans Circuits Syst Video Technol 14–5:622–633

    Article  Google Scholar 

  13. Ekin A, Tekalp AM, Mehrotra R (2004) Integrated semantic–syntactic video modeling for search and browsing. IEEE Trans Multimedia 6–6:839–851

    Article  Google Scholar 

  14. Gershon N, Eick SG, Card S (1998) Design: information visualization. Interactions 5–2:9–15

    Article  Google Scholar 

  15. Hacid M-S, Decleir C, Kouloumdjian J (2000) A database approach for modeling and querying video data. IEEE Trans Knowl Data Eng 12–5:729–750

    Article  Google Scholar 

  16. Hauglid JO (2005) User interfaces for accessing information in digital repositories, Ph.D. thesis, Department of Information and Computer Science, Norwegian University of Science and Technology, NTNU trykk

  17. Hauglid JO, Midtstraum R (2002) SESAM: searching supported by analysis of metadata. In: Proceedings of the 2002 ACM symposium on applied computing (SAC), pp 418–425

  18. Heggland J (2002) OntoLog: temporal annotation using ad hoc ontologies and application profiles. In research and advanced technology for digital libraries (ECDL), pp 118–128

  19. Heggland J (2005) OntoLog: flexible management of temporal video content annotations, Ph.D. thesis, Department of Information and Computer Science, Norwegian University of Science and Technology, NTNU trykk

  20. Hjelsvold R (1995) VideoSTAR-a database for video information sharing. Department of Computer Science and Telematics, Norwegian Institute of Technology

  21. Hjelsvold R, Midtstraum R (1994) Modelling and querying video data. In VLDB’94, In: Proceedings of 20th international conference on Very Large Data Bases, pp 686–694

  22. Hjelsvold R, Midtstraum R, Sandstå O (1995a) A temporal foundation of video databases. In: Clifford J, Tuzhilin A (eds) Recent advances in temporal databases: proceedings of the international workshop on temporal databases, pp 295–314

  23. Hjelsvold R, Langørgen S, Midtstraum R, Sandstå O (1995b) Integrated video archive tools. ACM Multimedia, pp 283–293

  24. Kazman R, Al-Halimi R, Hunt W, Mantei M (1996) Four paradigms for indexing video conferences. IEEE MultiMedia 3–1:63–73

    Article  Google Scholar 

  25. Kokkoras FA, Jiang H, Vlahavas IP, Elmagarmid AK, Houstis EN, Aref WG (2002) Smart videotext: a video data model based on conceptual graphs. Multimedia Syst 8–4:328–338

    Article  Google Scholar 

  26. Mackay WE, Beaudouin-Lafon M (1998) DIVA: exploratory data analysis with multimedia streams. CHI, pp 416–423

  27. Mitchell M, Jolley J (2001) Research design explained, 4th edn. Harcourt, Fort Worth, TX

    Google Scholar 

  28. Nack F, Hardman L (2002) Towards a syntax for multimedia semantics http://www.cwi.nl/ftp/CWIreports/INS/INS-R0204.pdf

  29. Nielsen J (1993) Usability engineering. Academic, Boston

    MATH  Google Scholar 

  30. Noldus Information Technology (2007) The observer, http://www.noldus.com/site/doc200401012

  31. Oomoto E, Tanaka K (1993) OVID: design and implementation of a video-object database system. IEEE Trans Knowl Data Eng 5–4:629–643

    Article  Google Scholar 

  32. Ponceleon D, Srinivasan S, Amir A, Petkovic D, Diklic D (1998) Key to effective video retrieval: effective cataloging and browsing. In: Proceedings of the ACM multimedia ’98 conference. ACM, New York, pp. 99–107

  33. Santini S, Jain R (1999) Interfaces for emergent semantics in multimedia databases. In: Proceedings of the IS&T/SPIE conference on storage and retrieval for image and video databases, pp 167–175

  34. Shneiderman B (1996) The eyes have it: a task by data type taxonomy for information visualizations. In: Proceedings of the IEEE symposium on visual languages, pp 336–343

  35. Shneiderman B (1997) Designing the user interface: strategies for effective human-computer interaction. Addison-Wesley, Reading, MA

    Google Scholar 

  36. Skou CV (2003) Qualitative media analyzer, http://www.cvs.dk/qma.htm, August

  37. Slaughter LA, Oard DW, Warnick VL, Harding JL, Wilkerson GJ (1998) A graphical interface for speech-based retrieval. In: Proceedings of the 3rd ACM international conference on digital libraries, pp 305–306

  38. Volkmer T, Smith JR, Natsev A (2005) A web-based system for collaborative annotation of large image and video collections: an evaluation and user study. In: Proceedings of the 13th annual ACM international conference on multimedia, November 06–11, 2005, Hilton, Singapore. DOI 10.1145/1101149.1101341

  39. Wactlar HD, Kanade T, Smith MA, Stevens SM (1996) Intelligent access to digital video: informedia project. IEEE Comp 29–5:46–52

    Google Scholar 

  40. Weiss R, Duda A, Gifford DK (1995) Composition and search with a video algebra. IEEE MultiMedia 2–1:12–25

    Article  Google Scholar 

  41. Whittaker S, Hirschberg J, Choi J, Hindle D, Pereira FCN, Singhal A (1999) SCAN: designing and evaluating user interfaces to support retrieval from speech archives. In: Proceedings of the 22nd annual international ACM SIGIR conference on research and development in information retrieval pp 26–33

  42. Zhao N, Chen S-C, Shyu M-L (2006) Video database modeling and temporal pattern retrieval using hierarchical Markov model mediator. In: Proceedings of the 22nd International Conference on Data Engineering Workshops (ICDEW’06)

Download references

Acknowledgements

We would like to thank Steinar Line for invaluable help in producing the test data, and him and Kjetil Nørvåg for participating in pilot studies of both Savanta and the usability test.

Author information

Authors and Affiliations

  1. Department of Computer and Information Science, Norwegian University of Science and Technology, Trondheim, Norway

    Jon Olav Hauglid & Jon Heggland

Authors
  1. Jon Olav Hauglid
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jon Heggland
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jon Olav Hauglid.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hauglid, J.O., Heggland, J. Savanta—search, analysis, visualisation and navigation of temporal annotations. Multimed Tools Appl 40, 183–210 (2008). https://doi.org/10.1007/s11042-008-0204-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-008-0204-5

Keywords

Search

Navigation