Flexible Querying Using Structural and Event Based Multimodal Video Data Model

  • Hakan Öztarak
  • Adnan Yazıcı
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4027)


Investments on multimedia technology enable us to store many more reflections of the real world in digital world as videos so that we carry a lot of information to the digital world directly. In order to store and efficiently query this information, a video database system (VDBS) is necessary. We propose a structural, event based and multimodal (SEBM) video data model which supports three different modalities that are visual, auditory and textual modalities for VDBSs and we can dissolve these three modalities within a single SEBM model. We answer the content-based, spatio-temporal and fuzzy queries of the user by using SEBM video data model more easily, since SEBM stores the video data as the way that user interprets the real world data. We follow divide and conquer technique when answering very complicated queries. We give the algorithms for querying on SEBM and try them on an implemented SEBM prototype system.


Video Data Complex Query Video Object Spatial Query Semantic Place 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Snoek, C., Worring, M.: Multimodal Video Indexing: A review of the State of Art. Multimedia Tools and Applications 25, 5–35 (2005)CrossRefGoogle Scholar
  2. 2.
    Durak, N.: Semantic Video Modeling And Retrieval With Visual, Auditory, Textual Sources., Ms Thesis, METU (2004)Google Scholar
  3. 3.
    Köprülü, M., Çiçekli, N.K., Yazıcı, A.: Spatio-temporal querying in video databases. Inf. Sci. 160(1-4), 131–152 (2004)CrossRefGoogle Scholar
  4. 4.
    Ekin, A., Tekalp, M., Mehrotra, R.: Integrated Semantic–Syntactic Video Modeling for Search and Browsing. IEEE Transactions on Multimedia 6(6) (December 2004)Google Scholar
  5. 5.
    Öztarak, H.: Structural and Event Based Multimodal Video Data Modelling., Ms Thesis, METU (2005)Google Scholar
  6. 6.
    Tjondronegoro, D., Chen, P.: Content-Based Indexing and Retrieval Using MPEG-7 and X-Query in Video Data Management Systems. World Wide Web: Internet and Web Information Systems 5, 207–227 (2002)Google Scholar
  7. 7.
    Oomoto, E., Tanaka, K.: OVID: Design and implementation of a video-object database system. IEEE Trans. Knowledge Data Eng. 5, 629–643 (1993)CrossRefGoogle Scholar
  8. 8.
    Ulusoy, Ö., Güdükbay, U., Dönderler, M., Ediz, Ş., Alper, C.: BilVideo Database Management System. In: Proceedings of the 30th VLDB Conference, Toronto, Canada (2004)Google Scholar
  9. 9.
    Zhang, C., Chen, S.-C., Shyu, M.-L.: PixSO: A System for Video Shot Detection. In: Proceedings of the Fourth IEEE Pacific-Rim Conference On Multimedia, Singapore, pp. 1–5 (December 15-18, 2003)Google Scholar
  10. 10.
    IBM MPEG-7 Annotation Tool Web site (last date accessed, September 2005),
  11. 11.
    Berkeley DB XML (Last date accessed, September 2005),
  12. 12.
    XQuery (Last date accessed, September 2005),
  13. 13.
    Pradhan, S., Tajima, K., Tanaka, K.: A Query Model to Synthesize Answer Intervals from Indexed Video Units. IEEE Trans. on Knowledge and Data Eng. 13(5), 824–838 (2001)CrossRefGoogle Scholar
  14. 14.
    Hammiche, S., Benbernou, S., Hacid, M., Vakali, A.: Semantic Retrieval of Multimedia Data. In: MMDB 2004, November 13, 2004, Washington, DC, USA (2004)Google Scholar
  15. 15.
    Lyu, M., Yau, E., Sze, S.: A Multilingual, Multimodal Digital Video Library System. In: JCDL 2002, July 13-17, 2002, Portland, Oregon, USA (2002)Google Scholar
  16. 16.
    Kuo, T., Chen, A.: Content-Based Query Processing for Video Databases. IEEE Trans. on Multimedia. 2(1) (March 2000)Google Scholar
  17. 17.
    Day, Y.F., Dağtaş, S., Lino, M., Khokhar, A., Ghafoor, A.: Object Oriented Conceptual Modeling of Video Data. In: Proc. Data Eng. (DE 1995), pp. 401–408 (1995)Google Scholar
  18. 18.
    Snoek, C.G.M., Worring, M.: Multimedia event based video indexing using time intervals. Technical Report 2003-01, Intelligent Sensory Information Systems Group, University of Amsterdam (August 2003)Google Scholar
  19. 19.
    Allen, J.: Maintaining Knowledge about Temporal Intervals. Communications of ACM 26(11), 832–843 (1983)MATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Hakan Öztarak
    • 1
  • Adnan Yazıcı
    • 2
  1. 1.Aselsan IncYenimahalle, AnkaraTurkey
  2. 2.Department of Computer EngineeringMETUAnkaraTurkey

Personalised recommendations