Structural and Event Based Multimodal Video Data Modeling

  • Hakan Öztarak
  • Adnan Yazıcı
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4243)


In this paper, a structural and event based multimodal video data model (SEBM) is proposed. SEBM supports three different modalities that are visual, auditory and textual modalities for video database systems and it can dissolve these three modalities within a single structure. This dissolving procedure is a mimic of human interpretation regarding video data. The SEBM video data model is used to answer content-based, spatio-temporal and fuzzy queries about video data. A SEBM prototype system is developed to evaluate the practical usage of the SEBM video data model when storing and querying the video data.


Query Processing Video Data Video Modeling Video Object Conjunctive Query 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Snoek, C., Worring, M.: Multimodal Video Indexing: A review of the State of Art. Multimedia Tools and Applications 25, 5–35 (2005)Google Scholar
  2. 2.
    Durak, N.: Semantic Video Modeling And Retrieval With Visual, Auditory, Textual Sources, Ms Thesis, METU (2004)Google Scholar
  3. 3.
    Köprülü, M., Çiçekli, N.K., Yaz\(\imath\)c\(\imath\), A.: Spatio-temporal querying in video databases. Inf. Sci. 160(1-4), 131–152 (2004)Google Scholar
  4. 4.
    Ekin, A., Tekalp, M., Mehrotra, R.: Integrated Semantic–Syntactic Video Modeling for Search and Browsing. IEEE Transactions on Multimedia 6(6) (December 2004)Google Scholar
  5. 5.
    Öztarak, H.: Structural and Event Based Multimodal Video Data Modelling, Ms Thesis, METU (2005)Google Scholar
  6. 6.
    Öztarak, H., Yazıcı, A.: Flexible Querying Using Structural and Event Based Multimodal Video Data Model. In: Larsen, H.L., Pasi, G., Ortiz-Arroyo, D., Andreasen, T., Christiansen, H. (eds.) FQAS 2006. LNCS (LNAI), vol. 4027, pp. 75–86. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  7. 7.
    Oomoto, E., Tanaka, K.: OVID: Design and implementation of a video-object database system. IEEE Trans. Knowledge Data Eng. 5, 629–643 (1993)Google Scholar
  8. 8.
    Ulusoy, Ö., Güdükbay, U., Dönderler, M., Ediz, Alper, C.: BilVideo Database Management System. In: Proceedings of the 30th VLDB Conference, Toronto, Canada (2004)Google Scholar
  9. 9.
    Zhang, C., Chen, S., Shyu, M.: PixSO: A System for Video Shot Detection. In: Proceedings of the Fourth IEEE Pacific-Rim Conference On Multimedia, Singapore, Decemebr 15-18, 2003, pp. 1–5 (2003)Google Scholar
  10. 10.
    IBM MPEG-7 Annotation Tool Web site (Last date accessed, September 2005),
  11. 11.
    Berkeley DB XML Web Site, (Last date accessed, September 2005)
  12. 12.
    XQuery Web Site (Last date accessed, September 2005),
  13. 13.
    Pradhan, S., Tajima, K., Tanaka, K.: A Query Model to Synthesize Answer Intervals from Indexed Video Units. IEEE Trans. on Knowledge and Data Eng. 13(5), 824–838 (2001)Google Scholar
  14. 14.
    Hammiche, S., Benbernou, S., Hacid, M., Vakali, A.: Semantic Retrieval of Multimedia Data. In: Hammiche, S., Benbernou, S., Hacid, M., Vakali, A. (eds.) MMDB 2004, Washington, DC, USA, November 13 (2004)Google Scholar
  15. 15.
    Lyu, M., Yau, E., Sze, S.: A Multilingual, Multimodal Digital Video Library System. In: JCDL 2002, Portland, Oregon, USA, July 13-17 (2002)Google Scholar
  16. 16.
    Kuo, T., Chen, A.: Content-Based Query Processing for Video Databases. IEEE Trans. on Multimedia 2(1) (March 2000)Google Scholar
  17. 17.
    Day, Y., Data, S., Iino, M., Khokhar, A., Ghafoor, A.: Object Oriented Conceptual Modeling of Video Data. In: Proc. Data Eng. (DE 1995), pp. 401–408 (1995)Google Scholar
  18. 18.
    Snoek, C.G.M., Worring, M.: Multimedia event based video indexing using time intervals. Technical Report 2003-01, Intelligent Sensory Information Systems Group, University of Amsterdam (August 2003)Google Scholar
  19. 19.
    Tjondronegoro, D., Chen, P.: Content-Based Indexing and Retrieval Using MPEG-7 and X-Query in Video Data Management Systems. World Wide Web: Internet and Web Information Systems 5, 207–227 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Hakan Öztarak
    • 1
  • Adnan Yazıcı
    • 2
  1. 1.Aselsan IncYenimahalle, AnkaraTurkey
  2. 2.Department of Computer EngineeringMETUAnkaraTurkey

Personalised recommendations