Skip to main content
SpringerLink
Log in

Rule-based spatiotemporal query processing for video databases

  • Published:
The VLDB Journal Aims and scope Submit manuscript

Abstract.

In our earlier work, we proposed an architecture for a Web-based video database management system (VDBMS) providing an integrated support for spatiotemporal and semantic queries. In this paper, we focus on the task of spatiotemporal query processing and also propose an SQL-like video query language that has the capability to handle a broad range of spatiotemporal queries. The language is rule-based in that it allows users to express spatial conditions in terms of Prolog-type predicates. Spatiotemporal query processing is carried out in three main stages: query recognition, query decomposition, and query execution.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Adali S, Candan KS, Chen S, Erol K, Subrahmanian VS (1996) Advanced video information systems: data structures and query processing. ACM Multimedia Sys 4:172-186

    Article  Google Scholar 

  2. Allen JF (1983) Maintaining knowledge about temporal intervals. Commun ACM 26(11):832-843

    Article  MATH  Google Scholar 

  3. Arslan U, Dönderler ME, Saykol E, Ulusoy Ö, Güdükbay U (2002) A semi-automatic semantic annotation tool for video databases. In: Proceedings of the workshop on multimedia semantics (SOFSEM’2002), Milovy, Czech Republic, 24-29 November, 2002, pp 1-10. Available at: http://www.cs.bilkent.edu.tr/~ediz/bilmdg/papers/sofsem02.pdf

  4. Chang NS, Fu KS (1980) Query by pictorial example. IEEE Trans Softw Eng SE6 6:519-524

    Google Scholar 

  5. Chang S, Chen W, Meng HJ, Sundaram H, Zhong D (1997) VideoQ: an automated content-based video search system using visual cues. In: Proceedings of ACM Multimedia, Seattle, 9-13 November 1997, pp 313-324

  6. Chang SK, Shi QY, Yan CW (1987) Iconic indexing by 2-d strings. IEEE Trans Patt Anal Mach Intell 9:413-428

    Google Scholar 

  7. Chu W, Cardenas AF, Taira RK (1995) A knowledge-based multimedia medical distributed database system - KMED. Inf Sys 20(2):75-96

    Article  Google Scholar 

  8. Dönderler ME, Saykol E, Ulusoy Ö, Güdükbay U (2003) BilVideo: a video database management system. IEEE Multimedia 1(10):66-70

    Google Scholar 

  9. Dönderler ME, Ulusoy Ö, Güdükbay U (2002) A rule-based video database system architecture. Inf Sci 143(1-4):13-45

    Google Scholar 

  10. Donnelly C, Stallman R (1995) Bison: the yacc-compatible parser generator. Online manual: http://www.combo.org/bison/

  11. Egenhofer M, Franzosa R (1991) Point-set spatial relations. Int J Geograph Inf Sys 5(2):161-174

    Google Scholar 

  12. Flickner M, Sawhney H, Niblack W, Ashley J, Huang Q, Dom B, Gorkani M, Hafner J, Lee D, Petkovic D, Steele D, Yanker P (1995) Query by image and video content: the QBIC system. IEEE Comput 28:23-32

    Article  Google Scholar 

  13. Guting RH, Bohlen MH, Erwig M, Jensen CS, Lorentzos NA, Schneider M, Vazirgiannis M (2000) A foundation for representing and querying moving objects. ACM Trans Database Sys 25(1):1-42

    Article  Google Scholar 

  14. Hjelsvold R, Midtstraum R (1994) Modelling and querying video data. In: Proceedings of the 20th international conference on very large databases, Santiago, Chile, 12-15 September 1994, pp 686-694

  15. Hwang E, Subrahmanian VS (1996) Querying video libraries. J Vis Commun Image Represent 7(1):44-60

    Article  Google Scholar 

  16. Jiang H, Montesi D, Elmagarmid AK (1997) VideoText database systems. In: Proceedings of IEEE Multimedia Computing and Systems, Ottawa, Canada, 3-6 January, 1997, pp 344-351

  17. Johnson SC (1975) Yacc: yet another compiler compiler. Computing Science Technical Report 32, Bell Laboratories, Murray Hill, NJ

  18. Koh J, Lee C, Chen ALP (1999) Semantic video model for content-based retrieval. In: Proceedings of IEEE Multimedia Computing and Systems, Florence, Italy, 7-11 June, 1999, 1:472-478

  19. Kuo TCT, Chen ALP (1996) A content-based query language for video databases. In: Proceedings of IEEE Multimedia Computing and Systems, 17-23 June, Hiroshima, Japan, pp 209-214

  20. Kuo TCT, Chen ALP (2000) Content-based query processing for video databases. IEEE Trans Multimedia 2(1):1-13

    Article  Google Scholar 

  21. Lesk ME (1975) Lex - a lexical analyzer generator. Computing Science Technical Report 39, Bell Laboratories, Murray Hill, NJ

  22. Li JZ (1998) Modeling and querying multimedia data. Technical Report TR-98-05, Department of Computing Science, The University of Alberta, Alberta, Canada

  23. Li JZ, Özsu MT (1997) Stars: a spatial attributes retrieval system for images and videos. In: Proceedings of the 4th international conference on multimedia modeling, Singapore, 18-19 November, 1997, pp 69-84

  24. Li JZ, Özsu MT, Szafron D (1997) Modeling of moving objects in a video database. In: Proceedings of IEEE Multimedia Computing and Systems, Ottawa, Canada, 3-6 June, 1997, pp 336-343

  25. Li JA, Özsu MT, Szafron D, Oria V (1997) MOQL: A multimedia object query language. In: Proceedings of the 3rd international workshop on multimedia information systems, Como, Italy, 25-27 September, 1997, pp 19-28

  26. Li JZ, Özsu MT, Szafron D, Oria V (1997) Multimedia extensions to database query languages. Technical Report TR-97-01, Department of Computing Science, University of Alberta, Alberta, Canada

  27. Marcus S, Subrahmanian VS (1996a) Foundations of multimedia information systems. J ACM 43(3):474-523

    Article  MathSciNet  MATH  Google Scholar 

  28. Marcus S, Subrahmanian VS (1996b) Towards a theory of multimedia database systems. In: Subrahmanian VS, Jajodia S (eds) Multimedia database systems: issues and research directions. Springer, Berlin Heidelberg New York, pp 1-35

  29. Mehrotra S, Chakrabarti K, Ortega M, Rui Y, Huang TS (1997) Multimedia analysis and retrieval system (MARS project). In: Proceedings of the 3rd international workshop on information retrieval systems, Como, Italy, 25-27 September, 1997, pp 39-45

  30. Nabil M, Ngu AH, Shepherd J (2001) Modeling and retrieval of moving objects. Multimedia Tools Appl 13:35-71

    Article  Google Scholar 

  31. Oomoto E, Tanaka K (1993) OVID: Design and implementation of a video object database system. IEEE Trans Knowl Data Eng 5:629-643

    Article  Google Scholar 

  32. Özsu MT, Iglinski P, Szafron D, El-Medani S, Junghanns M (1997) An object-oriented sqml/hytime compliant multimedia database management system. In: Proceedings of of ACM Multimedia, Seattle, 9-13 November, 1997, pp 233-240

  33. Papadias D, Theodoridis Y, Sellis T, Egenhofer M (1995) Topological relations in the world of minimum bounding rectangles: a study with R-trees. In: Proceedings of the ACM SIGMOD international conference on management of data, San Jose, 22-25 May 1995, pp 92-103

  34. Paxson V (1995) Flex: a fast scanner generator. Online manual: http://www.combo.org/flex/

  35. Petrakis EGM, Orphanoudakis SC (1993) Methodology for the representation, indexing and retrieval of image by content. Image Vision Comput 11(8):504-521

    Article  Google Scholar 

  36. Saykol E (2001) Web-based user interface for query specification in a video database system. Master’s thesis, Department of Computer Engineering, Bilkent University, Ankara, Turkey

  37. Saykol E, Güdükbay U, Ulusoy Ö (2002) A histogram-based approach for object-based query-by-shape-and-color in multimedia databases. Available as a technical report (BU-CE-0201) at: http://www.cs.bilkent.edu.tr/tech-reports/2002/BU-CE-0201.ps.gz

  38. Sistla AP, Wolfson O, Chamberlain S, Dao S (1997) Modeling and querying moving objects. In: Proceedings of IEEE Data Engineering, Birmingham, UK, 7-11 April 1997, pp 422-432

  39. Smoliar SW, Zhang H (1994) Content-based video indexing and retrieval. IEEE Multimedia Mag 1(2):62-72

    Article  Google Scholar 

  40. Ünel G, Dönderler ME, Ulusoy Ö, Güdükbay U (2004) An efficient query optimization strategy for spatio-temporal queries in video databases. J Sys Softw (in press)

  41. Zhuang Y, Rui Y, Huang TS, Mehrotra S (1998) Applying semantic association to support content-based video retrieval. In: Proceedings of the IEEE Very Low Bitrate Video Coding workshop (VLBV98), Urbana, IL, 8-9 October 1998, pp 45-48

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Arizona State University, AZ 85287-5406, Tempe, USA

    Mehmet Emin Dönderler

  2. Department of Computer Engineering, Bilkent University, 06800, Bilkent, Ankara, Turkey

    Özgür Ulusoy & Ugur Güdükbay

Authors
  1. Mehmet Emin Dönderler
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Özgür Ulusoy
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ugur Güdükbay
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Özgür Ulusoy.

Additional information

Received: 11 October 2001, Accepted: 3 October 2003, Published online: 12 December 2003

Edited by: A. Buchmann

Correspondence to: Özgür Ulusoy

This work is supported by the Scientific and Research Council of Turkey (TÜBITAK) under Project Code 199E025. This work was done while the first author was at Bilkent University.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Dönderler, M.E., Ulusoy, Ö. & Güdükbay, U. Rule-based spatiotemporal query processing for video databases. VLDB 13, 86–103 (2004). https://doi.org/10.1007/s00778-003-0114-0

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00778-003-0114-0

Keywords:

Search

Navigation