A Semantic Model for Video Description and Retrieval

  • Chia-Han Lin
  • Andro H.C. Lee
  • Arbee L.P. Chen
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2532)


In this paper, a semantic video retrieval system is proposed based on the stories of the videos. A hierarchical knowledge model is used to express the semantic meanings contained in the videos, and a video query language is also provided. The terms of Object, Action and Relation are used to specify rich and complex semantic meanings in a query. Based on the proposed knowledge model, the retrieval system is able to make inferences on the terms appearing in a query, and determine whether a video semantically matches the query conditions. The semantic similarity measurement is also proposed for processing approximate queries.


Video Clip Query Processing Semantic Model Query Result Semantic Meaning 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Harry W. Agiuo and Marios C. Angelides, “Modeling Content for Semantic-Level Querying of Multimedia,” Multimedia Tools and Applications, Vol.15, No.1, 2001.Google Scholar
  2. [2]
    Edoardo Ardizzone and Mohand-Said Hacid, “A Semantic Modeling Approach for Video Retrieval by Content,” Proc. IEEE International Conference Multimedia of Computing and Systems, 1999.Google Scholar
  3. [3]
    E. Ardizzone, M. La Cascia and D. Molinelli, “Motion and Color-Based Video Indexing and Retrieval,” Proc. IEEE Pattern Recognition, pp.135–139 1996.Google Scholar
  4. [4]
    T. Chua and L. Ruan, “A Video Retrieval and Sequencing System,” ACM Transaction on Information Systems, 1995.Google Scholar
  5. [5]
    Cyril Decleir and Mohand-Said Hacid, “A Database Approach for Modeling and Querying Video Data,” Proc. IEEE 15th International Conference on Data Engineering, 1999.Google Scholar
  6. [6]
    Lilac A.E. Al Safadi and Janusz R. Getta, “Semantic Modeling for Video Content-Based Retrieval Systems,” Proc. IEEE 23th Australasian Computer Science Conference, 2000.Google Scholar
  7. [7]
    M.-S Hacid, C. Decleir, and J. Kouloumdjian, “ A database approach for modeling and querying video data,” IEEE Transactions on Knowledge and Data Engineering, Vol.12, No.5, pp.729–750, Sept–Oct. 2000.CrossRefGoogle Scholar
  8. [8]
    Mi Hee, Yoon Yong Ik and Kio Chung Kim, “Intelligent Hybrid Video Retrieval System supporting Spatio-temporal correlation, Similarity retrieval,” Systems, Man, and Cybernetics, 1999.Google Scholar
  9. [9]
    R. Hielsvold and R. Midtstraum, “ Modeling and Querying Video Data,” Proceedings of the 20 th International Conference on VLDB, 1994.Google Scholar
  10. [10]
    Haitao Jiang, Danilo Montesi and Ahmed K. Elmagarmid, “VideoText Database Systems,” Proceedings of the International Conference on Multimedia Computing and Systems, 1997.Google Scholar
  11. [11]
    Jia-Ling Koh, Chin-Sung Lee and Arbee L.P. Chen, “Semantic Video Model for Content-Based Retrieval,” Proc. International Conference on Multimedia Computing and Systems, 1999.Google Scholar
  12. [12]
    Tony C.T. Kuo and Arbee L.P. Chen, “Indexing, Query Interface and Query Processing for Venus: A Video Database System,” Proc. International Symposium on Cooperative Database Systems for Advanced Applications, 1996.Google Scholar
  13. [13]
    Andro H. C. Lee, “A Semantic Model for Video Description and Retrieval,” Master Thesis, Dept. of Computer Science, National Tsing Hua University, Taiwan, 2001Google Scholar
  14. [14]
    Suieet Pradhan, Keishi Tajima, Katsumi Tanaka, “Querying Video Databases based on Description Substantiality and Approximations,” Proceedings of the IPSJ International Symposium on Information Systems and Technologies for Network Society, September 1997.Google Scholar
  15. [15]
    T. G. A. Smith and G. Davenport, “The Stratification System: A Design Environment for Random Access Video,” Workshop on Networking and Operating System Support for Digital Audio and Video, 1992.Google Scholar
  16. [16]
    Mitsukazu Washisaka, Toshihiro Takada, Shigemi Anyagi and Rikio Onai, “Video/Text Linkage System Assisted by a Concept Dictionary and Image Recognition,” Proceedings of the International Conference on Multimedia Computing and Systems, 1996.Google Scholar
  17. [17]
    D. Zhong and S.-F. Chang, “Video Object Model and Segmentation for Content-Based Video Indexing,” Proc. of IEEE International Symposium on Circuits and Systems, 1997.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Chia-Han Lin
    • 1
  • Andro H.C. Lee
    • 1
  • Arbee L.P. Chen
    • 1
  1. 1.Department of Computer ScienceNational Tsing Hua UniversityHsinchu, TaiwanR.O.C.

Personalised recommendations