Abstract
Extraction and utilization of high-level semantic features are critical for more effective video retrieval. However, the performance of video retrieval hasn’t benefited much despite of the advances in high-level feature extraction. To make good use of high-level semantic features in video retrieval, we present a method called pointwise mutual information weighted scheme(PMIWS). The method makes a good judgment of the relevance of all the semantic features to the queries, taking the characteristics of semantic features into account. The method can also be extended for the fusion of multi-modalities. Experiment results based on TRECVID2005 corpus demonstrate the effectiveness of the method.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12), 1349–1380 (2000)
Natsev, A., Naphade, M.R., Smith, J.R.: Semantic representation: search and mining of multimedia content. In: KDD 2004, pp. 641–646 (2004)
Christel, M.G., Hauptmann, A.G.: The Use and Utility of High-Level Semantic Features in Video Retrieval. In: Leow, W.-K., Lew, M., Chua, T.-S., Ma, W.-Y., Chaisorn, L., Bakker, E.M. (eds.) CIVR 2005. LNCS, vol. 3568, pp. 134–144. Springer, Heidelberg (2005)
Manning, C.D., Schutze, H.: Foundations of Statistical Natural Language Processing. The MIT Press, Cambridge (1999)
Over, P., Ianeva, T., Kraaij, W., Smeaton, A.: TRECVID 2005 - An Introduction. In: Proceedings of TRECVID 2005 (2005)
Amir, A., Argillandery, J., Campbellz, M., Hauboldz, A., Iyengar, G., Ebadollahiz, S., Kangz, F., Naphadez, M.R. (Paul) Natsevz, A., Smithz, J.R., Tesicz, J., Volkmer, T.: BM Research TRECVID-2005 Video Retrieval System. In: Proceedings of TRECVID 2005 (2005)
Jinhui, Y., Huiyi, W., Lan, X., Dong, W., Dayong, D., Yuanyuan, Z., Zijian T., Xiaobing, L., Shuping, X., Wujie, Z., Xirong, L., Zhangzhang, S., Jianmin, L., Fuzong, L., Bo, Z.: Tsinghua University at TRECVID 2005. In: Proceedings of TRECVID 2005 (2005)
Iyengar, G., Duygulu, P., Feng, S., Ircing, P., Khudanpur, S.P., Klakow, D., Krause, M.R., Manmatha, R., Nock, H.J., Petkova, D., Pytlik, B., Virga Pages, P.: Joint Visual-Text Modeling for Automatic Retrieval of Multimedia Documents. In: Proceedings of the 13th ACM international conference on Multimedia, pp. 21–30 (2005)
TREC-10 Proceedings Appendix on Common Evaluation Measures, http://trec.nist.gov/pubs/trec10/appendices/measures.pdf
Yan, R., Yang, J., Hauptmann, A.G.: Learning query-class dependent weights in automatic video retrieval. In: Proceedings of ACM Multimedia 2004, October 2004, pp. 548–555 (2004)
Eidenberger, H., Breiteneder, C.: Semantic Feature Layers in Content-Based Image Retrieval. In: Proceedings IEEE International Conference on Control, Automation, Robotic and Vision, Singapore (2002)
Naphade, M.R., Kennedy, L., Kender, J.R., Chang, S-F., C., Smith, J.R., Over, P., Hauptmann, A.: A Light Scale Concept Ontology for Multimedia Understanding for TRECVID 2005. IBM Research Report RC23612 (W0505-104) (May 2005)
Platt, J.: Probabilities for SV machines. In: Advances in Large Margin Classiers, pp. 61–74. MIT Press, Cambridge (2000)
Chang, S.-F., Hsu, W., Kennedy, L., Xie, L., Yanagawa, A., Zavesky, E., Zhang, D.-Q.: Columbia University TRECVID-2005 Video Search and High-Level Feature Extraction. In: Proceedings of TRECVID 2005 (2005)
Chua, T.-S., Neo, S.-Y., Goh, H.-K., Ming, Z.,Yang, X., Gang, W.: TRECVID 2005 by NUS PRIS. In: Proceedings of TRECVID 2005 (2005)
Snoek, C.G.M., van Gemert, J.C., Geusebroek, J.M., Huurnink, B., Koelma, D.C., Nguyen, G.P., de Rooij, O., Seinstra, F.J., Smeulders, A.W.M., Veenman, C.J., Worring, M.: The MediaMill TRECVID 2005 Semantic Video Search Engine. In: Proceedings of TRECVID 2005 (2005)
Koskela, M., Laaksonen, J., Sjoberg, M., Muurinen, H.: PicSOM Experiments in TRECVID 2005. In: Proceedings of TRECVID 2005 (2005)
Hauptmann, A.G., Christel, M., Concescu, R., Gao, J., Jin, Q., Lin, W.-H., Pan, J.-Y., Stevens, S.M., Yan, R., Yang, J., Zhang, Y.: CMU Informedia’s TRECVID 2005 Skirmishes. In: Proceedings of TRECVID 2005 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zheng, W., Li, J., Si, Z., Lin, F., Zhang, B. (2006). Using High-Level Semantic Features in Video Retrieval. In: Sundaram, H., Naphade, M., Smith, J.R., Rui, Y. (eds) Image and Video Retrieval. CIVR 2006. Lecture Notes in Computer Science, vol 4071. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11788034_38
Download citation
DOI: https://doi.org/10.1007/11788034_38
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-36018-6
Online ISBN: 978-3-540-36019-3
eBook Packages: Computer ScienceComputer Science (R0)