Abstract
In this paper, we propose a novel query language for video indexing and retrieval that (1) enables to make queries both at the image level and at the semantic level (2) enables the users to define their own scenarios based on semantic events and (3) retrieves videos with both exact matching and similarity matching. For a query language, four main issues must be addressed: data modeling, query formulation, query parsing and query matching. In this paper we focus and give contributions on data modeling, query formulation and query matching. We are currently using color histograms and SIFT features at the image level and 10 types of events at the semantic level. We have tested the proposed query language for the retrieval of surveillance videos of a metro station. In our experiments the database contains more than 200 indexed physical objects and 48 semantic events. The results using different types of queries are promising.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)
Müller, H., Marchand-Maillet, S., Pun, T.: The truth about corel - evaluation in image retrieval. In: Lew, M.S., Sebe, N., Eakins, J.P. (eds.) CIVR 2002. LNCS, vol. 2383, pp. 28–49. Springer, Heidelberg (2002)
Saykol, E., Güdükbay, U., Ulusoy, O.: A database model for querying visual surveillance by integrating semantic and low-level features. In: Candan, K.S., Celentano, A. (eds.) MIS 2005. LNCS, vol. 3665, pp. 163–176. Springer, Heidelberg (2005)
Swain, M.J., Ballard, D.H.: Color indexing. International Journal of Computer Vision 7(1), 11–32 (1991)
Vu, V.T., Brémond, F., Thonnat, M.: Automatic video interpretation: A novel algorithm for temporal scenario recognition. In: International Joint Conference on Artificial Intelligence (IJCAI 2003), Acapulco, Mexico, August 9-15, 2003, pp. 1295–1302 (2003)
Durak, N., Yazici, A., George, R.: Online Surveillance Video Archive System. In: Proc. of International Multimedia Modeling Conference, Singapore, pp. 376–385 (January 2007)
Hampapur, A., Brown, L., Connell, J., Ekin, A., Haas, N., Lu, M., Merki, H., Pankanti, S., Senior, A., Shu, C., Tian, Y.L.: Smart Video Surveillance: Exploring the concept of multiscale spatiotemporal tracking. IEEE Signal Processing Magazine 22(2), 38–51 (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Le, TL., Thonnat, M., Boucher, A., Brémond, F. (2008). A Query Language Combining Object Features and Semantic Events for Surveillance Video Retrieval. In: Satoh, S., Nack, F., Etoh, M. (eds) Advances in Multimedia Modeling. MMM 2008. Lecture Notes in Computer Science, vol 4903. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-77409-9_29
Download citation
DOI: https://doi.org/10.1007/978-3-540-77409-9_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-77407-5
Online ISBN: 978-3-540-77409-9
eBook Packages: Computer ScienceComputer Science (R0)