Semantic Scene Classification for Image Annotation and Retrieval
We describe an annotation and retrieval framework that uses a semantic image representation by contextual modeling of images using occurrence probabilities of concepts and objects. First, images are segmented into regions using clustering of color features and line structures. Next, each image is modeled using the histogram of the types of its regions, and Bayesian classifiers are used to obtain the occurrence probabilities of concepts and objects using these histograms. Given the observation that a single class with the highest probability is not sufficient to model image content in an unconstrained data set with a large number of semantically overlapping classes, we use the concept/object probabilities as a new representation, and perform retrieval in the semantic space for further improvement of the categorization accuracy. Experiments on the TRECVID and Corel data sets show good performance.
KeywordsLine Segment Contextual Modeling Image Annotation Semantic Space Probabilistic Latent Semantic Analysis
- 3.van Gemert, J.C., Geusebroek, J., Veenman, C.J., Snoek, C.G.M., Smeulders, A.W.M.: Robust scene categorization by learning image statistics in context. In: CVPR (2006)Google Scholar
- 5.Li, Y., Shapiro, L.G., Bilmes, J.A.: A generative/discriminative learning algorithm for image classification. In: ICCV (2005)Google Scholar
- 7.Li, Y., Shapiro, L.G.: Consistent line clusters for building recognition in CBIR. In: ICPR (2002)Google Scholar
- 9.Gokalp, D., Aksoy, S.: Scene classification using bag-of-regions representations. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Beyond Patches Workshop, Minneapolis, Minnesota, June 23 (2007)Google Scholar
- 10.Tax, D.M.J.: One-Class Classification. PhD thesis, Delft University of Technology, Delft, The Netherlands (2001)Google Scholar