Abstract
It is important to integrate contextual information in order to improve the inaccurate results of current approaches for automatic image annotation. Graph based representations allow incorporation of such information. However, their behaviour has not been studied in this context. We conduct extensive experiments to show the properties of such representations using semantic relationships as a type of contextual information. We also experimented with different similarity measures for semantic features and results are presented.
The research leading to this paper was supported by European Commission under contracts FP6-027026(K-Space) and FP6-027122(Salero).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE TPAMI 22(12), 1349–1380 (2000)
Smeaton, A.F., Over, P., Kraaij, W.: Evaluation campaigns and trecvid. In: MIR 2006, Santa Barbara, CA, USA, pp. 321–330. ACM Press, New York (2006)
Wang, Y., Gong, S.: Refining image annotation using contextual relations between words. In: CIVR, Amsterdam, The Netherlands, ACM, pp. 425–432 (2007)
Pan, J.Y., Yang, H.J., Faloutsos, C., Duygulu, P.: Gcap: Graph-based automatic image captioning. In: CVPRW 2004, vol. 9, p. 146. IEEE Computer Society Press, Los Alamitos (2004)
Urban, J., Jose, J.M.: Adaptive image retrieval using a graph model for semantic feature integration. In: MIR 2006, Santa Barbara, CA, USA, pp. 117–126. ACM Press, New York (2006)
Lova’sz, L.: Random walks on graphs: A survey. In: Combinatronics Bolyai Society for Mathematical Studies, Budapest, vol. 2, pp. 353–397 (1996)
Cilibrasi, R., Vitanyi, P.M.: Automatic meaning discovery using google. In: Hutter, M., Merkle, W., Vitanyi, P.M. (eds.) Kolmogorov Complexity and Applications. Number 06051 in Dagstuhl Seminar Proceedings, Schloss Dagstuhl, Germany, IBFI (2006)
Baeza-Yates, R., Ribeiro-Neto, B.: Modern Information Retrieval. Addison Wesley, Reading (1999)
Duygulu, P., Barnard, K., de Freitas, J.F.G., Forsyth, D.A.: Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 97–112. Springer, Heidelberg (2002)
Yavlinsky, A., Schofield, E.J., Rüger, S.: Automated image annotation using global features and robust nonparametric density estimation. In: Leow, W.-K., Lew, M., Chua, T.-S., Ma, W.-Y., Chaisorn, L., Bakker, E.M. (eds.) CIVR 2005. LNCS, vol. 3568, pp. 507–517. Springer, Heidelberg (2005)
Jeon, J., Lavrenko, V., Manmatha, R.: Automatic image annotation and retrieval using cross-media relevance models. In: SIGIR 2003, Toronto, Canada, pp. 119–126. ACM Press, New York (2003)
Barnard, K., Duygulu, P., Forsyth, D., de Freitas, N., Blei, D.M., Jordan, M.I.: Matching words and pictures. JMLR 3, 1107–1135 (2003)
Page, L., Brin, S., Motwani, R., Winograd, T.: The pagerank citation ranking: Bringing order to the web. Technical report, Stanford Digital Library Technologies Project (1998), http://dbpubs.stanford.edu:8090/pub/1999-66
Kemeny, J.G., Snell, J.L.: Finite Markov Chains. Springer, New York (1960)
Gallager, R.G.: Discrete Stochastic Processes. Kluwer Academic, Boston (1996)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Stathopoulos, V., Urban, J., Jose, J. (2008). Semantic Relationships in Multi-modal Graphs for Automatic Image Annotation. In: Macdonald, C., Ounis, I., Plachouras, V., Ruthven, I., White, R.W. (eds) Advances in Information Retrieval. ECIR 2008. Lecture Notes in Computer Science, vol 4956. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78646-7_47
Download citation
DOI: https://doi.org/10.1007/978-3-540-78646-7_47
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-78645-0
Online ISBN: 978-3-540-78646-7
eBook Packages: Computer ScienceComputer Science (R0)