Can Geotags Help Image Recognition?

  • Keita Yaegashi
  • Keiji Yanai
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5414)


In this paper, we propose to exploit geotags as additional information for visual recognition of consumer photos to improve its performance. Geotags, which represent places where the photos were taken, for photos can be obtained automatically by carrying a portable small GPS device with digital cameras. Geotags have potential to improve performance of visual image recognition, since recognition targets are unevenly distributed. For example, “beach” photos can be taken near the sea and “lion” photos can be taken only in a zoo except Africa.

To integrate geotag information into visual image recognition, we adopt two types of geographical information, raw values of latitude and longitude, and visual feature of aerial photos around the location the geotag represents. As classifiers, we use both a discriminative method and a generative method in the experiments.

The objective of this paper is to examine if geotags can help category-level image recognition. Note that we define an image recognition problem as deciding if an image is associated with a certain given concept such as “mountain” and “beach” in this paper. We propose a novel method to carry out geotagged image recognition in this paper. The experimental results demonstrate effectiveness of usage of geographical information for recognition of consumer photos.


Support Vector Machine Aerial Photo Visual Feature Latent Dirichlet Allocation Scale Invariant Feature Transform 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Blei, D., Ng, A., Jordan, M.: Latent dirichlet allocation. Journal of Machine Learning Research 3, 993–1022 (2003)zbMATHGoogle Scholar
  2. 2.
    Csurka, G., Bray, C., Dance, C., Fan, L.: Visual categorization with bags of keypoints. In: Proc. of ECCV Workshop on Statistical Learning in Computer Vision, pp. 59–74 (2004)Google Scholar
  3. 3.
    Fei-Fei, L., Perona, P.: A bayesian hierarchical model for learning natural scene categories. In: Proc. of IEEE Computer Vision and Pattern Recognition, pp. 524–531 (2005)Google Scholar
  4. 4.
    Hofmann, T.: Unsupervised learning by probabilistic latent semantic analysis. Machine Learning 43, 177–196 (2001)CrossRefzbMATHGoogle Scholar
  5. 5.
    Kennedy, L., Naaman, M.: Generating diverse and representative image search results for landmarks. In: Proc. of the International World Wide Web Conference, pp. 297–306 (2008)Google Scholar
  6. 6.
    Lillesand, T.M., Kiefer, R.W., Chipman, J.W.: Remote sensing and image interpretation. John Wiley, Chichester (2004)Google Scholar
  7. 7.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)CrossRefGoogle Scholar
  8. 8.
    Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(10), 1615–1630 (2005)CrossRefGoogle Scholar
  9. 9.
    Monay, F., Gatica-Perez, D.: Modeling semantic aspects for cross-media image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(10), 1802–1817 (2007)CrossRefGoogle Scholar
  10. 10.
    Sivic, J., Russell, B.C., Efros, A.A., Zisserman, A., Freeman, W.T.: Discovering objects and their localization in images. In: Proc. of IEEE International Conference on Computer Vision, pp. 370–377 (2005)Google Scholar
  11. 11.
    Snavely, N., Seitz, S., Szeliski, R.: Photo tourism: exploring photo collections in 3d. ACM Transactions on Graphics (TOG) 25(3), 835–846 (2006)CrossRefGoogle Scholar
  12. 12.
    Varma, M., Ray, D.: Learning the discriminative power-invariance trade-off. In: Proc. of IEEE International Conference on Computer Vision, pp. 1150–1157 (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Keita Yaegashi
    • 1
  • Keiji Yanai
    • 1
  1. 1.Department of Computer ScienceThe University of Electro-CommunicationsTokyoJapan

Personalised recommendations