Skip to main content

Improving Scene Recognition through Visual Attention

  • Conference paper
Pattern Recognition and Image Analysis (IbPRIA 2009)

Abstract

In this paper we study how the use of a novel model of bottom-up saliency (visual attention), based on local energy and color, can significantly accelerate scene recognition and, at the same time, preserve the recognition performance. To do so, we use a mobile robot-like application where scene recognition is performed through the use of SIFT features to characterize the different scenarios, and the Nearest Neighbor rule to carry out the classification. Experimental work shows that important reductions in the size of the database of prototypes can be achieved (17.6% of the original size) without significant losses in recognition performance (from 98.5% to 96.1%), thus accelerating the classification task.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Treisman, A., Gelade, G.: A feature integration theory of attention. Cognitive Psychologhy 12, 97–136 (1980)

    Article  Google Scholar 

  2. Koch, C., Ullman, S.: Shifts in selective visual attention: towards the underlying neural circuitry. Human Neurobiology 4(4), 219–227 (1985)

    Google Scholar 

  3. García-Díaz, A., Fdez-Vidal, X.R., Dosil, R., Pardo, X.M.: Local Energy Variability as a Generic Measure of Bottom-Up Salience. In: Yin, P.-Y. (ed.) Pattern Recognition Techniques, Technology and Applications, In-Teh, Vienna, ch. 1, pp. 1–24 (2008)

    Google Scholar 

  4. Itti, L., Koch, C.: A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research 40, 1489–1506 (2000)

    Article  Google Scholar 

  5. Milanese, R., Gil, S., Pun, T.: Attentive mechanisms for dynamic and static scene analysis. Optical Engineering 34(8), 2428–2434 (1995)

    Article  Google Scholar 

  6. Bonaiuto, J.J., Itti, L.: Combining attention and recognition for rapid scene analysis. In: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), vol. (III)90, p. 90 (2005)

    Google Scholar 

  7. Walther, D., Rutishauser, U., Koch, C., Perona, P.: Selective visual attention enables learning and recognition of multiple objects in cluttered scenes. Computer Vision and Image Understanding (100), 1–63 (2005)

    Article  Google Scholar 

  8. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)

    Article  Google Scholar 

  9. Field, D.J.: Relations Between the Statistics of Natural Images and the Response Properties of Cortical Cells. Journal of the Optical Society of America A 4(12), 2379–2394 (1987)

    Article  Google Scholar 

  10. Kovesi, P.: Invariant Measures of Image Features from Phase Information. Ph.D. Thesis, The University or Western Australia (1996)

    Google Scholar 

  11. Morrone, M.C., Burr, D.C.: Feature Detection in Human Vision: A Phase-Dependent Energy Model. Proceedings of the Royal Society of London B 235, 221–245 (1988)

    Article  Google Scholar 

  12. Zetzsche, C.: Natural Scene Statistics and Salient Visual Features. In: Itti, L., Rees, G., Tsotsos, J.K. (eds.) Neurobiology of Attention, ch. 37, pp. 226–232. Elsevier Academia Press, Amsterdam (2005)

    Chapter  Google Scholar 

  13. Vinje, W.E., Gallant, J.L.: Sparse coding and decorrelation in primary visual cortex during natural vision. Science 287, 1273–1276 (2000)

    Article  Google Scholar 

  14. Weliky, M., Fiser, J., Hunt, R.H., Wagner, D.N.: Coding of natural scenes in primary visual cortex. Neuron 37, 703–718 (2003)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

López-García, F., García-Díaz, A., Fdez-Vidal, X.R., Pardo, X.M., Dosil, R., Luna, D. (2009). Improving Scene Recognition through Visual Attention. In: Araujo, H., Mendonça, A.M., Pinho, A.J., Torres, M.I. (eds) Pattern Recognition and Image Analysis. IbPRIA 2009. Lecture Notes in Computer Science, vol 5524. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02172-5_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-02172-5_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-02171-8

  • Online ISBN: 978-3-642-02172-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics