What Is the Chance of Happening: A New Way to Predict Where People Look

  • Yezhou Yang
  • Mingli Song
  • Na Li
  • Jiajun Bu
  • Chun Chen
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6315)


Visual attention is an important issue in image and video analysis and keeps being an open problem in the computer vision field. Motivated by the famous Helmholtz principle, a new approach of visual attention analysis is proposed in this paper based on the low level feature statistics of natural images and the Bayesian framework. Firstly, two priors, i.e., Surrounding Feature Prior (SFP) and Single Feature Probability Distribution (SFPD) are learned and integrated by a Bayesian framework to compute the chance of happening (CoH) of each pixel in an image. Then another prior, i.e., Center Bias Prior (CBP), is learned and applied to the CoH to compute the saliency map of the image. The experimental results demonstrate that the proposed approach is both effective and efficient by providing more accurate and quick visual attention location. We make three major contributions in this paper: (1) A set of simple but powerful priors, SFP, SFPD and CBP, are presented in an intuitive way; (2) A computational model of CoH based on Bayesian framework is given to integrate SFP and SFPD together; (3) A computationally plausible way to obtain the saliency map of natural images based on CoH and CBP.


Visual Attention Human Visual System Natural Image Bayesian Framework Independent Component Analysis 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Tsotsos, J.: Analyzing vision at the complexity level. Behavioral and Brain Sciences 13, 423–445 (1990)Google Scholar
  2. 2.
    Wolfe, J.M., Cave, K.: Deploying visual attention: The guided search model. John Wiley and Sons Ltd., Chichester (1990)Google Scholar
  3. 3.
    Tsotsos, J.K., Culhane, S.M., Wai, W.: Modeling visual attention via selective tuning. Artificial Intelligence 78, 507–545 (1995)CrossRefGoogle Scholar
  4. 4.
    Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. on Pattern Analysis and Machine Intelligence (1998)Google Scholar
  5. 5.
    Itti, L., Koch, C.: A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research 40, 1489–1506 (2000)CrossRefGoogle Scholar
  6. 6.
    Yang, Y., Song, M., Li, N., Bu, J., Chen, C.: Visual attention analysis by pseudo gravitational field. ACM Multimedia, 553–556 (2009)Google Scholar
  7. 7.
    Judd, T., Ehinger, K., Durand, F., Torralba, A.: Learning to predict where humans look. In: International Conference on Computer Vision, Acceptance (2009)Google Scholar
  8. 8.
    Koch, C., Ullman, S.: Shifts in selective visual attention: towards the underlying neural circuitry. Human Neurobiology 4, 219–227 (1985)Google Scholar
  9. 9.
    Bruce, N.D.B.: Features that draw visual attention: An information theoretic perspective. Neurocomputing 65-66, 125–133 (2005)CrossRefGoogle Scholar
  10. 10.
    Bruce, N.D.B., Tsotsos, J.K.: Saliency based on information maximization. Advances in Neural Information Processing Systems 18, 155–162 (2006)Google Scholar
  11. 11.
    Itti, L., Baldi, P.: Bayesian surprise attracts human attention. Advances in neural information processing systems 19, 547–554 (2006)Google Scholar
  12. 12.
    Zhang, L., Tong, M.H., Marks, T.K., Shan, H., Cottrell, G.W.: Sun: A bayesian framework for saliency using natural statistics. Journal of Vision 8, 1–20 (2008)Google Scholar
  13. 13.
    Bruce, N.D.B., Tsotsos, J.K.: Saliency, attention, and visual search: An information theoretic approach. Journal of Vision 9(3), 1–24Google Scholar
  14. 14.
    Meur, O.L., Callet, P.L., Barba, D., Thoreau, D.: A coherent computational approach to model bottom-up visual attention. IEEE Trans on Pattern Analysis and Machine Intelligence 28, 802–816 (2006)CrossRefGoogle Scholar
  15. 15.
    Desolneux, A., Moisan, L., Morel, J.: From Gestalt Theory to Image Analysis, A Probabilistic Approach. Springer Science and Business Media, Heidelberg (2008)CrossRefGoogle Scholar
  16. 16.
    Liu, H., Jiang, S., Huang, Q., Xu, C., Gao, W.: Region-based visual attention analysis with its application in image browsing on small displays. ACM Multimedia (2007)Google Scholar
  17. 17.
    Zhai, G., Chen, Q., Yang, X., Zhang, W.: Scalable visual sensitivity profile estimation. In: ICASSP, pp. 876–879 (2008)Google Scholar
  18. 18.
    de Wouwer, G.V., Scheunders, P., Dyck, D.V.: Statistical texture characterization from discrete wavelet representations. IEE Trans. Image Processing 8, 592–598 (1999)CrossRefGoogle Scholar
  19. 19.
    Poor, H.V.: An Introduction to Signal Estimation and Detection, 2nd edn. Springer, Heidelberg (1994)zbMATHGoogle Scholar
  20. 20.
    Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 511–518 (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Yezhou Yang
    • 1
  • Mingli Song
    • 1
  • Na Li
    • 1
  • Jiajun Bu
    • 1
  • Chun Chen
    • 1
  1. 1.Zhejiang UniversityHangzhouChina

Personalised recommendations