Advertisement

Spherical Center-Surround for Video Saliency Detection Using Sparse Sampling

  • Hamed Rezazadegan Tavakoli
  • Esa Rahtu
  • Janne Heikkilä
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8192)

Abstract

This paper presents a technique for detection of eminent (salient) regions in an image sequence. The method is inspired by the biological studies on human visual attention systems and is grounded on the famous center-surround theory. It hypothesis that an item (center) is dissimilar to its surrounding. A spherical representation is proposed to estimate amount of salience. It enables the method to integrate computation of temporal and spatial contrast features. Efficient computation of the proposed representation is made possible by sparse sampling the surround which result in an efficient spatiotemporal comparison. The method is evaluated against a recent benchmark methods and is shown to outperform all of them.

Keywords

Independent Component Analysis Saliency Detection Visual Saliency Sparse Sampling Spherical Representation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Borji, A., Itti, L.: State-of-the-art in visual attention modeling. IEEE Trans. Pattern Anal. Mach. Intell. 35(1), 185–207 (2012)CrossRefGoogle Scholar
  2. 2.
    Borji, A., Sihite, D.N., Itti, L.: Quantitative analysis of human-model agreement in visual saliency modeling: A comparative study. IEEE Trans. Image Process. 22(1), 55–69 (2013)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Bruce, N.D.B., Tsotsos, J.K.: Saliency, attention, and visual search: An information theoretic approach. J. Vis. 9(3) (2009)Google Scholar
  4. 4.
    Ćulibrk, D., Mirković, M., Zlokolica, V., Pokric, M., Crnojević, V., Kukolj, D.: Salient motion features for video quality assessment. IEEE Trans. Image Process. 20(4), 948–958 (2011)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Elgammal, A., Harwood, D., Davis, L.: Non-parametric model for background subtraction. In: Vernon, D. (ed.) ECCV 2000. LNCS, vol. 1843, pp. 751–767. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  6. 6.
    Gao, D., Mahadevan, V., Vasconcelos, N.: On the plausibility of the discriminant center-surround hypothesis for visual saliency. J. Vis. 8(7) (2008)Google Scholar
  7. 7.
    Itti, L., Dhavale, N.: Realistic avatar eye and head animation using a neurobiological model of visual attention. In: Proc. SPIE, pp. 64–78. SPIE Press (2003)Google Scholar
  8. 8.
    Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20(11), 1254–1259 (1998)CrossRefGoogle Scholar
  9. 9.
    Itti, L., Baldi, P.: Bayesian surprise attracts human attention. Vision Res. 49(10), 1295–1306 (2009)CrossRefGoogle Scholar
  10. 10.
    Judd, T., Durand, F., Torralba, A.: A benchmark of computational models of saliency to predict human fixations. Tech. Rep. MIT-CSAIL-TR-2012-001, Massachusetts institute of technology (2012)Google Scholar
  11. 11.
    Mahadevan, V., Vasconcelos, N.: Spatiotemporal saliency in dynamic scenes. IEEE Trans. Pattern Anal. Mach. Intell. 32(1), 171–177 (2010)CrossRefGoogle Scholar
  12. 12.
    Mancas, M., Riche, N., Leroy, J., Gosselin, B.: Abnormal motion selection in crowds using bottom-up saliency. In: 18th IEEE International Conference on Image Processing, pp. 229–232 (2011)Google Scholar
  13. 13.
    Monnet, A., Mittal, A., Paragios, N., Ramesh, V.: Background modeling and subtraction of dynamic scenes. In: Proc. 9th IEEE International Conference on Computer Vision, vol. 2, pp. 1305–1312 (October 2003)Google Scholar
  14. 14.
    Rahtu, E., Kannala, J., Salo, M., Heikkilä, J.: Segmenting salient objects from images and videos. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part V. LNCS, vol. 6315, pp. 366–379. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  15. 15.
    Rezazadegan Tavakoli, H., Rahtu, E., Heikkilä, J.: Fast and efficient saliency detection using sparse sampling and kernel density estimation. In: Heyden, A., Kahl, F. (eds.) SCIA 2011. LNCS, vol. 6688, pp. 666–675. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  16. 16.
    Riche, N., Mancas, M., Culibrk, D., Crnojevic, V., Gosselin, B., Dutoit, T.: Dynamic saliency models and human attention: A comparative study on videos. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012, Part III. LNCS, vol. 7726, pp. 586–598. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  17. 17.
    Seo, H.J., Milanfar, P.: Static and space-time visual saliency detection by self-resemblance. J. Vis. 9(12), 1–27 (2009)CrossRefGoogle Scholar
  18. 18.
    Tatler, B.: The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor bases and image feature distributions. J. Vis. 14(7), 4, 1-17 (2007)Google Scholar
  19. 19.
    Toet, A.: Computational versus psychophysical bottom-up image saliency: A comparative evaluation study. IEEE Trans. Pattern Anal. Mach. Intell. 33(11), 2131–2146 (2011)CrossRefGoogle Scholar
  20. 20.
    Tsotsos, J.K., Bruce, N.D.B.: Saliency based on information maximization. In: Weiss, Y., Schölkopf, B., Platt, J. (eds.) Advances in Neural Information Processing Systems 18, pp. 155–162. MIT Press (2006)Google Scholar
  21. 21.
    Zhang, L., Tong, M.H., Cottrell, G.W.: Sunday: Saliency using natural statistics for dynamic analysis of scenes. In: Thirty-First Annual Cognitive Science Society Conference (2009)Google Scholar
  22. 22.
    Zhang, L., Tong, M.H., Marks, T.K., Shan, H., Cottrell, G.W.: Sun: A bayesian framework for saliency using natural statistics. J. Vis. 8(7) (2008)Google Scholar
  23. 23.
    Zivkovic, Z., van der Heijden, F.: Efficient adaptive density estimation per image pixel for the task of background subtraction. Pattern Recogn. Lett. 27(7), 773–780 (2006)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Hamed Rezazadegan Tavakoli
    • 1
  • Esa Rahtu
    • 1
  • Janne Heikkilä
    • 1
  1. 1.Center for Machine Vision ResearchUniversity of OuluFinland

Personalised recommendations