Salient Region Detection by Jointly Modeling Distinctness and Redundancy of Image Content

  • Yiqun Hu
  • Zhixiang Ren
  • Deepu Rajan
  • Liang-Tien Chia
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6493)


Salient region detection in images is a challenging task, despite its usefulness in many applications. By modeling an image as a collection of clusters, we design a unified clustering framework for salient region detection in this paper. In contrast to existing methods, this framework not only models content distinctness from the intrinsic properties of clusters, but also models content redundancy from the removed content during the retargeting process. The cluster saliency is initialized from both distinctness and redundancy and then propagated among different clusters by applying a clustering assumption between clusters and their saliency. The novel saliency propagation improves the robustness to clustering parameters as well as retargeting errors. The power of the proposed method is carefully verified on a standard dataset of 5000 real images with rectangle annotations as well as a subset with accurate contour annotations.


Gaussian Mixture Model Salient Object Salient Region Saliency Detection Visual Saliency 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Wang, X.J., Ma, W.Y., Li, X.: Data-Driven Approach for Bridging the Cognitive Gap in Image Retrieval. In: Proceedings of the 2004 IEEE International Conference on Multimedia and Expo., Taipei, Taiwan, vol. 3, pp. 2231–2234 (2004)Google Scholar
  2. 2.
    Fu, H., Chi, Z., Feng, D.: Attention-driven Image Interpretation with Application to Image Retrieval. Pattern Recognition 39, 1604–1621 (2006)CrossRefzbMATHGoogle Scholar
  3. 3.
    Chen, L.Q., Xie, X., Fan, X., Ma, W.Y., Zhang, H.J., Zhou, H.Q.: A Visual Attention Model for Adapting Images on Small Displays. ACM Multimedia Systems Journal (9) 353–364Google Scholar
  4. 4.
    Xie, X., Liu, H., Ma, W.Y., Zhang, H.J.: Browsing Large Pictures under Limited Display Sizes. IEEE Transaction on Multimedia 8, 707–715 (2006)CrossRefGoogle Scholar
  5. 5.
    Avidan, S., Shamir, A.: Seam Carving for Content-Aware Image Resizing. ACM Transactions on Graphics (Proceedings SIGGRAPH 2007) 26 (2007)Google Scholar
  6. 6.
    Itti, L., Koch, C., Niebur, E.: A Model of Saliency-Based Visual Attention for Rapid Scene Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 1254–1259 (1998)CrossRefGoogle Scholar
  7. 7.
    Ma, Y.F., Zhang, H.J.: Contrast-based Image Attention Analysis by Using Fuzzy Growing. In: Proceedings of the Eleventh ACM International Conference on Multimedia, New York, NY, USA, pp. 228–241Google Scholar
  8. 8.
    Kadir, T., Brady, M.: Scale, Saliency and Image Description. International Journal of Computer Vision 45, 83–105 (2001)CrossRefzbMATHGoogle Scholar
  9. 9.
    Bruce, N., Tsotsos, J.: Saliency Based on Information Maximization. In: Advances in Neural Information Processing Systems 18Google Scholar
  10. 10.
    Hou, X., Zhang, L.: Dynamic Visual Attention: Searching for Coding Length Increments. In: Advances in Neural Information Processing Systems 21Google Scholar
  11. 11.
    Hou, X., Zhang, L.: Saliency Detection: A Spectral Residual Approach. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, Minnesota, USA (2007)Google Scholar
  12. 12.
    Achanta, R., Estrada, S.H.F., Susstrunk, S.: Frequency-tuned Salient Region Detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Florida, USA (2009)Google Scholar
  13. 13.
    Achanta, R., Susstrunk, S.: Saliency Detection for Content-aware Image Resizing. In: Proceedings of the IEEE Conference on Image Processing, Cairo, Egypt (2009)Google Scholar
  14. 14.
    Hu, Y., Rajan, D., Chia, L.T.: Robust Subspace Analysis for Detecting Visual Attention Regions in Images. In: Proceedings of the Thirteenth ACM International Conference on Multimedia, Singapore, pp. 716–724Google Scholar
  15. 15.
    Harel, J., Koch, C., Perona, P.: Graph-Based Visual Saliency. In: Advances in Neural Information Processing Systems 19Google Scholar
  16. 16.
    Gopalakrishnan, V., Hu, Y., Rajan, D.: Salient Region Detection by Modeling Distributions of Color and Orientation. IEEE Transaction on Multimedia 11, 892–905 (2009)CrossRefGoogle Scholar
  17. 17.
    Torralba, A., Oliva, A., Castelhano, M.S., Henderson, J.M.: Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. Psychological Review 113, 766–786 (2006)CrossRefGoogle Scholar
  18. 18.
    Pritch, Y., Venaki, E.K., Peleg, S.: Shift-Map Image Editing. In: Proceedings of the IEEE International Conference on Computer Vision (2009)Google Scholar
  19. 19.
    Wang, Y.S., Tai, C.L., Sorkine, O., Lee, T.Y.: Optimized Scale-and-Stretch for Image Resizing. ACM Transactions on Graphics (Proceedings of ACM SIGGRAPH ASIA 2008) 27 (December 2008)Google Scholar
  20. 20.
    Liu, T., Sun, J., Zheng, N.N., Tang, X., Shum, H.Y.: Learning to Detect A Salient Object. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, Minnesota, USA (2007)Google Scholar
  21. 21.
    Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum Likelihood from Incomplete Data via The EM Algorithm. Journal of the Royal Statistical Society, Series B 39, 1–38 (1977)MathSciNetzbMATHGoogle Scholar
  22. 22.
    Wang, Z., Li, B.: A Two-stage Approach to Saliency detection. In: ICASSP, Las Vegas, Nevada, U.S.A (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Yiqun Hu
    • 1
  • Zhixiang Ren
    • 1
  • Deepu Rajan
    • 1
  • Liang-Tien Chia
    • 1
  1. 1.School of Computer EngineeringNanyang Technological UniversitySingapore

Personalised recommendations