Multimedia Tools and Applications

, Volume 76, Issue 8, pp 10521–10538 | Cite as

A novel position prior using fusion of rule of thirds and image center for salient object detection

Article

Abstract

Salient object detection is one of the challenging problems in the field of computer vision. Most of the models use a center prior to detect salient objects. They give more weightage to the objects which are present near the center of the image and less weightage to the ones near the corners of the image. But there may be images in which object is placed near the image corner. In order to handle such situation, we propose a position prior based on the combined effect of the rule of thirds and the image center. In this paper, we first segment the image into an optimal number of clusters using Davies-Bouldin index. Then the pixels in these clusters are used as samples to build the Gaussian mixture model whose parameters are refined using Expectation-Maximization algorithm. Thereafter the spatial saliency of the clusters is computed based on the proposed position prior and then combined into a saliency map. The performance is evaluated both qualitatively and quantitatively on six publicly available datasets. Experimental results demonstrate that the proposed model outperforms the seventeen existing state-of-the-art methods in terms of F –measure and area under curve on all the six datasets.

Keywords

Salient object detection Cluster validation Gaussian mixture model Expectation maximization Rule of thirds Spatial saliency 

Notes

Acknowledgments

The authors are indebted to the reviewers for their constructive suggestions which significantly helped in improving the quality of this paper.

References

  1. 1.
    Achanta R, Susstrunk S (2010) Saliency detection using maximum symmetric surround, proceedings in international conference on image processing, pp. 2653–2656Google Scholar
  2. 2.
    Achanta R, Hemamiz S, Estraday F, Susstrunk S (2009) Frequency-tuned Salient Region Detection, Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1597–1604Google Scholar
  3. 3.
    Alexe B, Deselaers T, Ferrari V (2012) Measuring the objectness of image windows. IEEE Trans Pattern Anal Mach Intell 34(11):2189–2202CrossRefGoogle Scholar
  4. 4.
    Amit Y (2002) 2D target detection and recognition, models, algorithms and networks. MIT Press, CambridgeGoogle Scholar
  5. 5.
    Arya R, Singh N, Agrawal RK (2015) A novel hybrid approach for salient object detection using local and global saliency in frequency domain. Multimedia Tools Appl. doi: 10.1007/s11042-015-2750-y Google Scholar
  6. 6.
    Borji A, Itti L (2013) State-of-the-art in visual attention modeling. IEEE Trans Pattern Anal Mach Intell 35:185–207CrossRefGoogle Scholar
  7. 7.
    Borji A, Sihite DN, Itti L (2012) Salient object detection: a benchmark. ECCV 414–429Google Scholar
  8. 8.
    Borji A, Cheng MM, Jiang H, Li J (2014) Salient object detection: A survey. arXiv preprint arXiv:1411.5878Google Scholar
  9. 9.
    Bruce NDB, Tsotsos JK (2006) Saliency based on information maximization. Advances in Neural Information and Processing Systems 18:155–162Google Scholar
  10. 10.
    Cheng MM, Warrell J, Lin WY, Zheng S, Vineet V, Crook N (2013) Efficient salient region detection with soft image abstraction. In Proceedings of the IEEE International Conference on Computer Vision 1529–1536Google Scholar
  11. 11.
    Cheng M-M, Mitra NJ, Huang X, Torr PHS, Hu S-M (2014) Global contrast based salient region detection. IEEE TPAMI (CVPR 2011)Google Scholar
  12. 12.
    Cheng MM, Zhang Z, Lin WY, Torr P, BING (2014) Binarized normed gradients for objectness estimation at 300fps. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 3286–3293Google Scholar
  13. 13.
    Davies DL, DW B (1979) A cluster separation measure. IEEE Trans Pattern Anal Mach Intell 1:224–227CrossRefGoogle Scholar
  14. 14.
    Frintrop S, Rome E, Christensen HI (2010) Computational visual attention systems and their cognitive foundation: a survey. ACM Trans Appl Percept 7:1–39CrossRefGoogle Scholar
  15. 15.
    Fu H, Cao X, Tu Z (2013) Cluster-based Co-saliency detection. IEEE Transactions on Image ProcessingGoogle Scholar
  16. 16.
    Gasparini F, Corchs S, Schettini R (2007) Low quality image enhancement using visual attention. Opt Eng 46:40502-(1–3)CrossRefGoogle Scholar
  17. 17.
    Goferman S, Zelnik-Manor L, Tal A (2012) Context-aware saliency detection. IEEE Trans Pattern Anal Mach Intell 34:1915–1926CrossRefGoogle Scholar
  18. 18.
    Gonzalez RC, Woods RE (2002) Digital image processing. Prentice-Hall IncGoogle Scholar
  19. 19.
    Graefe R, Efenberger W (1996) A novel approach for the detection of vehicles on freeways by real time vision. In Intelligent Vehicles 363–368Google Scholar
  20. 20.
    Halkidi M, Batistakis Y, Vazirgiannis M (2001) On cluster validation techniques. J Intell Inf Syst 17:107–145CrossRefMATHGoogle Scholar
  21. 21.
    Han J, Zhang D, Hu X, Guo L, Ren J, Wu F (2014) Background prior based salient object detection via deep reconstruction residual. IEEE Trans Circuits Syst Video TechnolGoogle Scholar
  22. 22.
    Harel J, Koch C, Perona P (2007) Graph based visual saliency, proceedings of the advances in neural information and processing systems, pp. 545–552 Multimed Tools ApplGoogle Scholar
  23. 23.
    X. Hou, Zhang L (2007) Saliency detection: a spectral residual approach, proceedings in ieee conference on computer vision and pattern recognition, pp. 1‑8Google Scholar
  24. 24.
    İmamoğlu N, Lin W, Fang Y (2013) A saliency detection model using low-level features based on wavelet transform. IEEE Trans Multimedia 15:96–105CrossRefGoogle Scholar
  25. 25.
    Itti L (2000) Models of bottom up and top down visual attention. California Institute of Technology, PasadenaGoogle Scholar
  26. 26.
    Itti L, Koch C, Niebur E (1998) A model of saliency based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20:1254–1259CrossRefGoogle Scholar
  27. 27.
    Jiang H, Wang J, Yuan Z, Wu Y, Zheng N, Li S (2013) Salient object detection: a discriminative regional feature integration approach. IEEE CVPR 2083–2090Google Scholar
  28. 28.
    Karssemeijer N (2006) Detection of stellate distortions in mammograms. IEEE Trans Med Imaging 15:611–619CrossRefGoogle Scholar
  29. 29.
    Li Z, Itti L (2011) Saliency and gist features for target detection in satellite images. IEEE Trans Image Process 20:2017–2029MathSciNetCrossRefGoogle Scholar
  30. 30.
    Li X, Lu H, Zhang L, Ruan X (2013) M.-H. Yang, Saliency detection via dense and sparse reconstruction. ICCVGoogle Scholar
  31. 31.
    Liu T, Yuan Z, Sun-Wang J, Zheng N, Tang X, Shum HY (2007) Learning to detect a salient object, IEEE Conference on Computer Vision and Pattern Recognition 1–8Google Scholar
  32. 32.
    Liu Z, Zou W, Meur OL (2014) Saliency tree: a novel saliency detection framework. IEEE Trans Image Process 23:1937–1952MathSciNetCrossRefGoogle Scholar
  33. 33.
    Mai L, Le H, Niu Y, Liu F (2011) Rule of thirds detection from photograph. IEEE Int Symp Multimedia 91–96Google Scholar
  34. 34.
    Qi W, Cheng MM, Borji A, Lu H, Bai LF (2015) SaliencyRank: two-stage manifold ranking for salient object detection. Comput Vis Media 1(4):309–320CrossRefGoogle Scholar
  35. 35.
    Ren Z, Hu Y, Chia L, Rajan D (2010) Improved saliency detection based on superpixel clustering and saliency propagation. In ACM-MMGoogle Scholar
  36. 36.
    Rother C, Bordeaux L, Hamadi Y, Blake A (2006) Autocollage. ACM SIGGRAPH 25:847–852CrossRefGoogle Scholar
  37. 37.
    Santella A, Agrawala M, Decarlo D, Salesin D, Cohen M (2006) Gaze based interaction for semi automatic photo cropping, proceedings of conference human factors in computing systems, pp. 771–780Google Scholar
  38. 38.
    Shen X, Wu Y (2012) A unified approach to salient object detection via low rank matrix recovery, Proceedings in IEEE Conference on Computer Vision and Pattern Recognition, pp. 853–860Google Scholar
  39. 39.
    Singh N, Agrawal RK (2013) Combination of Kullback–Leibler divergence and Manhattan distance measures to detect salient objects. SIViP. doi: 10.1007/s11760-013-0457-y Google Scholar
  40. 40.
    Singh N, Arya R, Agrawal RK (2014) A novel approach to combine features for salient object detection using constrained particle swarm optimization. Pattern Recogn 47:1731–1739CrossRefGoogle Scholar
  41. 41.
    Uijlings JR, van de Sande KE, Gevers T, Smeulders AW (2013) Selective search for object recognition. Int J Comput Vis 104(2):154–171CrossRefGoogle Scholar
  42. 42.
    Vikram TN, Tscherepanow M, Wrede B (2012) A saliency map based on sampling an image into random rectangular regions of interest. Pattern Recogn 45:3114–3124CrossRefGoogle Scholar
  43. 43.
    Wei Y, Wen F, Zhu W, Sun J (2012) Geodesic saliency using background priors. In Comput Vision–ECCV 29–42Google Scholar
  44. 44.
    Zhang L, Tong MH, Marks TK, Shan H, Cottrell GW (2008) SUN: a Bayesian framework for saliency using natural statistics. J Vis 8:1–20Google Scholar
  45. 45.
    Zhang D, Han J, Li C, Wang J (2015) Co-saliency detection via looking deep and wide. In CVPRGoogle Scholar
  46. 46.
    Zhu W, Liang S, Wei Y, Sun J (2014) Saliency optimization from robust background detection. In: IEEE Conference on Computer Vision and Pattern Recognition. pp 2814–2821Google Scholar
  47. 47.
    Zhu L, Klein DA, Frintrop S, Cao Z, Cremers AB (2014) AMultisize superpixel approach for salient object detection based on multivariate normal distribution estimation. IEEE Trans Image Process 23:5094–5107MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  1. 1.School of Computer and Systems SciencesJawaharlal Nehru UniversityNew DelhiIndia
  2. 2.National Institute of TechnologyPauri (Garhwal)India

Personalised recommendations