Skip to main content
Log in

Saliency detection based on salient edges and remarkable discriminating for superpixel pairs

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Saliency detection is an essential pre-processing step for intensifying image objects in many computer vision fields. Other than most bottom-up methods, in this paper, we propose a novel saliency model based on high-level image edges and low-level feature contrast. Edges are inherent features for an image, and it can locate the object via a salient selection. With this theory, an accurate object contour is generated after two salient discriminations for edge-contiguous superpixel couples. After position is confirmed, foreground and background of the image can be divided by the contour. With an ingrowth model, we then obtain a foreground (or background) seeds referencing spatial adjacent relation. According to the seed set, a homologous saliency map is computed via a seed-based saliency approach, which is proposed on the basis of affinity matrix. Compared with some pre-existing algorithms, low-level information is utilized purposefully by salient edges in the presented method, which makes the extracted fore regions more precise.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Achanta R, Estrada F, Wils P, Sűsstrunk S (2008) Salient region detection and segmentation. Int Conf Comput Vis Syst 5008:66–75. doi:10.1007/978-3-540-79547-6_7

    Google Scholar 

  2. Achanta R, Hemami SS, Estrada FJ, Süsstrunk S (2009) Frequency-tuned salient region detection. IEEE Comput Vis Pattern Recognit. doi:10.1109/CVPR.2009.5206596

    Google Scholar 

  3. Achanta R, Shaji A, Smith K, Lucchi A, Fua P, Süsstrunk S (2010) Slic superpixels. Report, EPFL Technical Report no.149300.

  4. Borji A, Cheng M-M, Jiang H, Li J (2015) Salient object detection: a benchmark. IEEE Trans Image Process 24(12):5706–5722. doi:10.1109/TIP.2015.2487833

    Article  MathSciNet  Google Scholar 

  5. Chen T, Lin L, Liu L, Luo X, Li X (2016) DISC: deep image saliency computing via progressive representation learning. IEEE Trans Neural Netw Learn Syst 27(6):1135–1149. doi:10.1109/TNNLS.2015.2506664

    Article  MathSciNet  Google Scholar 

  6. Cheng M-M, Warrell J, Lin W-Y, Zheng S, Vineet V, Crook N (2013) Efficient salient region detection with soft image abstraction. IEEE Int Conf Comput Vis. doi:10.1109/ICCV.2013.193

    Google Scholar 

  7. Cheng M-M, Mitra NJ, Huang X, Hu S-M (2015) Global contrast based salient region detection. IEEE Trans Pattern Anal Mach Intell 37(3):569–582. doi:10.1109/TPAMI.2014.2345401

    Article  Google Scholar 

  8. Felzenszwalb P, Huttenlocher D (2004) Efficient graph-based image segmentation. Int J Comput Vis 59(2):167–181. doi:10.1023/B:VISI.0000022288.19776.77

    Article  Google Scholar 

  9. Gao H-Y, Lam K-M (2014) Salient object detection using octonion with Bayesian inference. IEEE Int Conf Image Processing. doi:10.1109/ICIP.2014.7025666

    Google Scholar 

  10. Harel J, Koch C, Perona P (2006) Graph-based visual saliency. Advances in Neural Information Processing Systems (9):545–552

  11. Hou X, Zhang L (2007) Saliency detection: a spectral residual approach. IEEE Conf Comput Vis Pattern Recognit. doi:10.1109/CVPR.2007.383267

    Google Scholar 

  12. Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259. doi:10.1109/34.730558

    Article  Google Scholar 

  13. Jiang H, Wang J, Yuan Z, Liu T, Zheng N, Li S (2011) Automatic salient object segmentation based on context and shape prior. British Mach Vis Conf. doi:10.5244/C.25.110

    Google Scholar 

  14. Jiang B, Zhang L, Lu H, Yang C, Yang M-H (2013) Saliency detection via absorbing Markov chain. IEEE Int Conf Comput Vis. doi:10.1109/ICCV.2013.209

    Google Scholar 

  15. Kim J-S, Sim J-Y, Kim C-S (2014) Multiscale Saliency Detection Using Random Walk With Restart. IEEE Trans Circuits Syst Video Technol 24(2):198–210. doi:10.1109/TCSVT.2013.2270366

    Article  Google Scholar 

  16. J. Kim, D. Han, Y-W. Tai, J. Kim (2015) Salient region detection via high-dimensional color transform and local spatial support. IEEE Trans Image Process 25 (1): 9–23. doi:10.1109/TIP.2015.2495122.

  17. Li X, Lu H, Zhang L, Ruan X, Yang M (2013) Saliency detection via dense and sparse reconstruction. IEEE Int Conf Comput Vis. doi:10.1109/ICCV.2013.370

    Google Scholar 

  18. Ma Y-F, Zhang H-J (2003) Contrast-based image attention analysis by using fuzzy growing. ACM Multimedia. doi:10.1145/957013.957094

    Google Scholar 

  19. Ma X, Xie X, Lam K-M, Hu J, Zhong Y (2015) Saliency detection based on singular value decomposition. J Vis Commun Image Represent 32:95–106. doi:10.1016/j.jvcir.2015.08.003

    Article  Google Scholar 

  20. Martin DR, Fowlkes CC, Malik J (2004) Learning to detect natural image boundaries using local brightness, color, and texture cues. IEEE Trans Pattern Anal Mach Intell 26(5):529–549. doi:10.1109/TPAMI.2004.1273918

    Article  Google Scholar 

  21. Murray N, Vanrell M, Otazu X, Parraga CA (2011) Saliency estimation using a non-parametric low-level vision model. IEEE Conf Comput Vis Pattern Recognit. doi:10.1109/CVPR.2011.5995506

    Google Scholar 

  22. Perazzi F, Krahenbuhl P, Pritch Y, Hornung A (2012) Saliency filters: contrast based filtering for salient region detection. IEEE Conf Comput Vis Pattern Recognit. doi:10.1109/CVPR.2012.6247743

    Google Scholar 

  23. Seo HJ, Milanfar P (2009) Static and space-time visual saliency detection by self-resemblance. J Vis 9(12):1–27. doi:10.1167/9.12.15

    Article  Google Scholar 

  24. Sha C, Li X, Shao Q, Wu J (2013) Saliency detection via boundary and center priors. IEEE Int Congr Image Signal Process. doi:10.1109/CISP.2013.6745214

    Google Scholar 

  25. Shen X, Wu Y (2012) A unified approach to salient object detection via low rank matrix recovery. IEEE ComputVis Pattern Recognit. doi:10.1109/CVPR.2012.6247758

    Google Scholar 

  26. Shi Q, Yan L, Xu JJ (2016) Hierarchical image saliency detection on extended CSSD. IEEE Trans Pattern Anal Mach Intell 38(4):717–729. doi:10.1109/TPAMI.2015.2465960

    Article  Google Scholar 

  27. Sun J, Lu H, Liu X (2015) Saliency region detection based on Markov absorption probabilities. IEEE Trans Image Process 24(5):1639–1649. doi:10.1109/TIP.2015.2403241

    Article  MathSciNet  Google Scholar 

  28. Tavakoli HR, Rahtu E, Heikkila J (2011) Fast and efficient saliency detection using sparse sampling and kernel density estimation. Scandinavian Conf Image Analysis 6688:666–675. doi:10.1007/978-3-642-21227-7_62

    Article  Google Scholar 

  29. Wang Z, Li B (2008) A two-stage approach to saliency detection in images. Int Conf Acoust Speech Signal Process. doi:10.1109/ICASSP.2008.4517772

    Google Scholar 

  30. Wang Y, Zhao Q (2015) Superpixel tracking via graph-based semi-supervised SVM and supervised saliency detection. IEEE Int Conf Multimedia Expo. doi:10.1109/ICME.2015.7177416

    Google Scholar 

  31. Wang J, Lu H, Li X, Tong N, Liu W (2015) Saliency detection via background and foreground seed selection. Neurocomputing 152:359–368. doi:10.1016/j.neucom.2014.10.056

    Article  Google Scholar 

  32. Xie Y, Lu H (2011) Visual saliency detection based on Bayesian model. IEEE Int Conf Image Process. doi:10.1109/ICIP.2011.6116634

    Google Scholar 

  33. Xie Y, Lu H, Yang M-H (2013) Bayesian saliency via low and mid level cues. IEEE Trans Image Process 22(5):1689–1698. doi:10.1109/TIP.2012.2216276

    Article  MathSciNet  MATH  Google Scholar 

  34. Yan Q, Xu L, Shi J, Jia J (2013) Hierarchical saliency detection. IEEE ComputVis Pattern Recognit. doi:10.1109/CVPR.2013.153

    Google Scholar 

  35. Yang C, Zhang L, Lu H (2013) Graph-regularized saliency detection with convex-hull-based center prior. IEEE Signal Process Letters 20(7):637–640. doi:10.1109/LSP.2013.2260737

    Article  Google Scholar 

  36. Yuna S, Chang D-Y (2014) Salient object detection based on sparse representation with image-specific prior. IEEE Int Symp Consumer Electron. doi:10.1109/ISCE.2014.6884549

    Google Scholar 

  37. Zhang L, Tong MH, Marks TK, Shan H, Cottrell GW (2008) Sun: a bayesian framework for saliency using natural statistics. J Vis 8(7):1–20. doi:10.1167/8.7.32

    Article  Google Scholar 

  38. Zhang L, Zhao S, Liu W, Lu H (2015) Saliency detection via sparse reconstruction and joint label inference in multiple features. Neurocomputing 155:1–11. doi:10.1016/j.neucom.2014.12.080

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhenbin Zhang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hu, Z., Zhang, Z., Sun, Z. et al. Saliency detection based on salient edges and remarkable discriminating for superpixel pairs. Multimed Tools Appl 77, 5949–5968 (2018). https://doi.org/10.1007/s11042-017-4508-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-4508-1

Keywords

Navigation