Abstract
Saliency detection is an essential pre-processing step for intensifying image objects in many computer vision fields. Other than most bottom-up methods, in this paper, we propose a novel saliency model based on high-level image edges and low-level feature contrast. Edges are inherent features for an image, and it can locate the object via a salient selection. With this theory, an accurate object contour is generated after two salient discriminations for edge-contiguous superpixel couples. After position is confirmed, foreground and background of the image can be divided by the contour. With an ingrowth model, we then obtain a foreground (or background) seeds referencing spatial adjacent relation. According to the seed set, a homologous saliency map is computed via a seed-based saliency approach, which is proposed on the basis of affinity matrix. Compared with some pre-existing algorithms, low-level information is utilized purposefully by salient edges in the presented method, which makes the extracted fore regions more precise.
Similar content being viewed by others
References
Achanta R, Estrada F, Wils P, Sűsstrunk S (2008) Salient region detection and segmentation. Int Conf Comput Vis Syst 5008:66–75. doi:10.1007/978-3-540-79547-6_7
Achanta R, Hemami SS, Estrada FJ, Süsstrunk S (2009) Frequency-tuned salient region detection. IEEE Comput Vis Pattern Recognit. doi:10.1109/CVPR.2009.5206596
Achanta R, Shaji A, Smith K, Lucchi A, Fua P, Süsstrunk S (2010) Slic superpixels. Report, EPFL Technical Report no.149300.
Borji A, Cheng M-M, Jiang H, Li J (2015) Salient object detection: a benchmark. IEEE Trans Image Process 24(12):5706–5722. doi:10.1109/TIP.2015.2487833
Chen T, Lin L, Liu L, Luo X, Li X (2016) DISC: deep image saliency computing via progressive representation learning. IEEE Trans Neural Netw Learn Syst 27(6):1135–1149. doi:10.1109/TNNLS.2015.2506664
Cheng M-M, Warrell J, Lin W-Y, Zheng S, Vineet V, Crook N (2013) Efficient salient region detection with soft image abstraction. IEEE Int Conf Comput Vis. doi:10.1109/ICCV.2013.193
Cheng M-M, Mitra NJ, Huang X, Hu S-M (2015) Global contrast based salient region detection. IEEE Trans Pattern Anal Mach Intell 37(3):569–582. doi:10.1109/TPAMI.2014.2345401
Felzenszwalb P, Huttenlocher D (2004) Efficient graph-based image segmentation. Int J Comput Vis 59(2):167–181. doi:10.1023/B:VISI.0000022288.19776.77
Gao H-Y, Lam K-M (2014) Salient object detection using octonion with Bayesian inference. IEEE Int Conf Image Processing. doi:10.1109/ICIP.2014.7025666
Harel J, Koch C, Perona P (2006) Graph-based visual saliency. Advances in Neural Information Processing Systems (9):545–552
Hou X, Zhang L (2007) Saliency detection: a spectral residual approach. IEEE Conf Comput Vis Pattern Recognit. doi:10.1109/CVPR.2007.383267
Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259. doi:10.1109/34.730558
Jiang H, Wang J, Yuan Z, Liu T, Zheng N, Li S (2011) Automatic salient object segmentation based on context and shape prior. British Mach Vis Conf. doi:10.5244/C.25.110
Jiang B, Zhang L, Lu H, Yang C, Yang M-H (2013) Saliency detection via absorbing Markov chain. IEEE Int Conf Comput Vis. doi:10.1109/ICCV.2013.209
Kim J-S, Sim J-Y, Kim C-S (2014) Multiscale Saliency Detection Using Random Walk With Restart. IEEE Trans Circuits Syst Video Technol 24(2):198–210. doi:10.1109/TCSVT.2013.2270366
J. Kim, D. Han, Y-W. Tai, J. Kim (2015) Salient region detection via high-dimensional color transform and local spatial support. IEEE Trans Image Process 25 (1): 9–23. doi:10.1109/TIP.2015.2495122.
Li X, Lu H, Zhang L, Ruan X, Yang M (2013) Saliency detection via dense and sparse reconstruction. IEEE Int Conf Comput Vis. doi:10.1109/ICCV.2013.370
Ma Y-F, Zhang H-J (2003) Contrast-based image attention analysis by using fuzzy growing. ACM Multimedia. doi:10.1145/957013.957094
Ma X, Xie X, Lam K-M, Hu J, Zhong Y (2015) Saliency detection based on singular value decomposition. J Vis Commun Image Represent 32:95–106. doi:10.1016/j.jvcir.2015.08.003
Martin DR, Fowlkes CC, Malik J (2004) Learning to detect natural image boundaries using local brightness, color, and texture cues. IEEE Trans Pattern Anal Mach Intell 26(5):529–549. doi:10.1109/TPAMI.2004.1273918
Murray N, Vanrell M, Otazu X, Parraga CA (2011) Saliency estimation using a non-parametric low-level vision model. IEEE Conf Comput Vis Pattern Recognit. doi:10.1109/CVPR.2011.5995506
Perazzi F, Krahenbuhl P, Pritch Y, Hornung A (2012) Saliency filters: contrast based filtering for salient region detection. IEEE Conf Comput Vis Pattern Recognit. doi:10.1109/CVPR.2012.6247743
Seo HJ, Milanfar P (2009) Static and space-time visual saliency detection by self-resemblance. J Vis 9(12):1–27. doi:10.1167/9.12.15
Sha C, Li X, Shao Q, Wu J (2013) Saliency detection via boundary and center priors. IEEE Int Congr Image Signal Process. doi:10.1109/CISP.2013.6745214
Shen X, Wu Y (2012) A unified approach to salient object detection via low rank matrix recovery. IEEE ComputVis Pattern Recognit. doi:10.1109/CVPR.2012.6247758
Shi Q, Yan L, Xu JJ (2016) Hierarchical image saliency detection on extended CSSD. IEEE Trans Pattern Anal Mach Intell 38(4):717–729. doi:10.1109/TPAMI.2015.2465960
Sun J, Lu H, Liu X (2015) Saliency region detection based on Markov absorption probabilities. IEEE Trans Image Process 24(5):1639–1649. doi:10.1109/TIP.2015.2403241
Tavakoli HR, Rahtu E, Heikkila J (2011) Fast and efficient saliency detection using sparse sampling and kernel density estimation. Scandinavian Conf Image Analysis 6688:666–675. doi:10.1007/978-3-642-21227-7_62
Wang Z, Li B (2008) A two-stage approach to saliency detection in images. Int Conf Acoust Speech Signal Process. doi:10.1109/ICASSP.2008.4517772
Wang Y, Zhao Q (2015) Superpixel tracking via graph-based semi-supervised SVM and supervised saliency detection. IEEE Int Conf Multimedia Expo. doi:10.1109/ICME.2015.7177416
Wang J, Lu H, Li X, Tong N, Liu W (2015) Saliency detection via background and foreground seed selection. Neurocomputing 152:359–368. doi:10.1016/j.neucom.2014.10.056
Xie Y, Lu H (2011) Visual saliency detection based on Bayesian model. IEEE Int Conf Image Process. doi:10.1109/ICIP.2011.6116634
Xie Y, Lu H, Yang M-H (2013) Bayesian saliency via low and mid level cues. IEEE Trans Image Process 22(5):1689–1698. doi:10.1109/TIP.2012.2216276
Yan Q, Xu L, Shi J, Jia J (2013) Hierarchical saliency detection. IEEE ComputVis Pattern Recognit. doi:10.1109/CVPR.2013.153
Yang C, Zhang L, Lu H (2013) Graph-regularized saliency detection with convex-hull-based center prior. IEEE Signal Process Letters 20(7):637–640. doi:10.1109/LSP.2013.2260737
Yuna S, Chang D-Y (2014) Salient object detection based on sparse representation with image-specific prior. IEEE Int Symp Consumer Electron. doi:10.1109/ISCE.2014.6884549
Zhang L, Tong MH, Marks TK, Shan H, Cottrell GW (2008) Sun: a bayesian framework for saliency using natural statistics. J Vis 8(7):1–20. doi:10.1167/8.7.32
Zhang L, Zhao S, Liu W, Lu H (2015) Saliency detection via sparse reconstruction and joint label inference in multiple features. Neurocomputing 155:1–11. doi:10.1016/j.neucom.2014.12.080
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hu, Z., Zhang, Z., Sun, Z. et al. Saliency detection based on salient edges and remarkable discriminating for superpixel pairs. Multimed Tools Appl 77, 5949–5968 (2018). https://doi.org/10.1007/s11042-017-4508-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-017-4508-1