Abstract
Object detection is an important problem in computer vision attracting researchers from various domains. It deals with separating objects of interest from their background. Image-related low-level features are used to detect salient objects from images, however these features vary from image to image. There is no single feature that can clearly identify salient objects in all the images. Rather, a linear combination of these features may be useful for detection of salient objects. The computation of optimal weights of these features in a learning algorithm is an NP-Hard problem and requires an approximation of an optimization problem. So in the first phase, three low-level features capturing the edge and color information are extracted from the image. In the second phase, these features are integrated to form the saliency map. The linear weights are used for the combination which guides the dominance of feature(s). Thereafter, a threshold is applied over the saliency map to extract the salient objects. We use a linear weight vector and threshold that play a vital role in increasing the detection accuracy of the model. Identification of these parameters can be mapped to an optimization problem to identify the optimal linear weights best suited for the image. The problem is solved using an improved environmental adaptation method. There are three contributions of the paper. First being the identification of weight vector so that important feature(s) for an image are selected where the salient object is highlighted. The second is posing the salient object detection as an optimization problem with a relevant fitness function. Finally the third is utilization of Environment Adaptation Method (EAM) to solve the optimization problem pointed in the paper. The model is extensively validated over six complex datasets and achieves good results on standard performance measures used in comparison to twenty six related works. Four variants of the optimization algorithm are also presented. The EAM optimizer outperforms the GA, PSO and GWO optimizers.
Similar content being viewed by others
References
Achanta R, Hemamiz S, Estraday F, Susstrunk S (2009) Frequency-tuned Salient Region Detection, Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1597–1604
Achanta R, Susstrunk S (2010) Saliency Detection using Maximum Symmetric Surround, Proceedings in International Conference on Image Processing, pp. 2653–2656
Arya R, Agrawal RK, Singh N (2019) A novel approach for salient object detection using double-density dual-tree complex wavelet transform in conjunction with superpixel segmentation. Knowl Inf Syst 60(1):327–361
Borji A, Cheng MM, Jiang H, Li J (2014) Salient object detection: A survey. arXiv preprint arXiv:1411.5878
Bruce NDB, Tsotsos JK (2006) Saliency Based on Information Maximization. Adv Neural Inf Proces Syst 18:155–162
Fu H, Cao X, Tu Z (2013) Cluster-based co-saliency detection. IEEE Trans Image Process
Goferman S, Zelnik-Manor L, Tal A (2012) Context-aware saliency detection. IEEE Trans Pattern Anal Mach Intell 34:1915–1926
Graefe R, Efenberger W (1996) A novel approach for the detection of vehicles on freeways by real time vision. Intelligent Vehicles 1996:363–368
Han J, Ngan KN, Li MJ, Zhang HJ (2006) Unsupervised extraction of visual attention objects in color images. IEEE Transactions on Circuit Systems and Video Technology 16:141–145
Harel J, Koch C, Perona P (2007) Graph Based Visual Saliency, Proceedings of the Advances in Neural Information and Processing Systems, pp. 545–552
Hou X, Zhang L (2007) Saliency Detection: A Spectral Residual Approach, Proceedings in IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8
İmamoğlu N, Lin W, Fang Y (2013) A saliency detection model using low-level features based on wavelet transform. IEEE Transactions on Multimedia 15:96–105
Itti L (2000) Models of bottom up and top down visual attention. California Institute of Technology, Pasadena
Itti L, Koch C, Niebur E (1998) A model of saliency based visual attention for rapid scene analysis. IEEE Transactions in Pattern Analysis and Machine Intelligence 20:1254–1259
Jiang H, Wang J, Yuan Z, Wu Y, Zheng N, Li S (2013) Salient object detection: a discriminative regional feature integration approach. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2083-2090
Karssemeijer N (2006) Detection of stellate distortions in mammograms. IEEE Trans Med Imaging 15:611–619
Koch C, Ullman S (1985) Shifts in selective visual attention: towards the underlying neural circuitry. Hum Neurobiol 4:219–227
Li Z, Itti L (2011) Saliency and gist features for target detection in satellite images. IEEE Transactions in Image Processing 20:2017–2029
Li G, Yu Y (2016) Deep contrast learning for salient object detection. In proceedings of the IEEE conference on computer vision and pattern recognition (pp. 478-487).
Lin Y, Kong S, Wang D, Zhuang Y (2014) Saliency detection within a deep convolutional architecture. In Workshops at the Twenty-Eighth AAAI Conference on Artificial Intelligence
Liu Z, Shi R, Shen L, Xue Y, Ngan KN, Zhang Z (2012) Unsupervised salient object segmentation based on kernel density estimation and two-phase graph cut. IEEE Transactions on Multimedia 14:1275–1289
Liu T, Yuan Z, Sun-Wang J, Zheng N, Tang X, Shum HY (2011) Learning to detect a salient object. IEEE Trans Pattern Anal Mach Intell 33:353–366
Liu Z, Zou W, Meur OL (2014) Saliency tree: a novel saliency detection framework. IEEE Trans Image Process 23:1937–1952
Meur OL, Callet PL, Barba D, Thoreau D (2006) A coherent computational approach to model bottom up visual attention. IEEE Trans Pattern Anal Mach Intell 28:802–817
Peng P, Shao L, Han J, Han J (2015) Saliency-aware image-to-class distances for image classification. Neurocomputing 166:337–345
Qin Y, Lu H, Xu Y, Wang HE (2015) Saliency detection via cellular automata, in: IEEE Conference on Computer Vision and Pattern Recognition, pp.110–119
Rother C, Bordeaux L, Hamadi Y, Blake A (2006) Autocollage. ACM SIGGRAPH 25:847–852
Santella A, Agrawala M, Decarlo D, Salesin D, Cohen M (2006) Gaze Based Interaction for Semi-Automatic Photo Cropping, Proceedings of Conference Human Factors in Computing Systems, pp. 771–780
Shen X, Wu Y (2012) A Unified Approach to Salient Object Detection via Low Rank Matrix Recovery, Proceedings in IEEE Conference on Computer Vision and Pattern Recognition, pp. 853–860
Singh N, Agrawal RK (2013) Combination of Kullback–Leibler divergence and Manhattan distance measures to detect salient objects. Signal Image and Video Processing 9:427–435. https://doi.org/10.1007/s11760-013-0457-y
Singh N, Arya R, Agrawal RK (2014) A novel approach to combine features for salient object detection using constrained particle swarm optimization. Pattern Recogn 47:1731–1739
Singh N, Arya R, Agrawal RK (2016) A convex hull approach in conjunction with Gaussian mixture model for salient object detection. Digital Signal Processing 55:22–31
Singh N, Arya R, Agrawal RK (2017) A novel position prior using fusion of rule of thirds and image center for salient object detection. Multimed Tools Appl 76(8):10521–10538
Singh N, Arya R, Agrawal RK (2017) Performance enhancement of salient object detection using superpixel based Gaussian mixture model. Multimed Tools Appl:1–19
Singh M, Govil MC, Pilli ES (2018) CHACT: convex Hull enabled active contour technique for salient object detection. IEEE Access 6:22441–22451
Singh M, Govil MC, Pilli ES, Vipparthi SK (2019) SOD-CED: salient object detection for noisy images using convolution encoder–decoder. IET Comput Vis 13(6):578–587
Vikram TN, Tscherepanow M, Wrede B (2012) A saliency map based on sampling an image into random rectangular regions of interest. Pattern Recogn 45:3114–3124
Xie Y, Lu H, Yang M-H (2013) Bayesian saliency via low and mid level cues. IEEE Trans Image Process 22:1689–1698
Yu Z, Wong HS (2007) A rule based technique for extraction of visual attention regions based on real time clustering. IEEE Transactions on Multimedia 9:766–784
Zhang D, Han J, Han J, Shao L (2016) Cosaliency detection based on intrasaliency prior transfer and deep intersaliency mining. IEEE transactions on neural networks and learning systems 27(6):1163–1176
Zhang L, Tong MH, Marks TK, Shan H, Cottrell GW (2008) SUN: a Bayesian framework for saliency using natural statistics. J Vis 8:1–20
Zhang W, Wu QMJ, Wang G, Yin H (2010) An adaptive computational model for salient object detection. IEEE Transactions on Multimedia 12:300–315
Zhao R, Ouyang W, Li H, Wang X (2015) Saliency detection by multi-context deep learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1265–1274
Zhu L, Klein DA, Frintrop S, Cao Z, Cremers AB (2014) A multisize Superpixel approach for salient object detection based on multivariate Normal distribution estimation. IEEE Trans Image Process 23:5094–5107
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Singh, N., Mishra, K.K. & Bhatia, S. SEAM - an improved environmental adaptation method with real parameter coding for salient object detection. Multimed Tools Appl 79, 12995–13010 (2020). https://doi.org/10.1007/s11042-020-08678-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-020-08678-z