Co-saliency Detection Based on Siamese Network

  • Zhengchao Lei
  • Weiyan Chai
  • Sanyuan Zhao
  • Hongmei Song
  • Fengxia Li
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 747)


Saliency detection in images attracts much research attention for its usage in numerous multimedia applications. Beside on the detection within the single image, co-saliency has been developed rapidly by detecting the same foreground objects in different images and trying to further promote the performance of object detection. This paper we propose a co-saliency detection method based on Siamese Network. By using Siamese Network, we get the similarity matrix of each image in superpixels. Guided by the single image saliency map, each saliency value, saliency score matrix is obtained to generate the multi image saliency map. Our final saliency map is a linear combination of these two saliency maps. The experiments show that our method performs better than other state-of-arts methods.


Co-saliency detection Siamese network Feature extraction 


  1. 1.
    Ma, Y., Zhang, H.: Contrast-based image attention analysis by using fuzzy growing. In: ACM International Conference on Multimedia, pp. 374–381 (2003)Google Scholar
  2. 2.
    Yan, Q., Xu, L., Shi, J., Jia, J.: Hierarchical saliency detection. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp. 1155–1162 (2013)Google Scholar
  3. 3.
    Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Süsstrunk, S.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)CrossRefGoogle Scholar
  4. 4.
    Cheng, M., Zhang, G., Mitra, N., Huang, X., Hu, S.: Global contrast based salient region detection. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 37(3), pp. 409–416 (2011)Google Scholar
  5. 5.
    Perazzi, F., Krahenbuhl, P., Pritch, Y., Hornung, A.: Saliency filters: contrast based filtering for salient region detection. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 733–740 (2012)Google Scholar
  6. 6.
    Li, H., Ngan, K.: A co-saliency model of image pairs. IEEE Trans. Image Process. 20(12), 3365–3375 (2011)MathSciNetCrossRefzbMATHGoogle Scholar
  7. 7.
    Zhang, D., Han, J., Han, J., Shao, L.: Cosaliency detection based on intrasaliency prior transfer and deep intersaliency mining. IEEE Trans. Neural Netw. Learn. Syst. 27(6), 1163–1176 (2016)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Tao, Z., Liu, H., Fu, H., Fu, Y.: Image cosegmentation via saliency-guided constrained clustering with cosine similarity. In: 13th AAAI Conference on Artificial Intelligence (2017)Google Scholar
  9. 9.
    Zhang, D., Han, J., Li, C., Wang, J.: Co-saliency detection via looking deep and wide. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2994–3002 (2015)Google Scholar
  10. 10.
    Strand, R., Ciesielski, K.C., Malmberg, F., Saha, K.: The minimum barrier distance. Comput. Vis. Image Underst. 117(4), 429–437 (2013)CrossRefzbMATHGoogle Scholar
  11. 11.
    Zhang, J., Sclaroff, S., Lin, Z., Shen, X., Price, B., Mech, R.: Minimum barrier salient object detection at 80 FPS. In: 2015 IEEE International Conference on Image Processing, pp. 1404–1412 (2015)Google Scholar
  12. 12.
    Philipp, F., Alexey, D., Thomas, D.: Descriptor Matching with Convolutional Neural Networks: a Comparison to Sift. Computer Science (2014)Google Scholar
  13. 13.
    Žbontar, J., LeCun, Y.: Computing the stereo matching cost with a convolutional neural network. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1592–1599 (2015)Google Scholar
  14. 14.
    Zagoruyko, S., Komodakis, N.: Learning to compare image patches via convolutional neural networks. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4353–4361 (2015)Google Scholar
  15. 15.
    Dhruv, B., Adarsh, K., Devi, P., Luo, J., Chen, T.: iCoseg: interactive co-segmentation with intelligent scribble guidance. In: 2015 IEEE conference on Computer Vision and Pattern Recognition (CVPR), pp. 3169–3176 (2010)Google Scholar
  16. 16.
  17. 17.
    Kim, G., Xing, E., Li, F., Kanade, T.: Distributed cosegmentation via submodular optimization on anisotropic diffusion. In: 2011 International Conference on Computer Vision, pp. 169–176 (2011)Google Scholar
  18. 18.
    Joulin, A., Bach, F., Ponce, J.: Multi-class cosegmentation. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 542–549 (2012)Google Scholar
  19. 19.
    Rubinstein, M., Joulin, A., Kopf, J., Liu, C.: Unsupervised joint object discovery and segmentation in internet images. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1939–1946 (2013)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  • Zhengchao Lei
    • 1
  • Weiyan Chai
    • 1
  • Sanyuan Zhao
    • 1
  • Hongmei Song
    • 1
  • Fengxia Li
    • 1
  1. 1.Beijing Laboratory of Intelligent Information Technology, School of Computer ScienceBeijing Institute of TechnologyBeijingPeople’s Republic of China

Personalised recommendations