Skip to main content

Saliency Detection Using DCT Coefficients and Superpixel-Based Segmentation

  • Conference paper
Advances in Multimedia Information Processing – PCM 2013 (PCM 2013)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 8294))

Included in the following conference series:

  • 2988 Accesses

Abstract

The salient region is the area of an image that attracts the attention of viewers. In this paper, a very effective saliency detection algorithm is proposed. Our algorithm is mainly based on two new techniques. First, the discrete cosine transform (DCT) is used for constructing the block-wise saliency map. Then, the superpixel-based segmentation is applied. Since DCT coefficients can reflect the color features of each block in the frequency domain and superpixels can well preserve object boundaries, with the two techniques, the performance of saliency detection can be significantly improved. The simulations performed on a database of 1000 images with human-marked ground truths show that our proposed method can extract the salient region very accurately and outperforms all of the existing saliency detection methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Xue, J., Li, C., Zheng, N.: Proto-object Based Rate Control for JPEG2000: An Approach to Content-based Scalability. IEEE Trans. Image Processing 20(4), 1177–1184 (2011)

    Article  MathSciNet  Google Scholar 

  2. Chen, T., Cheng, M.M., Tan, P., Shamir, A., Hu, S.M.: Sketch2photo: Internet Image Montage. ACM Transactions on Graphics 28(5), article number 124 (2009)

    Google Scholar 

  3. Han, J., Ngan, K.N., Li, M., Zhang, H.J.: Unsupervised Extraction of Visual Attention Objects in Color Images. IEEE Transactions on Circuits and Systems for Video Technology 16(1), 141–145 (2006)

    Article  Google Scholar 

  4. Chen, O.C., Chen, C.C.: Automatically-determined Region of Interest in JPEG 2000. IEEE Transactions on Multimedia 9(7), 1333–1345 (2007)

    Article  Google Scholar 

  5. Rutishauser, U., Walther, D., Koch, C., Perona, P.: Is Bottom-up Attention Useful for Object Recognition? In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 37–44 (2004)

    Google Scholar 

  6. Boykov, Y., Kolmogorov, V.: An Experimental Comparison of Min-cut/ Max-flow Algorithms for Energy Minimization in Vision. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(9), 1124–1137 (2004)

    Article  Google Scholar 

  7. Avidan, S., Shamir, A.: Seam Carving for Content-aware Image Resizing. ACM Transactions on Graphics 26(3), article number 10 (2007)

    Google Scholar 

  8. Wang, Y.S., Tai, C.L., Sorkine, O., Lee, T.Y.: Optimized Scale-and-stretch for Image Resizing. ACM Transactions on Graphics 27(5), article number 118 (2008)

    Google Scholar 

  9. Wu, H., Wang, Y.S., Feng, K.C., Wong, T.T., Lee, T.Y., Heng, P.A.: Resizing by Symmetry-summarization. ACM Transactions on Graphics 29(6), article number 159 (2010)

    Google Scholar 

  10. Itti, L., Koch, C.: Computational Modeling of Visual Attention. Nature Reviews Neuroscience 2(3), 194–203 (2001)

    Article  Google Scholar 

  11. Achanta, R., Hemami, S., Estrada, F., Susstrunk, S.: Frequency-tuned Salient Region Detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1597–1604 (2009)

    Google Scholar 

  12. Cheng, M.M., Zhang, G.X., Mitra, N.J., Huang, X., Hu, S.M.: Global Contrast Based Salient Region Detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 409–416 (2011)

    Google Scholar 

  13. Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient Graph-based Image Segmentation. International Journal of Computer Vision 59(2), 167–181 (2004)

    Article  Google Scholar 

  14. Jiang, H., Wang, J., Yuan, Z., Liu, T., Zheng, N., Li, S.: Automatic Salient Object Segmentation Based on Context and Shape Prior. In: BMVC, vol. 3, p. 7 (2011)

    Google Scholar 

  15. Perazzi, F., Krahenbuhl, P., Pritch, Y., Hornung, A.: Saliency Filters: Contrast Based Filtering for Salient Region Detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 733–740 (2012)

    Google Scholar 

  16. Goferman, S., Zelnik-Manor, L., Tal, A.: Context-aware Saliency Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 34(10), 1915–1926 (2012)

    Article  Google Scholar 

  17. Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Susstrunk, S.: SLIC Superpixels Compared to State-of-the-art Superpixel Methods. IEEE Transactions on Pattern Analysis and Machine Intelligence 34(11), 2274–2282 (2012)

    Article  Google Scholar 

  18. Chen, W.Y., Song, Y., Bai, H., Lin, C.J., Chang, E.Y.: Parallel Spectral Clustering in Distributed Systems. IEEE Transactions on Pattern Analysis and Machine Intelligence 33(3), 568–586 (2011)

    Article  Google Scholar 

  19. Itti, L., Koch, C., Niebur, E.: A Model of Saliency-based Visual Attention for Rapid Scene Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(11), 1254–1259 (1998)

    Article  Google Scholar 

  20. Ma, Y.F., Zhang, H.J.: Contrast-based Image Attention Analysis by Using Fuzzy Growing. In: Proceedings of the 11th ACM International Conference on Multimedia, pp. 374–381 (2003)

    Google Scholar 

  21. Harel, J., Koch, C., Perona, P.: Graph-based Visual Saliency. In: Advances in Neural Information Processing Systems, vol. 19, pp. 545–552 (2007)

    Google Scholar 

  22. Hou, X., Zhang, L.: Saliency Detection: A Spectral Residual Approach. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)

    Google Scholar 

  23. Achanta, R., Estrada, F., Wils, P., Süsstrunk, S.: Salient Region Detection and Segmentation. In: Gasteratos, A., Vincze, M., Tsotsos, J.K. (eds.) ICVS 2008. LNCS, vol. 5008, pp. 66–75. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  24. Zhai, Y., Shah, M.: Visual Attention Detection in Video Sequences Using Spatiotemporal Cues. In: Proceedings of the 14th Annual ACM International Conference on Multimedia, pp. 815–824 (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer International Publishing Switzerland

About this paper

Cite this paper

Hsu, CY., Ding, JJ. (2013). Saliency Detection Using DCT Coefficients and Superpixel-Based Segmentation. In: Huet, B., Ngo, CW., Tang, J., Zhou, ZH., Hauptmann, A.G., Yan, S. (eds) Advances in Multimedia Information Processing – PCM 2013. PCM 2013. Lecture Notes in Computer Science, vol 8294. Springer, Cham. https://doi.org/10.1007/978-3-319-03731-8_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-03731-8_12

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-03730-1

  • Online ISBN: 978-3-319-03731-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics