Advertisement

Depth-Based Stereoscopic Projection Approach for 3D Saliency Detection

  • Hongyun Lin
  • Chunyu LinEmail author
  • Yao Zhao
  • Jimin Xiao
  • Tammam Tillo
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9314)

Abstract

With the popularity of 3D display and the widespread using of depth camera, 3D saliency detection is feasible and significant. Different with 2D saliency detection, 3D saliency detection increases an additional depth channel so that we need to take the influence of depth and binocular parallax into account. In this paper, a new depth-based stereoscopic projection approach is proposed for 3D visual salient region detection. 3D images reconstructed with color and depth images are respectively projected onto XOZ plane and YOZ plane with the specific direction. We find some obvious characteristics that help us to remove the background and progressive surface where the depth is from the near to the distant so that the salient regions are detected more accurately. Then depth saliency map (DSM) is created, which is combined with 2D saliency map to obtain a final 3D saliency map. Our approach performs well in removing progressive surface and background which are difficult to be detected in 2D saliency detection.

Keywords

3D saliency detection Depth-based stereoscopic projection Salient region 

Notes

Acknowledgement

This work was supported by National Natural Science Foundation of China (no.61402034, no.61210006 and no.61202240, no. 61272051), supported by Beijing Natural Science Foundation (4154082) and SRFDP (20130009120038), supported by the Fundamental Research Funds for the Central Universities (2015JBM032).

References

  1. 1.
    Yarbus, A.L.: Eye Movements and Vision. Plenum Press, New York (1967)CrossRefGoogle Scholar
  2. 2.
    Wang, J., Chandler, D.M., Callet, P.L.: Quantifying the relationship between visual salience and visual importance. In: SPIE Human and Electronic imaging (HVEI) XV, p. 75270K (2010)Google Scholar
  3. 3.
    Einhäuser, W., Rutishauser, U., Koch, C.: Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli. J. Vis. 8(2), 1–19 (2008)CrossRefGoogle Scholar
  4. 4.
    van Zoest, W., Donk, M.: Bottom-up and top-down control in visual search. Percept. London 33, 927–937 (2004)CrossRefGoogle Scholar
  5. 5.
    Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20(11), 1254–1259 (1998)CrossRefGoogle Scholar
  6. 6.
    Achanta, R., Hemami, S., Estrada, F., Susstrunk, S.: Frequency-tuned salient region detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1597–1604 (2009)Google Scholar
  7. 7.
    Goferman, S., Zelnik-Manor, L., Tal, A.: Context-aware saliency detection. IEEE Trans. Pattern Anal. Mach. Intell. 34(10), 1915–1926 (2011)CrossRefGoogle Scholar
  8. 8.
    Hou, X., Zhang, L.: Saliency detection: a spectral residual approach. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)Google Scholar
  9. 9.
    Wang, J., et al.: Computational model of stereoscopic 3D visual saliency. IEEE Trans. Image Process. 22(6), 2151–2165 (2013)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Chamaret, C., Godeffroy, S., Lopez, P., Meur, O.L.: Adaptive 3D rendering based on region-of-interest. In: Proceedings of SPIE 7524, Stereoscopic Displays and Applications XXI, p. 75240V (2010)Google Scholar
  11. 11.
    Ouerhani, N., Hugli, H.: Computing visual attention from scene depth. In: 15th IEEE International Conference on Pattern Recognition, vol. 1, pp. 375–378 (2000)Google Scholar
  12. 12.
    Potapova, E., Zillich, M., Vincze, M.: Learning what matters: combining probabilistic models of 2D and 3D saliency cues. In: Crowley, J.L., Draper, B.A., Thonnat, M. (eds.) ICVS 2011. LNCS, vol. 6962, pp. 132–142. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  13. 13.
    Bruce, N., Tsotsos, J.: An attentional framework for stereo vision. In: The 2nd Canadian Conference on Computer and Robot Vision, 2005. Proceedings, pp. 88–95 (2005)Google Scholar
  14. 14.
    Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: Advances in Neural Information Processing Systems, pp. 545–552 (2006)Google Scholar
  15. 15.
    Scharstein, D., Hirschmüller, H., Kitajima, Y., Krathwohl, G., Nešić, N., Wang, X., Westling, P.: High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth. In: Jiang, X., Hornegger, J., Koch, R. (eds.) GCPR 2014. LNCS, vol. 8753, pp. 31–42. Springer, Heidelberg (2014)Google Scholar
  16. 16.
    Jin, Z., Tillo, T., Cheng, F.: Depth-map driven planar surfaces detection. In: Visual Communications and Image Processing Conference, pp. 514–517 (2014)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Hongyun Lin
    • 1
  • Chunyu Lin
    • 1
    Email author
  • Yao Zhao
    • 1
  • Jimin Xiao
    • 2
  • Tammam Tillo
    • 2
  1. 1.Institute of Information Science, Beijing Key Laboratory of Advanced Information Science and NetworkBeijing Jiaotong UniversityBeijingChina
  2. 2.Department of Electrical and Electronic EngineeringXian Jiaotong-Liverpool UniversitySuzhouChina

Personalised recommendations