Skip to main content
SpringerLink
Log in

Efficient depth map generation with occlusion handling for various camera arrays

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

In this paper, we propose a direct depth map acquisition method for the arc camera array as well as the parallel camera array. In conventional stereo matching algorithms, image rectification is necessary where disparity values are obtained by identifying correspondences in the identical horizontal line of stereo images. The acquired disparity values are then transformed to depth values. However, image rectification may fabricate unwanted outcomes related to the arc camera array. Thus, the proposed method excludes image rectification and directly extracts depth values using an epipolar constraint. In particular, occlusion detection and handling processes are inserted to increase depth map accuracy. Further, belief propagation-based energy optimization is employed to confirm occlusion regions. Then, reasonable depth values are assigned to obtained occlusion regions using distances and color differences of neighbor pixels. Experimental results show that compared to the conventional methods, the proposed method generate more stable depth maps with fewer limitations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. ISO/IEC JTC1/SC29/WG11: Applications and requirements on FTV. N9466 (2007)

  2. ISO/IEC JTC1/SC29/WG11: Vision on 3D video. N10357 (2009)

  3. Zhang, L., Tam, W.J.: Stereoscopic image generation based on depth images for 3DTV. IEEE Trans. Broadcast. 51(2), 191–199 (2005)

    Article  Google Scholar 

  4. Fieseler, M., Jiang, X.: Discontinuity-based registration of depth and video data in depth image based rendering. Signal Image Video Process. 5(3), 353–361 (2011)

    Article  Google Scholar 

  5. Frick, A., Kellner, F., Bartczak, B., Koch, R.: Generation of 3D-TV LDV-content with time of flight camera. In: Proceedings of IEEE International Conference on 3DTV, pp. 45–48. Potsdam, Germany, May 4–6 (2009)

  6. Shin, I.Y., Ho, Y.S.: Disparity estimation at virtual viewpoint for real-time intermediate view generation. In: Proceedings of International Conference on 3D Systems and Applications, pp. 195–198. Seoul, Korea, June 20–22 (2011), paper S6–2

  7. Jang, W.S., Ho, Y.S.: Efficient disparity map estimation using occlusion handling for various 3D multimedia applications. IEEE Trans. Consumer Electron. 57(4), 1937–1943 (2011)

    Article  Google Scholar 

  8. Lee, E.K., Ho, Y.S.: Generation of high-quality depth maps using hybrid camera system for 3-D video. J. Visual Commun. Image Represent. 22(1), 73–84 (2011)

    Article  Google Scholar 

  9. Sharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. In: IEEE Workshop on Stereo and Multi-Baseline Vision, Kauai, Hawaii, Dec 9–10, 131–140 (2001)

  10. Raghavendra, U., Makkithaya, K., Karunakar, A. K.: Anchor-diagonal-based shape adaptive local support region for efficient stereo matching. Signal Image Video Process. 1–9 (2013). doi:10.1007/s11760-013-0524-4

  11. Kang, Y.S., Ho, Y.S.: An efficient image rectification method for parallel multi-camera arrangement. IEEE Trans. Consumer Electron. 57(3), 1041–1048 (2011)

    Google Scholar 

  12. Robert, L., Deriche, R.: Dense depth map reconstruction: a minimization and regularization approach which preserves discontinuities. In: Proceedings of European Conference on Computer Vision, Cambridge, pp. 439–451, April 15–18 (1996)

  13. Lopez, A., Pla, F.: A minimization approach for 3D recovery in region-based stereo vision. In: Proceedings of Image Processing and its Applications, Bangalore, India, pp. 47–51, July 13–15 (1999)

  14. Kang, Y.S., Ho, Y.S.: Geometrical calibration of stereo images in convergent camera arrangement. In: Proceedings of IEEE-RIVF International Conference on Computing and Communication Technologies, Ho Chi Minh, Vietnam, pp. 44–47, Feb 27–Mar 1 (2012)

  15. Wang, L., Jin, H., Yang, R.: Search space reduction for MRF stereo. In: Proceedings of 10th European Conference on Computer Vision, Marseille, pp. 576–588, Oct 12–18 (2008)

  16. Hirschmuller, H., Innocent, P.R., Garibaldi, J.M.: Real-time correlation-based stereo vision with reduced border errors. Int. J. Comput. Vision 47(1/2/3), 229–246 (2002)

    Article  Google Scholar 

  17. Kang, Y.S., Ho, Y.S.: Disparity Map Generation for color image using a TOF depth camera. In: Proceedings of 3DTV Conference, Antalya, Turkey, pp. 46(1–4), May 16–18 (2011)

  18. Yang, Q., Wang, L., Ahuja, N.: A constant-space belief propagation algorithm for stereo matching. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, pp. 1458–1465, June 13–18 (2010).

  19. Yang, Q., Engels, C., Akbarzadeh, A.: Near real-time stereo for weakly-textured scenes. In: Proceedings of British Machine Vision Conference, Leeds, England, pp. 80–87, Sept 1–4 (2008)

  20. Jung, J.-I., Ho, Y.-S.: Color correction algorithm based on camera characteristics for multi-view video coding. Signal Image Video Process. (2012). doi:10.1007/s11760-012-0341-1

  21. Zhang, Z.: A Flexible New Technique for Camera Calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)

    Article  Google Scholar 

  22. Tappen, M.F., Freeman, W.T.: Comparison of graph cuts with belief propagation for stereo, using identical MRF parameters. In: Proceedings of IEEE International Conference on Computer Vision, Nice, pp. 900–906, Oct 13–16 (2003)

Download references

Acknowledgments

This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MEST) (No. 2012-0009228).

Author information

Authors and Affiliations

  1. Gwangju Institute of Science and Technology (GIST), 123 Cheomdangwagi-ro, Buk-gu, Gwangju, 500-712, Republic of Korea

    Woo-Seok Jang & Yo-Sung Ho

Authors
  1. Woo-Seok Jang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yo-Sung Ho
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Woo-Seok Jang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jang, WS., Ho, YS. Efficient depth map generation with occlusion handling for various camera arrays. SIViP 8, 287–297 (2014). https://doi.org/10.1007/s11760-013-0550-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-013-0550-2

Keywords

Search

Navigation