Skip to main content
SpringerLink
Log in

Depth map enhancement using adaptive moving least squares method with a total variation minimization

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Accurate and fast depth map acquisition and enhancement is an important issue in the area of computer vision and image processing. In this study, we present a novel method for enhancing noisy depth maps using adaptive total variation minimization, which facilitates noise smoothing and boundary sharpening for a given depth map image but without previous information. We filter the noise in the depth map with a refined total variation minimization technique. Our experimental results demonstrate that the proposed method outperforms other competitive methods in both objective and subjective comparisons of depth map enhancement and denoising.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Balanna P, Suvarna K, Sudhakar K (2013) Improved depth conception with sharpness augmentation for stereo video. Int J Comput Electron Res 2(3):183

    Google Scholar 

  2. Bose NK, Ahuja NA (2006) Super-resolution and noise filtering using moving least squares. IEEE Trans Image Process 15(8):2239–2248

    Article  Google Scholar 

  3. Caselles V, Chambolle A, Novaga M (2007) The discontinuity set of solutions of the TV denoising problem and some extensions. Multiscale Model Simul 6(3):879–894

    Article  MathSciNet  MATH  Google Scholar 

  4. Chambolle A (2004) Total variation minimization and applications. J Math Imaging Vision 20:89–97

    Article  MathSciNet  Google Scholar 

  5. Chan T, Esedoglu S, Mulet P (2007) Image decomposition combining staircase reduction and texture extraction. J Vis Commun Image Represent 18(6):464–486

    Article  Google Scholar 

  6. Danielyan A, Katkovnik V, Egiazarian K (2012) BM3D frames and variational image deblurring. IEEE Trans Image Process 21(4):1715–1728

    Article  MathSciNet  Google Scholar 

  7. Eisenmann E, Durand F (2004) Flash photography enhancement via intrinsic relighting. In Proceeding of SIGGRAPH, p 673–678

  8. Goldstein T, Osher S (2009) The split Bregman method for l1 regularized problems. SIAM J Image Sci 2(2):323–343

    Article  MathSciNet  MATH  Google Scholar 

  9. Hu J, Hu R, Wang Z, Gong Y, Duan M (2013) Kinect depth map based enhancement for low light surveillance image. In Proceeding of ICIP, p 1090–1094

  10. Jung S-W (2013) Enhancement of image and depth map using adaptive joint trilateral filter. IEEE Trans Circuits Syst Video Technol 23(2):258–269

    Article  Google Scholar 

  11. Jung S-W, Ko S-J (2012) Depth map based image enhancement using color stereopsis. IEEE Signal Process Lett 19(5):303–306

    Article  Google Scholar 

  12. Kim S-M, Cha J, Ryu J, Lee (2006) Depth video enhancement for haptic interaction using a smooth surface reconstruction. Inst Electron Inf Commun Eng E89-D:37–44

    Google Scholar 

  13. Lee Y, Lee S, Yoon J (2014) A framework for moving least squares method with total variation minimizing regularization. J Math Imaging Vision 48:566–582

    Article  MathSciNet  MATH  Google Scholar 

  14. Levin D (1998) The approximation power of moving least-squares. Math Comput 67(224):1517–1531

    Article  MathSciNet  MATH  Google Scholar 

  15. Needell D, Ward R (2012) Total variation minimization for stable multidimensional signal recovery. SIAM J Numer Anal 50(3):1162–1180

    Article  MathSciNet  Google Scholar 

  16. Newcombe RA, Izadi S, Hilliges O, Molyneaux D, Kim D, Davison AJ, Kohli P, Shotton J, Hodges S, Fitzgibbon AW (2011) KinectFusion: real-time dense surface mapping and tracking. In Proceeding of ISMAR, p 127–136

  17. Nikolova M (2000) Local strong homogeneity of a regularized estimator. SIAM J Appl Math 61(2):633–658

    Article  MathSciNet  MATH  Google Scholar 

  18. Nikolova M (2004) Weakly constrained minimization: application to the estimation of images and signals involving constant regions. J Math Imaging Vision 21:155–175

    Article  MathSciNet  Google Scholar 

  19. Rana PK, Ma Z, Taghia J, Flierl M (2013) Multi-view depth map enhancement by variational bayes inference estimation of Dirichlet mixture models. In Proceeding of ICASSP

  20. Rudin L, Osher S, Fatemi E (1992) Nonlinear total variation based noise removal algorithms. Physica D 60:259–268

    Article  MathSciNet  MATH  Google Scholar 

  21. Stefanoski N, Bal C, Lang M, Wang O, Smolic A (2013) Depth estimation and depth enhancement by diffusion of depth features. In Proceeding of ICIP, p 1247–1251

  22. Subedar MM, Karam LJ (2010) Increased depth perception with sharpness enhancement for stereo video. In Proc. SPIE-IS&T Electronic Imaging

  23. Swenson D (2011) Intensity-constrained total variation regularization for image denoising and deblurring. UC Merced: Applied Mathematics

  24. Takeda H, Farsui S, Milanfar P (2007) Kernel regression for image processing and reconstruction. IEEE Trans Image Process 16(2):349–366

    Article  MathSciNet  Google Scholar 

  25. Tepper M, Sapiro G (2013) Fast L1 smoothing splines with an application to Kinect depth data. In Proceeding of ICIP, p 504–508

  26. Zhang Q (2012) Reconstruction of intermediate view based on depth map enhancement. J Multimed 7(6):415–419

    Google Scholar 

  27. Zhang Z (2012) Microsoft kinect sensor and its effect. IEEE MultiMed 19(2):4–10

    Article  Google Scholar 

Download references

Acknowledgments

S.M. Yoon was supported by the ICT R&D program of MSIP/IITP, Korea (B0101-15-1347), A Study on the Key Technology of Optical Modulation and Signal Processing for Implementation of 400 Gb/s Optical Transmission. S.M. Yoon was also supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT & Future Planning (NRF--2014R1A1A1002890). Jungho Yoon was supported by NRF20151009350 (Science Research Center Program) and 2009–0093827 (Priority Research Centers Program) through the National Research Foundation of Korea.

Author information

Authors and Affiliations

  1. School of Computer Science, Kookmin University, 77, Jeongneung-ro, Sungbuk-gu, Seoul, 136-702, South Korea

    Sang Min Yoon

  2. Department of Mathematics, Ewha Womans University, 52, Ewhayeodae-gil, Seodaemun-gu, Seoul, 120-750, South Korea

    Jungho Yoon

Authors
  1. Sang Min Yoon
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jungho Yoon
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sang Min Yoon.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yoon, S.M., Yoon, J. Depth map enhancement using adaptive moving least squares method with a total variation minimization. Multimed Tools Appl 75, 15929–15938 (2016). https://doi.org/10.1007/s11042-015-2905-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2905-x

Keywords

Search

Navigation