Skip to main content

Fusion of Depth Data with Standard Cameras Data

  • Chapter
  • First Online:
Time-of-Flight Cameras and Microsoft Kinect™

Abstract

Depth camera possibilities and limitations seen in the previous chapters may naturally prompt questions like “Is a depth camera enough for my application?” or “May one or more standard cameras help it?”.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 16.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. T. D. Arun Prasad, K. Hartmann, W. Weihs, S.E. Ghobadi, and A. Sluiter. First steps in enhancing 3d vision technique using 2d/3d sensors, 2006.

    Google Scholar 

  2. C. M. Bishop. Pattern Recognition and Machine Learning (Information Science and Statistics). Springer, 2007.

    Google Scholar 

  3. Blake A, Kohli P, Rother C (2011) editors. Markov Random Fields for Vision and Image Processing, MIT Press

    Google Scholar 

  4. Boykov Y, Kolmogorov V (2001) An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Transactions on Pattern Analysis and Machine Intelligence 26:359–374

    Google Scholar 

  5. Boykov Y, Veksler O, Zabih R (2001) Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 23:1222–1239

    Article  Google Scholar 

  6. A. Buades, B. Coll, and J.-M. Morel. A non-local algorithm for image denoising. In Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition CVPR 2005, volume 2, pages 60–65, 2005.

    Google Scholar 

  7. Recommendations on uniform color spaces, color difference equations, psychometric color terms. Supplement No.2 to CIE publication No. 15 (E.-1.3.1) 1971/(TC-1.3.), 1978.

    Google Scholar 

  8. C. Dal Mutto, P. Zanuttigh, and G. M. Cortelazzo. A probabilistic approach to tof and stereo data fusion. In Proceedings of 3DPVT, Paris, France, May 2010.

    Google Scholar 

  9. J. Diebel and S. Thrun. An application of markov random fields to range sensing. In Proceedings of Conference on Neural Information Processing Systems (NIPS), Cambridge, MA, 2005. MIT Press.

    Google Scholar 

  10. V. Garro, C. Dal Mutto, P. Zanuttigh, and G. M. Cortelazzo. A novel interpolation scheme for range data with side information. In CVMP, pages 52 –60, nov. 2009.

    Google Scholar 

  11. Gudmundsson SA, Aanaes H, Larsen R (2008) Fusion of stereo vision and time of flight imaging for improved 3d estimation. Int J Intell Syst Technol Appl 5:425–433

    Google Scholar 

  12. D.L. Hall and J. Llinas. An introduction to multisensor data fusion. Proceedings of the IEEE, 85(1):6 –23, jan 1997.

    Google Scholar 

  13. C. E. Hernandez, G. Vogiatzis, and R. Cipolla. Probabilistic visibility for multi-view stereo. In Proc. of CVPR Conf., 2007.

    Google Scholar 

  14. B. Huhle, S. Fleck, and A. Schilling. Integrating 3d time-of-flight camera data and high resolution images for 3dtv applications. In 3DTV Conference, 2007, pages 1 –4, may 2007.

    Google Scholar 

  15. Huhle B, Schairer T, Jenke P (2010) andW. Strasser Fusion of range and color images for denoising and resolution enhancement with a non-local filter Computer Vision and Image Understanding 114(12):1336–1345

    Google Scholar 

  16. K. D. Kuhnert and M. Stommel. Fusion of stereo-camera and pmd-camera data for real-time suited precise, 2006.

    Google Scholar 

  17. S. Z. Li. Markov Random Field Modeling in Image Analysis. Springer, New York, 3rd edition edition, 2009.

    Google Scholar 

  18. M. Lindner, A. Kolb, and K. Hartmann. Data-fusion of pmd-based distance-information and high-resolution rgb-images. In Signals, Circuits and Systems, 2007. ISSCS 2007. International Symposium on, volume 1, pages 1 –4, july 2007.

    Google Scholar 

  19. M. Lindner, M. Lambers, and A. Kolb. Sub-pixel data fusion and edge-enhanced distance refinement for 2d/3d images. International Journal of Intelligent Systems Technologies and Applications, pages 344–354, 2008.

    Google Scholar 

  20. J. Park, H. Kim, Y.W. Tai, M.S. Brown, and I. Kweon. High quality depth map upsampling for 3d-tof cameras. In Proceedings of the 13th International Conference on Computer Vision (ICCV2011), November 2011.

    Google Scholar 

  21. R. Reulke. Combination of distance data with high resolution images. In Proceedings of Image Engineering and Vision Metrology (IEVM), 2006.

    Google Scholar 

  22. Sun J, Zheng N, Shum H (2003) Stereo matching using belief propagation. IEEE Trans Pattern Anal Mach Intell 25:787–800

    Article  Google Scholar 

  23. Szeliski R (2010) Computer Vision: Algorithms and Applications. Springer, New York

    Google Scholar 

  24. Szeliski R, Zabih R, Scharstein D, Veksler O, Kolmogorov V, Agarwala A, Tappen M, Rother C (2008) A comparative study of energy minimization methods for markov random fields with smoothness-based priors. Pattern Analysis and Machine Intelligence, IEEE Transactions on 30:1068–1080

    Article  Google Scholar 

  25. C. Tomasi and R. Manduchi. Bilateral filtering for gray and color images. In Computer Vision, 1998. Sixth International Conference on, pages 839 –846, jan 1998.

    Google Scholar 

  26. Wallach HM (2004) Conditional random fields: An introduction. Technical report, University of Pennsylvania

    Google Scholar 

  27. Q. Yang, K.H. Tan, B. Culbertson, and J. Apostolopoulos. Fusion of active and passive sensors for fast 3d capture. In Multimedia Signal Processing (MMSP), IEEE International Workshop on, 2010.

    Google Scholar 

  28. Q. Yang, R. Yang, J. Davis, and D. Nistr. Spatial-depth super resolution for range images. In Computer Vision and Pattern Recognition, 2007. CVPR ’07. IEEE Conference on, 2007.

    Google Scholar 

  29. Zhu J, Wang L, Gao J, Yang R (2010) Spatial-temporal fusion for high accuracy depth maps using dynamic mrfs. IEEE Transactions on Pattern Analysis and Machine Intelligence 32:899–909

    Article  Google Scholar 

  30. Zhu J, Wang L, Yang R (2008) and J. Davis. Fusion of time-of-flight depth and stereo for high accuracy depth maps, In CVPR

    Google Scholar 

  31. J. Zhu, L. Wang, R. Yang, J. E. Davis, and Z. Pan. Reliability fusion of time-of-flight depth and stereo geometry for high quality depth maps. IEEE Trans. Pattern Anal. Mach. Intell.,33:1400–1414, 2011.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2012 The Author(s)

About this chapter

Cite this chapter

Mutto, C.D., Zanuttigh, P., Cortelazzo, G.M. (2012). Fusion of Depth Data with Standard Cameras Data. In: Time-of-Flight Cameras and Microsoft Kinect™. SpringerBriefs in Electrical and Computer Engineering(). Springer, Boston, MA. https://doi.org/10.1007/978-1-4614-3807-6_5

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-3807-6_5

  • Published:

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4614-3806-9

  • Online ISBN: 978-1-4614-3807-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics