Non-Iterative Vision-Based Interpolation of 3D Laser Scans
3D range sensors, particularly 3D laser range scanners, enjoy a rising popularity and are used nowadays for many different applications. The resolution 3D range sensors provide in the image plane is typically much lower than the resolution of a modern colour camera. In this chapter we focus on methods to derive a highresolution depth image from a low-resolution 3D range sensor and a colour image. The main idea is to use colour similarity as an indication of depth similarity, based on the observation that depth discontinuities in the scene often correspond to colour or brightness changes in the camera image. We present five interpolation methods and compare them with an independently proposed method based on Markov random fields. The proposed algorithms are non-iterative and include a parameter-free vision-based interpolation method. In contrast to previous work, we present ground truth evaluation with real world data and analyse both indoor and outdoor data.
KeywordsVoronoi Diagram Depth Image Voronoi Cell Laser Range Natural Neighbour
Unable to display preview. Download preview PDF.
- 1.M. Levoy, K. Pulli, B. Curless, S. Rusinkiewicz, D. Koller, L. Pereira, M. Ginzton, S. Anderson, J. Davis, J. Ginsberg, J. Shade, and D. Fulk. The digital michelangelo project: 3D scanning of large statues. In Kurt Akeley, editor, Siggraph 2000, Computer Graphics Proceedings, pages 131-144. ACM Press/ACM SIGGRAPH/ Addison Wesley Longman, 2000.Google Scholar
- 2.S. Thrun, D. Hähnel, D. Ferguson, M. Montemerlo, R. Triebel, W. Burgard, C. Baker, Z. Omohundro, S. Thayer, and W. Whittaker. A system for volumetric robotic mapping of abandoned mines. In ICRA, pages 4270-4275, 2003.Google Scholar
- 3.V. Sequeira, J. Goncalves, and M.I. Ribeiro. 3d reconstruction of indoor environments. In Proc. of ICIP, pages 405-408, Lausanne, Switzerland, 1996.Google Scholar
- 4.C. Früh and A. Zakhor. 3D model generation for cities using aerial photographs and ground level laser scans. In CVPR, pages 31-38, Hawaii, USA, 2001.Google Scholar
- 5.N. Haala and Y. Alshawabkeh. Application of photogrammetric techniques for heritage documentation. In 2nd Int. Conf. on Science & Technology in Archaeology & Conservation, Amman, Jordan, 2003.Google Scholar
- 6.H. Andreasson, R. Triebel, and A. Lilienthal. Vision-based interpolation of 3d laser scans. In Proc. of ICARA, pages 469-474, 2006.Google Scholar
- 7.R. Sibson. A brief description of natural neighbour interpolation, pages 21-36. John Wiley & Sons, Chichester, 1981.Google Scholar
- 8.J. Diebel and S. Thrun. An application of markov random fields to range sensing. In Y. Weiss, B. Schölkopf, and J. Platt, editors, Advances in Neural Information Processing Systems 18, pages 291-298. MIT Press, Cambridge, MA, 2006.Google Scholar
- 9.William H. Press, Brian P. Flannery, Saul A. Teukolsky, and William T. Vetterling. Numerical Recipes: The Art of Scientific Computing. Cambridge University Press, Cambridge (UK) and New York, 2nd edition, 1992.Google Scholar