Abstract
This paper proposes an automatic method for registering images from different sensors, particularly 2D optical sensors and 3D range sensors, without any assumption about initial alignment.
Many existing methods try to reconstruct 3D points from 2D image sequences, and then match 3D primitives from both sides. The availability of appropriate multiple images associated with 3D range data, the well-known challenge of inferring 3D from 2D and the difficulty of establishing correspondences among 3D primitives when there is no pre-knowledge about initial pose estimation, lead us to a different approach based on region matching between optical images and depth images projected from range data.
This paper details our interest region extraction method for optical images and also the efficient region matching component. Experiments using several cities’ aerial images and LiDAR (Light Detection and Ranging) data illustrate the effectiveness of the proposed approach even when facing considerably geometric distortions.
Chapter PDF
Similar content being viewed by others
References
Lowe, D.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision (2004)
Zhao, W., Nister, D., Hsu, S.: Alignment of continuous video onto 3d point clouds. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(8), 1305–1318 (2005)
Ding, M., Lyngbaek, K., Zakhor, A.: Automatic registration of aerial imagery with untextured 3D LiDAR models. In: Computer Vision and Pattern Recognition, pp. 1–8 (2008)
Fruh, C., Zakhor, A.: An automated method for large-scale, ground-based city model acquisition. International Journal of Computer Vision 60(1), 5–24 (2004)
Liu, L., Stamos, I.: Automatic 3D to 2D registration for the photorealistic rendering of urban scenes. In: Computer Vision and Pattern Recognition, pp. 137–143 (June 2005)
Liu, L., Yu, G., Wolberg, G., Zokai, S.: Multiview Geometry for Texture Mapping 2D Images Onto 3D Range Data. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 2293–2300 (2006)
Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. Technical Report UCB//CSD-00-1128, UC Berkeley (January 2001)
Comanicu, D., Meer, P.: Mean shift: A robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis aind Machine Intelligence 24, 603–619 (2002)
Hedau, V., Arora, H., Ahuja, N.: Matching Images under Unstable Segmentation. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Anchorage, AL (2008)
Felzenszwalb, P.F., Huttenlocher, D.P.: Effie Graph-Based Image Segmentation. International Journal of Computer Vision 59(2) (2004)
Mandelbrot, B.B.: The Fractal Geometry of Nature. W.H. Freeman and Co., New York (1983) ISBN: 0716711869
Solka, J.L., Marchette, D.J., Wallet, B.C., Irwin, V.L., Rogers, G.W.: Identification of man-made regions in unmanned aerial vehicle imagery and videos. IEEE Transactions on Pattern Analysis and Machine Intelligence (1998)
Wang, Q., You, S.: Explore Multiple Clues for Urban Images Matching. In: International Conference on Image Processing (September 2010)
Cao, G., Yang, X., Mao, Z.: A two-stage level set evolution scheme for man-made objects detection in aerial images. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 474–479 (June 2005)
Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(4), 509–522 (2002)
Wang, Q., You, S.: A Vision-based 2D-3D Registration System. In: IEEE Winter Vision Meeting, WACV, Salt Lake City (December 2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, Q., You, S. (2012). Automatic Registration of Large-Scale Multi-sensor Datasets. In: Kutulakos, K.N. (eds) Trends and Topics in Computer Vision. ECCV 2010. Lecture Notes in Computer Science, vol 6554. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35740-4_18
Download citation
DOI: https://doi.org/10.1007/978-3-642-35740-4_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35739-8
Online ISBN: 978-3-642-35740-4
eBook Packages: Computer ScienceComputer Science (R0)