Advertisement

Automatic Registration of Large-Scale Multi-sensor Datasets

  • Quan Wang
  • Suya You
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6554)

Abstract

This paper proposes an automatic method for registering images from different sensors, particularly 2D optical sensors and 3D range sensors, without any assumption about initial alignment.

Many existing methods try to reconstruct 3D points from 2D image sequences, and then match 3D primitives from both sides. The availability of appropriate multiple images associated with 3D range data, the well-known challenge of inferring 3D from 2D and the difficulty of establishing correspondences among 3D primitives when there is no pre-knowledge about initial pose estimation, lead us to a different approach based on region matching between optical images and depth images projected from range data.

This paper details our interest region extraction method for optical images and also the efficient region matching component. Experiments using several cities’ aerial images and LiDAR (Light Detection and Ranging) data illustrate the effectiveness of the proposed approach even when facing considerably geometric distortions.

Keywords

different sensors registration 2D-3D matching LiDAR data 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Lowe, D.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision (2004)Google Scholar
  2. 2.
    Zhao, W., Nister, D., Hsu, S.: Alignment of continuous video onto 3d point clouds. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(8), 1305–1318 (2005)CrossRefGoogle Scholar
  3. 3.
    Ding, M., Lyngbaek, K., Zakhor, A.: Automatic registration of aerial imagery with untextured 3D LiDAR models. In: Computer Vision and Pattern Recognition, pp. 1–8 (2008)Google Scholar
  4. 4.
    Fruh, C., Zakhor, A.: An automated method for large-scale, ground-based city model acquisition. International Journal of Computer Vision 60(1), 5–24 (2004)CrossRefGoogle Scholar
  5. 5.
    Liu, L., Stamos, I.: Automatic 3D to 2D registration for the photorealistic rendering of urban scenes. In: Computer Vision and Pattern Recognition, pp. 137–143 (June 2005)Google Scholar
  6. 6.
    Liu, L., Yu, G., Wolberg, G., Zokai, S.: Multiview Geometry for Texture Mapping 2D Images Onto 3D Range Data. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 2293–2300 (2006) Google Scholar
  7. 7.
    Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. Technical Report UCB//CSD-00-1128, UC Berkeley (January 2001)Google Scholar
  8. 8.
    Comanicu, D., Meer, P.: Mean shift: A robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis aind Machine Intelligence 24, 603–619 (2002)CrossRefGoogle Scholar
  9. 9.
    Hedau, V., Arora, H., Ahuja, N.: Matching Images under Unstable Segmentation. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Anchorage, AL (2008)Google Scholar
  10. 10.
    Felzenszwalb, P.F., Huttenlocher, D.P.: Effie Graph-Based Image Segmentation. International Journal of Computer Vision 59(2) (2004)Google Scholar
  11. 11.
    Mandelbrot, B.B.: The Fractal Geometry of Nature. W.H. Freeman and Co., New York (1983) ISBN: 0716711869Google Scholar
  12. 12.
    Solka, J.L., Marchette, D.J., Wallet, B.C., Irwin, V.L., Rogers, G.W.: Identification of man-made regions in unmanned aerial vehicle imagery and videos. IEEE Transactions on Pattern Analysis and Machine Intelligence (1998)Google Scholar
  13. 13.
    Wang, Q., You, S.: Explore Multiple Clues for Urban Images Matching. In: International Conference on Image Processing (September 2010)Google Scholar
  14. 14.
    Cao, G., Yang, X., Mao, Z.: A two-stage level set evolution scheme for man-made objects detection in aerial images. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 474–479 (June 2005)Google Scholar
  15. 15.
    Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(4), 509–522 (2002)CrossRefGoogle Scholar
  16. 16.
    Wang, Q., You, S.: A Vision-based 2D-3D Registration System. In: IEEE Winter Vision Meeting, WACV, Salt Lake City (December 2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Quan Wang
    • 1
  • Suya You
    • 1
  1. 1.Computer Science DepartmentUniversity of Southern CaliforniaLos AngelesU.S.A.

Personalised recommendations