Registration of 3D Geometric Model and Color Images Using SIFT and Range Intensity Images

  • Ryo Inomata
  • Kenji Terabayashi
  • Kazunori Umeda
  • Guy Godin
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6938)


In this paper, we propose a new method for 3D-2D registration based on SIFT and a range intensity image, which is a kind of intensity image simultaneously acquired with a range image using an active range sensor. A linear equation for the registration parameters is formulated, which is combined with displacement estimations for extrinsic and intrinsic parameters and the distortion of a camera’s lens. This equation is solved to match a range intensity image and a color image using SIFT. The range intensity and color images differ, and the pairs of matched feature points usually contain a number of false matches. To reduce false matches, a range intensity image is combined with the background image of a color image. Then, a range intensity image is corrected for extracting good candidates. Moreover, to remove false matches while keeping correct matches, soft matching, in which false matches are weakly removed, is used. First, false matches are removed by using scale information from SIFT. Secondly, matching reliability is defined from the Bhattacharyya distance of the pair of matched feature points. Then RANSAC is applied. In this stage, its threshold is kept high. In our approach, the accuracy of registration is advanced. The effectiveness of the proposed method is illustrated by experiments with real-world objects.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Levoy, M., Pulli, K., Curless, B., Rusinkiewicz, S., Koller, D., Pereira, L., Ginzton, M., Anderson, S., Davis, J., Ginsberg, J., Shade, J., Fulk, D.: The digital Michelangelo project:3D scanning of large statues. In: SIGGRAPH 2000, pp. 131–144 (2000)Google Scholar
  2. 2.
    Iwakiri, Y., Kaneko, T.: PC-based realtime texture painting on real world objects. In: Proc. Eurographics 2001, vol. 20, pp. 105–113 (2001)Google Scholar
  3. 3.
    Lensch, H.P.A., Heidrich, W., Seidel, H.P.: Automated texture registration and stitching for real world models. In: Proc. Pacific Graphics 2000, pp. 317–326 (2000)Google Scholar
  4. 4.
    Lavallee, S., Szeliski, R.: Recovering the position and orientation of free -form objects from image contours using 3D distance maps. IEEE Trans. Pattern Anal. Mach. Intell. 17(4), 378–390 (1995)CrossRefGoogle Scholar
  5. 5.
    Neugebauer, P.J., Klein, K.: Texturing 3D models of real world objects from multiple unregistered photographic views. In: Proc. Eurographics 1999, pp. 245–256 (1999)Google Scholar
  6. 6.
    Boughorbel, F., Page, D., Dumont, C., Abidi, M.A.: Registration and integration of multi-sensor data for photo-realistic scene reconstruction. In: Proc. Applied Imagery Pattern Recognition, pp. 74–84 (1999)Google Scholar
  7. 7.
    Umeda, K., Godin, G., Rioux, M.: Registration of range and color images using gradient constrains and range intensity images. In: Proc. of 17th Int. Conf. on Pattern Recognition, vol. 3, pp. 12–15 (2004)Google Scholar
  8. 8.
    Kurazume, R., Nishino, K., Zhang, Z., Ikeuchi, K.: Simultaneous 2D images and 3D geometric model registration for texture mapping utilizing reflectance attribute. In: Proc. Fifth ACCV, pp. 99–106 (2002)Google Scholar
  9. 9.
    Elstrom, M.D., Smith, P.W.: Stereo-based registration of multi-sensor imagery for enhanced visualization of remote environments. In: Proc. of the 1999 Int. Conf. on Robotics Automation, pp. 1948–1953 (1999)Google Scholar
  10. 10.
    Boehm, J., Becker, S.: Automatic Marker-Free Registration of Terrestrial Laser Scans using Reflectance Features. In: 8th Conf. on Optical 3D Measurement Techniques (2007)Google Scholar
  11. 11.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRefGoogle Scholar
  12. 12.
    Fischler, M.A., Bolles, R.C.: Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 16(24), 381–395 (1981)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Shinozaki, M., Kusanagi, M., Umeda, K., Godin, G., Rioux, M.: Correction of color information of a 3D model using a range intensity image. Comput. Vis. and Image Understanding 113(11), 1170–1179 (2009)CrossRefGoogle Scholar
  14. 14.
  15. 15.
    Zhang, Z.: A flexible new techniques for camera calibration. IEEE Trans. Pattern Anal. Martch. Intell. 22(11), 1330–1334 (2000)CrossRefGoogle Scholar
  16. 16.

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Ryo Inomata
    • 1
  • Kenji Terabayashi
    • 1
  • Kazunori Umeda
    • 1
  • Guy Godin
    • 2
  1. 1.Chuo UniversityBunkyo-kuJapan
  2. 2.National Research CouncilOttawaCanada

Personalised recommendations