Skip to main content
SpringerLink
Log in

Hand-held 3D scanning based on coarse and fine registration of multiple range images

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

A hand-held 3D scanning technique is proposed to reconstruct 3D models of real objects. A sequence of range images captured from a hand-held stereo camera is automatically registered to a reference coordinate system. The automated scanning process consists of two states, coarse and fine registration. At the beginning, scanning process starts at the fine registration state. A fast and accurate registration refinement technique is used to align range images in a pair-wise manner. If the refinement technique fails, the process changes to the coarse registration state. A feature-based coarse registration technique is proposed to find correspondences between the last successful frame and the current frame. If the coarse registration successes, the process returns to the fine registration state again. A fast point-to-plane refinement technique is employed to do shape-based registration. After the shape-based alignment, a texture-based refinement technique matches texture features to enhance visual appearance of the reconstructed models. Through a graphic and video display, a human operator adjusts the pose of the camera to change the view of the next acquisition. Experimental results show that 3D models of real objects are reconstructed from sequences of range images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Akbarzadeh, A., Frahm, J.M., Mordohai, P., Clipp, B., Engels, C., Gallup, D., Merrell, P., Phelps, M., Sinha, S., Talton, B., Wang, L., Yang, Q., Stewenius, H., Yang, R., Welch, G., Towles, H., Nister D., Pollefeys, M.: Towards urban 3D reconstruction from video. In: Proceedings of 3DPVT06 (2006)

  2. Besl P.J., McKay N.D.: A Method for Registration of 3-D Shapes. IEEE Trans. Pattern Recogn. Mach. Intell. 14(2), 239–256 (1992)

    Article  Google Scholar 

  3. Dias, P., Sequeira, V., Vaz, F., Goncalves, J.G.M.: Registration and fusion of intensity and range data for 3D modelling of real world scenes. In: Fourth International Conference on 3-D Digital Imaging and Modeling, pp. 418–421 (2003)

  4. Hilton A., Illingworth J.: Geometric fusion for a hand-held 3d sensor. Mach. Vis. Appl. 12(1), 44–51 (2000)

    Article  Google Scholar 

  5. Huber, D., Hebert, M.: 3-D modeling using a statistical sensor model and stochastic search. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 858–865 (2003)

  6. Jaeggli, T., Koninckx, T.P., Van Gool, L.: Online 3D acquisition and model integration, IEEE international workshop on projector-camera systems—ICCV03, cdrom proc (2003)

  7. Johnson A.E., Kang S.B.: Registration and integration of textured 3D data. Image Vis. Comput. 17(2), 135–147 (1999)

    Article  Google Scholar 

  8. Johnson A.: Spin-images: a representation for 3-D surface matching, CMU-RI-TR-97-47 (1997)

  9. Levoy, M., Pulli, K., Curless, B., Rusinkiewicz, S., Koller, D., Pereira, L., Ginzton, M., Anderson, S., Davis, J., Ginsberg, J., Shade, J., Fulk D.: The digital michelangelo project: 3D scanning of large statues. In: SIGGRAPH, pp. 131–144 (2000)

  10. Liu, Y., Heidrich, W.: Interactive 3D model acquisition and registration. In: Proceedings of 11th Pacific Conference on Computer Graphics and Applications, pp 115–122 (2003)

  11. Lorensen W.E., Cline Harvey E.: Marching cubes: a high resolution 3D surface construction algorithm. ACM SIGGRAPH Comput. Graph. 21(4), 163–169 (1987)

    Article  Google Scholar 

  12. Matabosch C., Fofi D., Salvi J., Batlle E.: Registration of surfaces minimizing error propagation for a one-shot multi-slit hand-held scanner. Pattern Recogn. 41(6), 2055–2067 (2008)

    Article  MATH  Google Scholar 

  13. Park S.Y., Subbarao M.: An accurate and fast point-to-plane registration technique. Pattern Recogn. Lett. 24(16), 2967–2976 (2003)

    Article  Google Scholar 

  14. Park, S.Y., Baek, J.: Online registration of multi-view range images using geometric and photometric feature tracking. In: The 6th International Conference on 3-D Digital Imaging and Modeling (3DIM) (2007)

  15. Popescu, V., Sacks, E., Bahmutov, G.: The model camera: a hand-held device for interactive modeling. In: Proceedings of 3DIM03, pp. 285–292 (2003)

  16. Popescu, V., Sacks, E., Bahmutov, G.: Interactive modeling from dense color and sparse depth. In: Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT) (2004)

  17. Rusinkiewicz S., Hall-Holt O., Levoy M.: Real-time 3d model acquisition. Proc. Siggraph 21(3), 438–446 (2002)

    Google Scholar 

  18. Rusinkiewicz, S., Levoy, M.: Efficient variants of the ICP algorithm. In: Third international conference on 3-D digital imaging and modeling, pp. 145–152 (2001)

  19. Se S., Jasiobedzki P.: Instant scene modeler for crime scene reconstruction. IEEE Conf. Comput. Vis. Pattern Recogn. 3, 123–123 (2005)

    Google Scholar 

  20. Shi, J. Tomasi, C.: Good features to track. IEEE Conf. Comput. Vis. Pattern Recogn. 593–600 (1994)

  21. Tomasi, C., Kanade, T.: Detection and tracking of point features, Carnegie Mellon University Technical Report CMU-CS-91-132 (1991)

  22. Urfalioglu, O., Mikulastik, P., Stegmann, I.: Scale invariant robust registration of 3D-point data and a triangle mesh by global optimization. In: Proceedings of the 8th International Conference on Advanced Concepts for Intelligent Vision Systems (ACIVS 2006), LNCS, vol. 127, pp. 1059–1070 (2006)

  23. Yoshida, K., Saito H.: Registration of range images using texture of high-resolution color images. In: Proceedings of IAPR Workshop on Machine Vision Applications(MVA2002) (2002)

  24. Yun S.U., Min, D., Sohn, K.: 3D scene reconstruction system with hand-held stereo camerasm 3DTV conference, pp. 1–4 (2007)

  25. http://www.ces.clemson.edu/~stb/klt/

  26. http://www.ptgrey.com

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Kyungpook National University, Daegu, 702-701, Korea

    Soon-Yong Park

  2. NeoMtel Incorporation, Seoul, 135-080, Korea

    Jaewon Baek

  3. School of Electronics, Electrical and Computer Science, Kyungpook National University, Daegu, 702-701, Korea

    Jaekyoung Moon

Authors
  1. Soon-Yong Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jaewon Baek
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jaekyoung Moon
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Soon-Yong Park.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Park, SY., Baek, J. & Moon, J. Hand-held 3D scanning based on coarse and fine registration of multiple range images. Machine Vision and Applications 22, 563–579 (2011). https://doi.org/10.1007/s00138-010-0248-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-010-0248-1

Keywords

Search

Navigation