Projection-Based Registration Using Color and Texture Information for Virtual Environment Generation
In this paper, we propose a registration method for 3D data which uses color and texture data acquired from a multi-view camera for virtual environment generation. In general, most registration methods depend on 3D data acquired by precise optical sensors. However, as for a multi-view camera, depth errors are relatively large and depths in homogeneous areas are not measurable. We propose a projection-based registration method to cope with these limitations. First, we perform initial registration by establishing relationship between multi-view cameras through inter-camera calibration. Then, by applying color and texture descriptors to projected images, fine registration is accomplished. Finally, by exploiting adaptive search ranges, color selection is attained. Even if the accuracy of 3D data is relatively low, the proposed method can effectively register 3D data. In addition, an effective color selection can be done by setting up adaptive search ranges based on depth. Through this method, we can generate a virtual environment that supports user interaction or navigation.
KeywordsAugmented Reality Texture Information Texture Descriptor Registration Method Depth Error
Unable to display preview. Download preview PDF.
- 1.Besl, P.J., McKay, N.D.: A Method for Registration of 3-D Shapes. IEEE Trans. on PAMI 14(2), 239–256 (1992)Google Scholar
- 2.Johnson, A., Kang, S.: Registration and Integration of Textured 3-D Data. Tech. report CRL96/4, Cambridge Research Lab (1996)Google Scholar
- 3.Levoy, M., Pulli, K., Curless, B., Rusinkiewicz, S., Koller, D., Pereira, L., Ginzton, M., Anderson, S., Davis, J., Ginsberg, J., Shade, J., Fulk, D.: The digital Michelangelo project: 3D scanning of large statues. In: SIGGRAPH 2000, July, pp. 131–144 (2000)Google Scholar
- 4.Nishino, K., Ikeuchi, K.: Robust Simultaneous Registration of Multiple Range Images Comprising A Large Number of Points. In: ACCV 2002 (2002)Google Scholar
- 5.Pulli, K.: Surface Reconstruction and Display from Range and Color Data, Ph.D. dissertation, University of Washington (1997)Google Scholar
- 6.Szeliski, R., Shum, H.-Y.: Creating full view panoramic image mosaics and environment maps. In: SIGGRAPH 1997, pp. 251–258 (1997)Google Scholar
- 7.Sharp, G.C., Lee, S.W., Wehe, D.K.: Invariant Features and the Registration of Rigid Bodies. In: IEEE Int’l Conf. on Robotics and Automation, pp. 932–937 (1999)Google Scholar
- 8.Fisher, R.: Projective ICP and Stabilizing Architectural Augmented Reality Overlays. In: Int. Symp. on Virtual and Augmented Architecture (VAA 2001), pp. 69–80 (2001)Google Scholar
- 9.Kim, S., Chang, E., Ahn, C., Woo, W.: Image-based Panoramic 3D Virtual Environment using Rotating Two Multi-view Cameras. In: IEEE Proc. ICIP 2003, vol. 1, pp. 917–920 (2003)Google Scholar
- 10.Zhang, Z.: Flexible camera calibration by viewing a plane from unknown orientations. In: Proc. of the Seventh IEEE Int’l Conf., vol. 1, pp. 666–673 (1999)Google Scholar
- 11.Manjunath, B.S., Ma, W.Y.: Texture features for browsing and retrieval of large image data. IEEE Trans on PAMI 18(8), 837–842 (1996)Google Scholar
- 12.Point Grey Research Inc. (2002), http://www.ptgrey.com