Natural-Textured Mesh Stream Modeling from Depth Image-Based Representation

  • Seung Man Kim
  • Jeung Chul Park
  • Kwan H. Lee
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3980)


This paper presents modeling techniques to generate natural-textured 3D mesh stream from depth image-based representation (DIBR). Although DIBR is a useful representation for expressing 2.5D information of dynamic real objects, its usage is limited to point-based applications. In order to generate smooth and textured 3D mesh models, depth images are captured using active depth sensors, and they are processed with segmentation, noise filtering, and adaptive sampling technique based on the depth variation. 3D meshes are reconstructed by constrained Delaunay triangulation and smoothened with the 3D Gaussian filter. Each mesh model is parameterized for texture mapping of a corresponding color image. Proposed procedures are automated to generate 3D mesh stream from hundreds of image sequence without user interventions. Final output is a natural-textured mesh model per frame, which can be used for arbitrary view synthesis in virtual reality or broadcasting applications.


Depth Image Mesh Model Adaptive Sampling Gaussian Smoothing Depth Video 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Smolic, A., Mueller, K., Merkle, P., Rein, T., Eisert, P., Wiegand, T.: Free Viewpoint Video Extraction, Representation, Coding, and Rendering. In: ICIP 2004, IEEE International Conference on Image Processing, Singapore, October 24-27 (2004)Google Scholar
  2. 2.
    Thomas, G.A., Grau, O.: 3D Image Sequence Acquisition for TV and Film Production. In: Conference Proc. of 1st Symp. on 3D Data Processing Visualization Transmission (2002)Google Scholar
  3. 3.
    Bazzoni, G., Bianchi, E., Grau, O., et al.: The Origami Project: Advanced Tools and Techniques for High-end Mixing and Interaction between Real and Virtual Content. In: Conference Proc. of 1st Symp. on Data Processing Visualization Transmission (2002)Google Scholar
  4. 4.
    Remondino, F., Roditakis, A.: 3D Reconstruction of human skeleton from single images or monocular video sequences. In: Michaelis, B., Krell, G. (eds.) DAGM 2003. LNCS, vol. 2781, pp. 100–107. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  5. 5.
    Matsuyama, T., Wu, X., Takai, T., Nobuhara, S.: Real-Time 3D Shape Reconstruction, Dynamic 3D Mesh Deformation, and High Fidelity Visualization for 3D Video. International Journal on Computer Vision and Image Understanding 96(3), 393–434 (2004)CrossRefGoogle Scholar
  6. 6.
    Kiriakos, K., Seitz, S.M.: A Theory of Shape by Space Carving. International Journal of Computer Vision 38(3), 199–218 (2000)MATHCrossRefGoogle Scholar
  7. 7.
    Debevec, P., Tayler, C., Malik, J.: Modeling and Rendering Architecture from Photographs: A Hybrid Geometry- and Image-based Approach. In: Proceedings of SIGGRAPH 1996, pp. 11–20 (1996)Google Scholar
  8. 8.
    Niem, W.: Robust and Fast Modelling of 3D Natural Objects from Multiple Views. In: SPIE Proceedings, vol. 2182, pp. 388–397 (1994)Google Scholar
  9. 9.
    Carranza, J., Theobalt, C., Magnor, M.A., Seidel, H.P.: Free-viewpoint video of human actors. ACM Transactions on Graphics 22(3), 569–577 (2003)CrossRefGoogle Scholar
  10. 10.
    Grau, O., Price, M., Thomas, G.A.: Use of 3d techniques for virtual production. in Proc. of SPIE. In: Conference Proc. of Videometrics and Optical Methods for 3D Shape Measurement, vol. 4309 (2001)Google Scholar
  11. 11.
    Allen, B., Curless, B., Popovic, Z.: The space of human body shapes: reconstruction and parameterization from range scans. ACM Transactions on Graphics 22(3), 587–594 (2003)CrossRefGoogle Scholar
  12. 12.
    Moccozet, L., Dellas, F., Magnenat-Thalmann, N., Biasotti, S., Mortara, M., Falcidieno, B., Min, P., Veltkamp, R.: Animatable Human Body Model Reconstruction from 3D Scan Data using Templates. In: Proc. CapTech Workshop on Modelling and Motion Capture Techniques for Virtual Environments (2004)Google Scholar
  13. 13.
  14. 14.
    Ignatenko, A., Konushin, A.: A Framework for Depth Image-Based Modeling and Rendering. In: Proc. Graphicon 2003, pp. 169–172 (2003)Google Scholar
  15. 15.
    Jain, A.K.: Fundamentals of Digital Image Processing. Prentice-Hall, Inc., Englewood Cliffs (1989)MATHGoogle Scholar
  16. 16.
    Domiter, V.: Constrained Delaunay triangulation using plane subdivision. In: Proceedings of the 8th Central european seminar on computer graphics, Budmerice, April 19-21, pp. 105–110 (2004)Google Scholar
  17. 17.
    Eck, M., DeRose, T., Duchamp, T., Hoppe, H., Lounsbery, M., Stuetzle, W.: Multiresolution Analysis of Arbitrary Meshes. In: Proceeding SIGGRAPH 1995, pp. 173–182 (1995)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Seung Man Kim
    • 1
  • Jeung Chul Park
    • 1
  • Kwan H. Lee
    • 1
  1. 1.Department of MechatronicsGwangju Institute of Science and Technology (GIST), Intelligent Design and Graphics laboratoryGwangjuKorea

Personalised recommendations