A Triangle Mesh Reconstruction Method Taking into Account Silhouette Images

  • Michihiro MikamoEmail author
  • Yoshinori Oki
  • Marco Visentini-Scarzanella
  • Hiroshi Kawasaki
  • Ryo Furukawa
  • Ryusuke Sagawa
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9431)


In this paper, we propose a novel approach to reconstruct triangle meshes from point sets by taking the silhouette of the target object into consideration. Recently, many approaches have been proposed for complete 3D reconstruction of moving objects. For example, motion capture techniques are used to acquire 3D data of human motion. However, it needs to attach markers onto the joints, which results in limiting the capturing environments and the number of data that can be acquired. In contrast, to obtain dense data of 3D object, multi-view stereo scanning system is one of the powerful methods. It utilize images taken by several directions and enables to reconstruct 3D dense point sets by using Epipolar geometry. However, it is still challenging problem to reconstruct 3D triangle mesh from the 3D point sets due to the abundant points originated by mismatched points between images. We propose a novel approach to obtain more accurate triangle mesh reconstruction method than the previous one. We take advantage of silhouette images acquired in the process of reconstructing 3D point sets that result in removing noises and compensating holes. Finally, we demonstrate that the proposed method can generate the details of the surface, where the previous method loses from a small number of points.


Active measurement system Projector-camera system Entire 3D shape Multi-view image reconstruction 


  1. 1.
    Boissonnat, J.-D.: Geometric structures for three-dimensional shape representation. ACM Trans. Graph. 3(4), 266–286 (1984)CrossRefGoogle Scholar
  2. 2.
    Boykov, Y., Lempitsky, V.: From photohulls to photoflux optimization. In: Proceedings of British Machine Vision Conference, vol. 3, pp. 1149–1158 (2006)Google Scholar
  3. 3.
    Broadhurst, A., Drummond, T.W., Cipolla, R.: A probablistic framewrok for space carving. In: Proceedings of IEEE International Conference on Computer Vision, pp. 388–393 (2001)Google Scholar
  4. 4.
    Edelsbrunner, H., Mücke, E.P.: Three-dimensional alpha shapes. ACM Trans. Graph. 13(1), 43–72 (1994)CrossRefzbMATHGoogle Scholar
  5. 5.
    Esteban, C.H., Schmitt, F.: Silhouette and stereo fusion for 3d object modeling. Comput. Vis. Image Underst. 96(3), 367–392 (2004)CrossRefGoogle Scholar
  6. 6.
    Faugeras, O., Keriven, R.: Variational principles, surface evolution, pdes, level set methods, and the stereo problem. Trans. Image Process. 7(3), 336–344 (1998)MathSciNetCrossRefzbMATHGoogle Scholar
  7. 7.
    Furukawa, R., Sagawa, R., Delaunoy, A., Kawasaki, H.: Multiview projectors/cameras system for 3d reconstruction of dynamic scenes. In: Proceedings of 4DMOD Workshop on Dynamic Shape Capture and Analysis, pp. 1602–1609 (2011)Google Scholar
  8. 8.
    Furukawa, Y., Ponce, J.: Accurate, dense, and robust multi-view stereopsis. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1362–1376 (2007)Google Scholar
  9. 9.
    Furukawa, Y., Ponce, J.: Carved visual hulls for image-based modeling. Int. J. Comput. Vis. 81(1), 53–67 (2009)CrossRefGoogle Scholar
  10. 10.
    Kasuya, N., Sagawa, R., Furukawa, R., Kawasaki, H.: One-shot entire shape scanning by utilizing multiple projector-camera constraints of grid patterns. In: Proceedings of IEEE International Conference on Computer Vision Workshops, pp. 299–306 (2013)Google Scholar
  11. 11.
    Kazhdan, M., Bolitho, M., Hoppe, H.: Poisson surface reconstruction. In: Proceedings of the Fourth Eurographics Symposium on Geometry Processing, SGP 2006, pp. 61–70 (2006)Google Scholar
  12. 12.
    Kolluri, R., Shewchuk, J.R., O’Brien, J.F.: Spectral surface reconstruction from noisy point clouds. In: Proceedings of Eurographics/ACM SIGGRAPH Symposium on Geometry Processing, pp. 11–21 (2004)Google Scholar
  13. 13.
    Labatut, P., Pons, J.-P., Keriven, R.: Efficient multi-view reconstruction of large-scale scenes using interest points, delaunay triangulation and graph cuts. In: Proceedings of IEEE 11th International Conference, pp. 1–8 (2007)Google Scholar
  14. 14.
    Laurentini, A.: The visual hull concept for silhouette-based image understanding. IEEE Trans. Pattern Anal. Mach. Intell. 16(2), 150–162 (1994)CrossRefGoogle Scholar
  15. 15.
    Lourakis, M.I.A., Argyros, A.A.: Sba: a software package for generic sparse bundle adjustment. ACM Trans. Math. Softw. 36(1), 1–2 (2009)MathSciNetCrossRefGoogle Scholar
  16. 16.
    Matusik, W., Buehler, C., Raskar, R., Gortler, S.J., McMillan, L.: Image-based visual hulls. ACM Trans. Graph. 6, 369–374 (2000)Google Scholar
  17. 17.
  18. 18.
    Oki, Y., Visentini-Scarzanella, M., Wada, T., Furukawa, R., Kawasaki, H.: Entire shape scan system with multiple pro-cams using texture information and accurate silhouette creating technique. In: Proceedings of the 14th IAPR International Conference Machine Vision Applications, pp. 18–21 (2015)Google Scholar
  19. 19.
    Seitz, S.M., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-view stereo reconstruction algorithms. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 519–528 (2006)Google Scholar
  20. 20.
    The Computational Geometry Algorithms Library.
  21. 21.
    Thibault, Y., Kawasaki, H., Sagawa, R.,. Furukawa, R.: Exemplar based texture recovery technique for active one shot scan. In: Proceedings of the 13th IAPR Conference on Machine Vision Applications, pp. 331–334 (2013)Google Scholar
  22. 22.
    Yoon, K.-J., Kweon, I.S.: Adaptive support-weight approach for correspondence search. IEEE Trans. Pattern Anal. Mach. Intell. 28(4), 650–656 (2006)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Michihiro Mikamo
    • 1
    Email author
  • Yoshinori Oki
    • 1
  • Marco Visentini-Scarzanella
    • 1
  • Hiroshi Kawasaki
    • 1
  • Ryo Furukawa
    • 2
  • Ryusuke Sagawa
    • 3
  1. 1.Graduate School of Science and EngineeringKagoshima UniversityKagoshimaJapan
  2. 2.Graduate School of Information SciencesHiroshima City UniversityHiroshimaJapan
  3. 3.National Institute of Advanced Industrial Science and TechnologyTokyoJapan

Personalised recommendations