Skip to main content
Log in

Surface completion for shape and appearance

  • original article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

In this paper, we present a new surface content completion system that can effectively repair both shape and appearance from scanned, incomplete point set inputs. First, geometric holes can be robustly identified from noisy and defective data sets without the need for any normal or orientation information. The geometry and texture information of the holes can then be determined either automatically from the models’ context, or interactively from users’ selection. We use local parameterizations to align patches in order to extract their curvature-driven digital signature. After identifying the patch that most resembles each hole region, the geometry and texture information can be completed by warping the candidate region and gluing it onto the hole area. The displacement vector field for the exact alignment process is computed by solving a Poisson equation with boundary conditions. Our experiments show that the unified framework, founded upon the techniques of deformable models, local parameterization, and PDE modeling, can provide a robust and elegant solution for content completion of defective, complex point surfaces.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Amenta, N., Bern, M., Kamvysselis, M.: A new Voronoi-based surface reconstruction algorithm. Proc. SIGGRAPH, pp. 415–421 (1998)

  2. Bajaj, C.L., Bernardini, F., Xu, G.: Automatic reconstruction of surfaces and scalar fields from 3D scans. Proc. SIGGRAPH, pp. 109–118 (1995)

  3. Bernardini, F., Mittleman, J., Rushmeier, H., Silva, C., Taubin, G.: The ball-pivoting algorithm for surface reconstruction. IEEE Trans. Vis. Comput. Graph. 4, 349–359 (1999)

    Google Scholar 

  4. Biermann, H., martin, I., Bernardini, F., Zorin, D.: Cut-and-paste editing of multiresolution surfaces. ACM Trans. Graph. 21(3), 312–321 (2002)

  5. Carr, J.C., Beatson, R.K., Cherrie, J.B., Mitchell, T.J., Fright, W.R., McCallum, B.C., Evans, T.R.: Reconstruction and representation of 3D objects with radial basis functions. Proc. SIGGRAPH, pp. 67–76 (2001)

  6. Clarenz, U., Diewald, U., Dziuk, G., Rumpf, M., Rusu, R.: A finite element method for surface restoration with smooth boundary conditions. Comput. Aided Geom. Des. 5, 427–445 (2004)

    Google Scholar 

  7. Davis, J., Marschner, S.R., Garr, M., Levoy, M.: Filling holes in complex surfaces using volumetric diffusion. Proceedings International Symposium on 3D Data Processing, Visualization, and Transmission, Padova, Italy, June 19–21, 2002, pp. 428–438. IEEE Computer Society (2002)

  8. Desbrun, M., Meyer, M., Schröder, P., Barr, A.H.: Implicit fairing of irregular meshes using diffusion and curvature flow. Proc. SIGGRAPH, pp. 317–324 (1999)

  9. Edelsbrunner, H., Mucke, E.P.: Three-dimensional alpha shapes. ACM Trans. Graph. 13(1), 43–72 (1994)

    Google Scholar 

  10. Fu, H., Tai, C., Zhang, H.: Topology-free cut-and-paste editing over meshes. Proceedings: Geometric Modeling and Processing, Beijing, China, April 13–15, 2004, pp. 173–182. IEEE Computer Society (2004)

  11. Hoppe, H., DeRose, T., Duchamp, T., McDonald, J., Stuetzle, W.: Surface reconstruction from unorganized points. Proc. SIGGRAPH, pp. 71–78 (1992)

  12. Johnson, A.E., Kang, S.B.: Registration and integration of textured 3D data. Proceedings International Conference on Recent Advances in 3D Digital Imaging and Modeling, Ottawa, Canada, May 12–15, 1997, pp. 234–241. IEEE Computer Society (1997)

  13. Ju, T.: Robust repair of polygonal models. ACM Trans. Graph. 23(3), 888–895 (2004)

    Google Scholar 

  14. Kass, M.A.W., Terzopoulos, D.: Snakes: active contour models. Int. J. Comput. Vis. 1(4), 321–331 (1987)

    Google Scholar 

  15. Kraevoy, V., Sheffer, A.: Template-based mesh completion. Proceedings of Eurographics Symposium on Geometry Processing, pp. 13–22 (2005)

  16. Masuda, T.: Filling the signed distance field by fitting local quadrics. Proceedings International Symposium on 3D Data Processing, Visualization, and Transmission, pp. 1003–1010 (2004)

  17. Mortensen, E.N., Barrett, W.A.: Interactive segmentation with intelligent scissors. Graph. Models 60(5), 349–384 (1998)

    Google Scholar 

  18. Levin, D.: The Approximation power of moving least-squares. Mathematics of Computation, 67(224), 1517–1531 (1998)

  19. Pauly, M., Mitra, N.J., Giesen, J., Gross, M., Guibas, L.J.: Example-based 3D scan completion. Proceedings Eurographics Symposium on Geometry Processing, pp. 23–32 (2005)

  20. Podolak, J., Rusinkiewicz, S.: Atomic volumes for mesh completion. Proceedings Eurographics Symposium on Geometry Processing, pp. 33–41 (2005)

  21. Ohtake, Y., Belyaev, A., Alexa, M., Turk, G., Seidel, H.P.: Multi-level partition of unity implicits. ACM Trans. Graph. 22(3), 463–470 (2003)

    Google Scholar 

  22. Page, D.L., Koschan, A., Sun, Y., Pail, J., Abidi, M.A.: Robust crease detection and curvature estimation of piecewise smooth surfaces from triangle mesh approximations using normal voting. Proceedings International Conference on Computer Vision and Pattern Recognition, Vol. 1, pp. 162–167 (2001)

  23. Perez, P., Gangnet, M., Blake, A.: Poisson image editing. ACM Trans. Graph. 22(3), 313–318 (2003)

    Google Scholar 

  24. Sharf, A., Alexa, M., Cohen-Or, D.: Context-based surface completion. ACM Trans. Graph. 23, 878–887 (2004)

    Google Scholar 

  25. Savchenko, V., Kojekine, N.: An approach to blend surfaces. Proc. Computer Graphics International, Bradford, UK, July 1–5 (2002)

  26. Taubin, G.: Estimating the tensor of curvature of a surface from a polyhedral approximation. Proceedings International Conference on Computer Vision, pp. 902–907 (1995)

  27. Verdera, J., Caselles, V., Bertalmío, M., Sapiro, G.: Inpainting surface holes. Proceedings International Conference on Image Processing, Barcelona, Spain, Sept. 14–17, 2003. IEEE Computer Society (2003)

  28. Wang, B., Wang, W., Yang, H., Sun, J.: Efficient example-based painting and synthesis of 2d directional texture. IEEE Trans. Vis. Comput. Graph. 10(3), 266–277 (2004)

    Google Scholar 

  29. Soler, C., Cani, M.P., Angelidis, A.: Hierarchical pattern mapping. ACM Trans. Graph. 21(3), 673–680 (2002)

    Google Scholar 

  30. Whitaker, R.T.: A level-set approach to 3d reconstruction from range data. Int. J. Comput. Vis. 3, 203–231 (1998)

    Google Scholar 

  31. Xie, H., McDonnell, K., Qin, H.: Surface reconstruction of noisy and defective data sets. Proc. Visualization, Austin, TX, Oct. 10–15, 2004, pp. 259–266. IEEE Computer Society (2004)

  32. Yu, Y., Zhou, K., Xu, D., Shi, X., Bao, H., Guo, B., Shum, H.Y.: Mesh editing with poisson-based gradient field manipulation. ACM Trans. Graph. 23, 644–651 (2004)

    Google Scholar 

  33. Zhao, H.K., Osher, S., Fedkiw, R.: Fast surface reconstruction using the level set method. Proceedings IEEE Workshop on Variational and Level Set Methods, p. 194 (2001)

  34. Zwicker, M., Pauly, M., Knoll, O., Gross, M.: Pointshop3d: an interactive system for point-based surface editing. Proceedings SIGGRAPH, pp. 322–329 (2002)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Seyoun Park.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Park, S., Guo, X., Shin, H. et al. Surface completion for shape and appearance. Visual Comput 22, 168–180 (2006). https://doi.org/10.1007/s00371-006-0374-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-006-0374-y

Keywords

Navigation