Abstract
The surface reconstruction of 3D objects has attracted more and more attention for its widespread application in many areas, such as computer science, cultural heritage restoration, medical facilities, entertainment. However, due to occlusion, reflectance, the scanning angle, raw data preprocessing, it is inevitable to lose some point data, which leads to holes in the reconstruction surface, making it undesirable for various applications. Therefore, methods for filling holes in the process of surface reconstruction are critical to the final results of reconstruction. This paper makes a survey of existing well-known hole-filling algorithms, classifies the algorithms into two main categories, analyzes and compares these algorithms from the viewpoints of theories and experimental results to make a clear introduction of their performance. At the end, the paper points out the possible development direction of hole filling in the future and hopes to be a good guide for other researchers.
Similar content being viewed by others
References
Kirkvik, A.S.: Completing a model based on laser scan generated point cloud data. Institutt for Datateknikk Og Informasjonsvitenskap (2010)
Rudolf, F., Weinbub, J., Rupp, K., Resutik, P., Morhammer, A., Selberherr, S.: Free open source mesh healing for TCAD device simulations. In: Lirkov, I., Margenov, S. D., Waśniewski, J. (eds.) Large-Scale Scientific Computing, vol.9374, pp. 293–300 Springer, Switzerland (2015). doi:10.1007/978-3-319-26520-9_32
Bendels, Gerhard H., Schnabel, R., Klein, R.: Detecting holes in point set surfaces. J. Wscg 14 (2006)
Xie, H., McDonnell, T., Qin, H.: Surface reconstruction of noisy and defective data sets. In Visualization, IEEE, pp. 259–266 (2004)
Weber, C., Hahmann, S., Hagen, H.: Sharp feature detection in point clouds. In: Proceedings of the 2010 Shape Modeling International Conference, pp. 175–186. IEEE Computer Society, Washington, DC (2010)
Tran, T.T., Cao, V.T., Laurendeau, D.: Extraction of reliable primitives from unorganized point clouds. 3D Res. 6(4), 1–12 (2015)
Franchini, E., Morigi, S., Sgallari, F.: Implicit shape reconstruction of unorganized points using PDE-based deformable 3D manifolds. Numer. Math. Theory Methods Appl. 3(4), 405–430 (2010)
Casciola, G., Lazzaro, D., Montefusco, L.B., Morigi, S.: Fast surface reconstruction and hole filling using positive definite radial basis functions. Numer. Algorithms 39(1–3), 289–305 (2005)
Park, S., Guo, X., Shin, H., Qin, H.: Surface completion for shape and appearance. Vis. Comput. 22(3), 168–180 (2006)
Sharf, A., Alexa, M., Cohen-Or, D.: Context-based surface completion. ACM Trans. Graph. (TOG) 23(3), 878–887 (2004)
Wang, J., Oliveira, M.: A hole-filling strategy for reconstruction of smooth surfaces in range images. In: Computer Graphics and Image Processing. SIBGRAPI 2003. XVI Brazilian Symposium, pp. 11–18. IEEE (2003)
Hoppe, H., DeRose, T., Duchamp, T., McDonald, J., Stuetzle, W.: Surface reconstruction from unorganized points, vol. 26, No. 2, pp. 71–78. ACM (1992)
Chalmoviansky, P., Jttler, B.: Filling holes in point clouds. In: Mathematics of Surfaces, pp. 196–212. Springer, Berlin, Heidelberg (2003)
Wu, X., Chen, W.: A scattered point set hole-filling method based on boundary extension and convergence. In: Intelligent Control and Automation (WCICA), 2014 11th World Congress on (pp. 5329-5334). IEEE.(2014)
Doria, D., Radke, R.J.: Filling large holes in lidar data by inpainting depth gradients. In: 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pp. 65–72. IEEE (2012)
Yang, N.E., Kim, Y.G., Park, R.H.: Depth hole filling using the depth distribution of neighboring regions of depth holes in the Kinect sensor. In: Signal Processing, Communication and Computing (ICSPCC), 2012 IEEE International Conference, pp. 658-661. IEEE (2012)
Jun, Y.: A piecewise hole filling algorithm in reverse engineering. Comput. Aided Des. 37(2), 263–270 (2005)
Qiang, H., Shusheng, Z., Xiaoliang, B., et al.: Hole filling based on local surface approximation. In: Computer Application and System Modeling (ICCASM), International Conference, vol. 3, pp. V3-242–V3-245. IEEE (2010)
Attene, M., Campen, M., Kobbelt, L.: Polygon mesh repairing: an application perspective. ACM Comput. Surv. (CSUR) 45(2), 15 (2013)
Davis, J., Marschner, S.R., Garr, M., Levoy, M.: Filling holes in complex surfaces using volumetric diffusion. In: 3D Data Processing Visualization and Transmission. Proceedings. IEEE. First International Symposium, pp. 428–441 (2002)
Ju, T.: Robust repair of polygonal models. In: ACM Transactions on Graphics (TOG), vol. 23, No. 3, pp. 888–895 (2004)
Guo, T.Q., Li, J.J., Weng, J.G., Zhuang, Y.T.: Filling holes in complex surfaces using oriented voxel diffusion. In: Machine Learning and Cybernetics, 2006 International Conference, pp. 4370–4375. IEEE (2006)
Centin, Marco, Pezzotti, Nicola, Signoroni, Alberto: Poisson-driven seamless completion of triangular meshes. Comput. Aided Geom. Des. 35, 42–55 (2015)
Liepa, P.: Filling holes in meshes. In: Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing, pp. 200–205. Eurographics Association (2003)
Attene, M.: A lightweight approach to repairing digitized polygon meshes. Vis. Comput. 26(11), 1393–1406 (2010)
Wei, M., Wu, J., Pang, M.: An integrated approach to filling holes in meshes. In: Artificial Intelligence and Computational Intelligence (AICI), 2010 International Conference, vol. 3, pp. 306–310. IEEE (2010)
Harary, G., Ayellet T., Grinspun, E.: Context-based coherent surface completion. ACM Trans. Graph. (TOG) 33(1), 5 (2014)
Branch, J., Prieto, F., Boulanger, P.: Automatic hole-filling of triangular meshes using local radial basis function. In: 3D Data Processing, Visualization, and Transmission, Third International Symposium, pp. 727–734. IEEE (2006)
Tekumalla, L.S., Elaine, C.: Reverse engineering point clouds to fit tensor product B-spline surfaces by blending local fits. arXiv:1411.5993 (2014)
Dellepiane, M., Venturi, A., Scopigno, R.: Image guided reconstruction of un-sampled data: a coherent filling for uncomplete Cultural Heritage models. In: Computer Vision Workshops (ICCV Workshops), 2009 IEEE 12th International Conference, pp. 939–946. IEEE (2009)
Quinsat, Y.: Filling holes in digitized point cloud using a morphing-based approach to preserve volume characteristics[J]. Int. J. Adv. Manuf. Technol. 81(1–4), 411–421 (2015)
Acknowledgments
This work is supported by the National Natural Science Foundation of China (No. 61471338), President Fund of UCAS, Youth Innovation Promotion Association CAS (2015361).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Guo, X., Xiao, J. & Wang, Y. A survey on algorithms of hole filling in 3D surface reconstruction. Vis Comput 34, 93–103 (2018). https://doi.org/10.1007/s00371-016-1316-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-016-1316-y