Abstract
Direct use of denoising and mesh reconstruction algorithms on point clouds originating from multi-view images is often oblivious to the reprojection error. This can be a severe limitation in applications which require accurate point tracking, e.g., metrology.
In this paper, we propose a method for improving the quality of such data without forfeiting the original matches. We formulate the problem as a robust smoothness cost function constrained by a bounded reprojection error. The arising optimization problem is addressed as a sequence of unconstrained optimization problems by virtue of the barrier method. Substantiated experiments on synthetic and acquired data compare our approach to alternative techniques.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Triggs, B., McLauchlan, P., Hartley, R., Fitzgibbon, A.: Bundle adjustment – a modern synthesis. Vision algorithms: Theory and Practice, 153–177 (2000)
Kazhdan, M., Bolitho, M., Hoppe, H.: Poisson surface reconstruction. In: Proceedings of the Fourth Eurographics Symposium on Geometry Processing, SGP 2006. Eurographics Association, pp. 61–70 (2006)
Lempitsky, V., Boykov, Y.: Global optimization for shape fitting. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2007, pp. 1–8 (2007)
Furukawa, Y., Ponce, J.: Accurate, dense, and robust multiview stereopsis. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 1362–1376 (2010)
Lhuillier, M., Quan, L.: Match propogation for image-based modeling and rendering. IEEE Trans. Pattern Anal. Mach. Intell. 24, 1140–1146 (2002)
Hartley, R., Zisserman, A.: Multiple view geometry in computer vision, vol. 2. Cambridge Univ. Press (2000)
Seitz, S.M., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-view stereo reconstruction algorithms. In: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2006, pp. 519–528 (2006)
Fua, P.: Using model-driven bundle-adjustment to model heads from raw video sequences. In: The Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 1, pp. 46–53 (1999)
Fua, P.: Regularized bundle-adjustment to model heads from image sequences without calibration data. International Journal of Computer Vision 38, 153–171 (2000)
Kume, H., Taketomi, T., Sato, T., Yokoya, N.: Extrinsic camera parameter estimation using video images and gps considering gps positioning accuracy. In: Proceedings of the 2010 20th International Conference on Pattern Recognition, ICPR 2010, pp. 3923–3926. IEEE Computer Society (2010)
Lhuillier, M.: Fusion of gps and structure-from-motion using constrained bundle adjustments. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition, CVPR, pp. 3025–3032. IEEE (2011)
Taubin, G.: A signal processing approach to fair surface design. In: Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, pp. 351–358. ACM (1995)
Desbrun, M., Meyer, M., Schröder, P., Barr, A.: Implicit fairing of irregular meshes using diffusion and curvature flow. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 317–324 (1999)
Fleishman, S., Drori, I., Cohen-Or, D.: Bilateral mesh denoising. ACM Transactions on Graphics (TOG) 22, 950–953 (2003)
Jones, T.R., Durand, F., Desbrun, M.: Non-iterative, feature-preserving mesh smoothing. ACM Transactions on Graphics (TOG) 22, 943–949 (2003)
Weyrich, T., Pauly, M., Keiser, R., Heinzle, S., Scandella, S., Gross, M.: Post-processing of scanned 3d surface data. In: Symposium on Point-Based Graphics, vol. 1 (2004)
Schall, O., Belyaev, A., Seidel, H.: Robust filtering of noisy scattered point data. In: IEEE Eurographics/IEEE VGTC Symposium Proceedings, pp. 71–144 (2005)
Ferrari, V., Tuytelaars, T., Van Gool, L.: Simultaneous Object Recognition and Segmentation by Image Exploration. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3021, pp. 40–54. Springer, Heidelberg (2004)
Nocedal, J., Wright, S.J.: Numerical optimization. Springer (1999)
Hoppe, H., DeRose, T., Duchamp, T., McDonald, J., Stuetzle, W.: Surface reconstruction from unorganized points. SIGGRAPH Comput. Graph. 26, 71–78 (1992)
Avron, H., Sharf, A., Greif, C., Cohen-Or, D.: ł1-sparse reconstruction of sharp point set surfaces. ACM Transactions on Graphics (TOG) 29, 135:1–135:12 (2010)
Luenberger, D.G., Ye, Y.: Linear and nonlinear programming, vol. 116. Springer (2008)
Press, W.H., Teukolsky, S.A., Vetterling, W.T., Flannery, B.P.: Numerical Recipes: The Art of Scientific Computing, 3rd edn. Cambridge University Press (2007)
Blender, http://www.blender.org
Heckbert, P.S., Garland, M.: Optimal triangulation and quadric-based surface simplification. Comput. Geom. Theory Appl. 14(1-3), 49–65 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liu, K., Zayer, R. (2012). Bundle Adjustment Constrained Smoothing for Multi-view Point Cloud Data. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2012. Lecture Notes in Computer Science, vol 7431. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33179-4_13
Download citation
DOI: https://doi.org/10.1007/978-3-642-33179-4_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33178-7
Online ISBN: 978-3-642-33179-4
eBook Packages: Computer ScienceComputer Science (R0)