Skip to main content

Advertisement

SpringerLink
Log in

Genetic algorithms and bundle adjustment for the enhancement of 3D reconstruction

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, we present a new technique of tridimensional reconstruction from a sequence of uncalibrated stereo images taken with cameras having varying parameters. At first, our system allows to recover initial coordinates of a set of 3D points. In this context, we have used our method of self-calibration based on the use of unknown 3D scene with its image projections and genetic algorithms to estimate all intrinsic parameters. After that extrinsic parameters are estimated based on classical pose estimation algorithms. Matching points and estimated value of intrinsic and extrinsic parameters are used to estimate initial 3D model that helps us in the initialization step. In order to have a reliable and relevant 3D reconstruction the proposed method is based on good and new exploitation of bundle adjustment (without camera poses initialization) technique based on Levenberg-Marquardt optimization with the aim to estimate our optimal 3D model that has special features compared to the classical case because it masks the pose parameters estimation in the optimization process. Finally, 3D mesh of the 3D scene is constructed with Delaunay algorithm and the 2D image is projected on the 3D model to generate the texture mapping. Experiments is conducted on real data to achieve demonstrate the validity and the performance of the proposed approach in terms of convergence, simplicity, stability and reconstruction quality.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. M.A. Ameller, A. Bartoliet, and L. Quan, “Minimal metric structure and motion from three affine images,” In Proc of the Fifth Asian Conference on Computer Vision, Melbourne, Australia, Volume 1, p:356–361, Jaunuary 2002

  2. Armstrong M, Zisserman A, Hartley R (1996) Self-calibration from image triplets. In: Buxton B, Cipolla R (eds) Proceedings of the 4th European conference on computer vision, Cambridge, England, volume 1064 of lecture notes in computer science, pages 3.16. Springer- Verlag, April

    Google Scholar 

  3. Baataoui, A., El batteoui, I., Saaidi, A., Satori, K. (2012) Camera self calibration by an equilateral triangle. Int J Comput Appl., 29–34

  4. P. Beardsley, P. Torr, and A. Zisserman. 3D Model Acquisition From Extended Image Sequences. In Proc. of ECCV’96, pages 683–695, 1996

  5. Blumenthal-Barby DC, Eisert P (2014) High resolution depth for binocular image-based modeling. Comput Graph 39:89–100

    Article  Google Scholar 

  6. Brooks MJ, de Agapito L, Huynh DQ, Baumela L (1996) Direct methods for self-calibration of a moving stereo head. In: Buxton B, Cipolla R (eds) Proceedings of the 4th European conference on computer vision, Cambridge, England, volume 1065 of lecture notes in computer science, pages 415.426. Springer-Verlag, April

    Google Scholar 

  7. M.J. Brooks, W. Chojnacki, and L. Baumela. Determining the ego-motion of an uncalibrated camera from instantaneous optical flow. Journal of the Optical Society of America, 14(10), October 1997

  8. Cao X, Xiao J, Foroosh H, Shah M (2006) Self-calibration from turn-table sequences in presence of zoom and focus. Comput Vis Image Underst 103(2):227–237

    Article  Google Scholar 

  9. Cazals F, Giesen J (2004) Delaunay triangulation based surface reconstruction: ideas and algorithms. Technical report, RR-5393, INRIA

  10. Cefalu A, Haala N, Fritsch D (2016) Structureless bundle adjustment with self-calibration using accumulated constraints. ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences, pp 3–9

    Google Scholar 

  11. Chambon, S., Crouzil, A. (2004) “Correlation measures for color images ”. In traitement du signal 2004_volume 21_numéro spécial L'image numérique couleur

  12. Chambon S, Crouzil A (2011) Similarity measures for image matching despite occlusions in stereo vision. Pattern Recogn 44(9):2063–2075

    Article  Google Scholar 

  13. Cornou, S., Dhome, M., & Sayd, P. (2002). Bundle adjustment: a fast method with weak initialisation. In Proceedings of the British machine vision conference 2002

    Google Scholar 

  14. David P, Dementhon D, Duraiswami R, Samet H (2004) SoftPOSIT: simultaneous pose and correspondence determination. Int J Comput Vis 59(3):259–284

    Article  MATH  Google Scholar 

  15. L. S. Davis, D.F. Dementhon. – Model-Based Object in 25 Lines of Code,” International Journal of Computer Vision, pp. 15(2) :123–141, 1995

  16. A. El abderrahmani, A. Saaidi and K. Satori ( December 2010) Robust technique for self-calibration of cameras based on a circle. ICGST-GVIP, Volume 10, Issue 5

  17. El akkad, N., Saaidi, A., Satori, K. (2012) Self-calibration based on a circle of the cameras having the varying intrinsic parameters. In: Proceedings of IEEE International Conference on Multimedia Computing and Systems, pp. 161–166

  18. El Akkad, N., et al. (2016). Reconstruction of 3D scenes by camera self-calibration and using genetic algorithms. 3D research

  19. El Hazzat S, Saaidi A, Satori K (2014) Euclidean 3D reconstruction of unknown objects from multiple images. J Emerg Technol Web Intell 6(1):59–63

    Google Scholar 

  20. El hazzat S., Akkad, N., Saaidi, A., Satori, K..: 3D reconstruction system based on incremental structure from motion using a camera having the varying intrinsic parameters. Visual Computer (2018)

  21. El hazzat, S., Akkad, N., Saaidi, A., Satori, K (2018) Enhancement of sparse 3D reconstruction using a modified match propagation based on particle swarm optimization. Multimedia Tools and Applications

  22. A.Elabderrahmani, A.Saaidi and K.Satori. Planar self-calibration with less constraint. IJCST Vol. 2, Issue 2, June 2011

  23. Fischler MA, Bolles RC (1981) Random sample consensus: aparadigm for model fittingwith applications to image analysis and automated cartography. Commun ACM 24(6):381–395

    Article  Google Scholar 

  24. A. Fitzgibbon and A. Zisserman. Automatic Camera Recovery for Closed or Open Image Sequences. In Proceedings of ECCV’98, pages 311–326, 1998

  25. Gao, Y., Radha, H. (2004) A multistage camera self-calibration algorithm. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp. 537–540

  26. Gouet V, Boujemaa N (2002) About optimal use of color points of interest for content-based image retrieval. Internal Report, INRIA Rocquencourt

    Google Scholar 

  27. P.Gurdjos and P.Sturm (2003) Methods and geometry for plane-based self-calibration. CVPR, pp. 491–496

  28. M. Hanet and T. Kanade, “Multiple motion scene reconstruction from uncalibrated views,” In Proc of the 8th International Conference on computer Vision, Vancouver, Canada, July 2001

  29. Harris C, Stephens M (1988) A combined corner and edge detector. In Alvey Vision Conference

  30. R. Hartley. Euclidean Reconstruction from Uncalibrated Views. In J. Mundy and A. Zisserman, editors, Applications of Invariance in Computer Vision, volume 825 of Lecture Notes in Computer Science, pages 237–256. Springer-Verlag, 1993

  31. Hartley R, Trumpf J, Dai Y, Li H (2013) Rotation averaging. Int J Comput Vis 103(3):p267–p305

    Article  MathSciNet  MATH  Google Scholar 

  32. Hemayed, E.E. (2003) A survey of camera self-calibration. In: Proceedings of the IEEE Conference on Advanced Video and Signal BasedSurveillance, pp. 351–357

  33. J. H. Holland (1975) Adaptation in natural and artificial systems. University Bibliographieof Michigan Press: Ann Arbor

  34. Hu Z, Zhao B (2019) Minimal vision system for linear camera self-calibration and 3D reconstruction using translation platform. Multimed Tools Appl 78:25731–25751. https://doi.org/10.1007/s11042-019-7666-5

    Article  Google Scholar 

  35. Indelman, V., 2012a. Bundle adjustment without iterative structure estimation and its application to navigation. Position location and navigation symposium (PLANS), 2012 IEEE/ION

  36. Indelman, V., Roberts, R., Beall, C., & Dellaert, F., 2012b. Incremental light bundle adjustment. Proceedings of the British machine vision conference (BMVC 2012), pp. 3-7

  37. Jiang, Z., Liu, S.: (2011) The self-calibration of varying internal camera parameters based on image of dual absolute quadric transformation. In: Information and Automation, Communications in Computer and Information Science, vol. 86, pp. 452–461. Springer, Berlin

  38. Jiang Z, Liu S (2012) Self-calibration of varying internal camera parameters algorithm based on quasi-affine reconstruction. J Comput 7(3):774–778

    Article  Google Scholar 

  39. Le V, Tang H, Cao L, Huang T (2010) Accurate and efficient reconstruction of 3D faces from stereo images. In: 17th IEEE international conference on image processing (ICIP), pp 4265-4268, 2010

  40. Liangfu Li, Zuren Feng, Yuanjing Feng. Accurate calibration of stereo cameras for machine vision. JCS&T Vol. 4 No. 3, October 2004

  41. Liu, P., Shi, J., Zhou, J., Jiang, L (2003) Camera self-calibration using the geometric structure in real scenes. In: Proceedings of the Computer Graphics International, pp. 262–265

  42. Lourakis M, Argyros A (Aug. 2005) Efficient. Causal Camera Tracking in Unprepared Environments Computer Vision and Image Understanding Journal 99(2):259–290

    Article  Google Scholar 

  43. Manolis I.A. Lourakis and R. Deriche. (2000) Camera self-calibration using the kruppa equations and the SVD of the fundamental matrix: the case of varying intrinsic parameters. Technical Report 3911, INRIA

  44. Xiaoqiao Meng, Hua Li and Zhanyi Hu. A new easy camera calibration technique based on circular points, bmvc2000

  45. Merras M, Saaidi A, El Akkad N, Satori K (2018) Multi-view 3D reconstruction and modeling of the unknown 3D scenes using genetic algorithms. Soft Comput 22:6271–6289. https://doi.org/10.1007/s00500-017-2966-z

    Article  MATH  Google Scholar 

  46. Pollefeys M, Koch R, Gool LV (1999) Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters. Int J Comput Vis 32(1):7–25

    Article  Google Scholar 

  47. M. Pollefeys, L. V. Gool, M. Vergauwen, F. Verbiest, K. Cornelis, J. Tops, and R. Koch. Visual Modeling With a Hand-Held Camera. IJCV, 59(3):207–232, Sep./Oct. 2004

  48. P. Ram and S. Padmavathi, “ Analysis of Harris Corner Detection For Color Images,” In International conference on Signal Processing, Communication, Power and Embedded System (SCOPES)-2016

  49. Rodriguez, A. L., López-de-Teruel, P. E., & Ruiz, A., 2011a. Reduced epipolar cost for accelerated incremental SfM. Computer vision and pattern recognition (CVPR), 2011 IEEE conference on

  50. Rodriguez, A. L., López-de-Teruel, P. E., & Ruiz, A., 2011b. GEA optimization for live structureless motion estimation. Computer vision and pattern recognition (CVPR), 2011 IEEE conference on

  51. Saaidi A, Halli A, Tairi H, Satori K (2008) Self-calibration using a particular motion of camera. WSEAS Tran Comput Res 3(5):295–299

    Google Scholar 

  52. Saaidi, A., Halli, A., Tairi, H., Satori, K. (2009) Self-calibration using a planar scene and parallelogram. In: ICGST-GVIP, pp. 41–47

  53. B.Satouri, A. Elabderrahmani, H. Tairi and K.satori. Camera Self-Calibration with Varying Intrinsic Parameters by an Unknown Three-Dimensional Scene. International Journal of Advanced Computer Science and Applications (IJACSA), Vol. 7, No. 9, 2016

  54. Shang Y, Yue Z, Chen M, Song Q (2012) A new method of camera self-calibration based on relative lengths. Inf Technol J 11(3):376–379

    Article  Google Scholar 

  55. Steffen, R., Frahm J.-M., & Förstner W., 2010. Relative bundle adjustment based on trifocal constraints. Trends and topics in computer vision. Springer Berlin Heidelberg, 2012. pp. 282–295

  56. Sturm P (2000) A case against Kruppa’s equations for camera selfcalibration. IEEE Trans Pattern Anal Mach Intell 22:1199–1204

    Article  Google Scholar 

  57. Sturm P (2002) Critical motion sequences for the self-calibration of cameras and stereo systems with variable focal length. Image VisComput 20:415–426

    Google Scholar 

  58. Sun J, Hongbin G (2009) Research of linear camera calibration based on planar pattern. World Acad Sci Eng Technol 60

  59. Tarek A. Al-Saeed1, Nahed H. Solouma2, and Said M. El-Sherbiny3. Retinal Motion Detection and 3D Structure Recovery From Two Perspective Views. GVIP Special Issue on Medical Image Processing, March, 2006

  60. Torr PHS, Murray DW (1997) The development and comparison of robust methods for estimating the fundamental matrix. Int JComput Vis 24:271–300

    Article  Google Scholar 

  61. Triggs B (1998) Autocalibration from planar scenes. In: Proceedings of the 5th European Conference on Computer Vision, pp. 89–105

  62. Triggs B, McLauchlan P, Hartley R, Fitzgibbon A (1999) Bundle adjustment – a modern synthesis. In Proceedings of the International Workshop on Vision Algorithms: Theory and Practice, pages 298–372

  63. Triggs B, McLauchlan PF, Hartley RI, Fitzgibbon AW (2000) Bundle adjustment—a modern synthesis. In vision algorithms: theory and practice. Springer, Berlin Heidelberg, pp 298–372

    Book  Google Scholar 

  64. B. Triggs, P. McLauchlan, R. Hartley, A. Fitzgibbon. (2000) Bundle adjustment - a modern synthesis. Vision Algorithms: Theory et Practice,” International Workshop on Vision Algorithms

  65. Triggs, P. McLauchlan, R. Hartley, A. Fitzgibbon (2000) Bundle adjustment - a modern synthesis. Vision Algorithms: Theory et Practice. International Workshop on Vision Algorithms

  66. G. Wang, Q. M. J. Wu. Perspective 3D Euclidean reconstruction with varying camera parameters. IEEE Transactions on Circuits and Systems for Video Technology Vol. 19, N°. 12, pp. 1793–1803. 2009

  67. Wiles C, Brady M (1996) Ground plane motion camera models. In: Buxton B, Cipolla R (eds) Proceedings of the 4th European conference on computer vision, Cambridge, England, volume 1065 of lecture notes in computer science, pages 238.247. Springer-Verlag, April

    Google Scholar 

  68. Zhang W (2005) A simple method for 3D reconstruction from two views. In: GVIP 05 Conference

  69. Zhao Y, Lv XD (2012) An approach for camera self-calibration using vanishing-line. Inf Technol J 112:276–282

    Article  Google Scholar 

  70. Zhao Y, Hu X, Lv X, Wang H (2012) Solving the camera intrinsic parameters with the positive tri-prism based on the circular points. Inf Technol J 11(7):926–930

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. LIIAN, Department of Mathematics and Informatics, Faculty of Sciences Dhar-Mahraz, P.O.Box 1796, Atlas Fes, Morocco

    B. Satouri & K. Satori

  2. LIIAN, Department of Mathematics and Informatics, Larache Poly disciplinary School, Larache, Morocco

    A. El abderrahmani

Authors
  1. B. Satouri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. K. Satori
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. El abderrahmani
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to B. Satouri.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Satouri, B., Satori, K. & El abderrahmani, A. Genetic algorithms and bundle adjustment for the enhancement of 3D reconstruction. Multimed Tools Appl 79, 29265–29288 (2020). https://doi.org/10.1007/s11042-020-09097-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09097-w

Keywords

Search

Navigation