Advertisement

Journal of Central South University

, Volume 24, Issue 5, pp 1063–1072 | Cite as

Automatic three-dimensional reconstruction based on four-view stereo vision using checkerboard pattern

  • Jie Xiong (熊杰)
  • Si-dong Zhong (仲思东)
  • Yong Liu (刘勇)
  • Li-fen Tu (屠礼芬)
Article
  • 60 Downloads

Abstract

An automatic three-dimensional (3D) reconstruction method based on four-view stereo vision using checkerboard pattern is presented. Mismatches easily exist in traditional binocular stereo matching due to the repeatable or similar features of binocular images. In order to reduce the probability of mismatching and improve the measure precision, a four-camera measurement system which can add extra matching constraints and offer multiple measurements is applied in this work. Moreover, a series of different checkerboard patterns are projected onto the object to obtain dense feature points and remove mismatched points. Finally, the 3D model is generated by performing Delaunay triangulation and texture mapping on the point cloud obtained by four-view matching. This method was tested on the 3D reconstruction of a terracotta soldier sculpture and the Buddhas in the Mogao Grottoes. Their point clouds without mismatched points were obtained and less processing time was consumed in most cases relative to binocular matching. These good reconstructed models show the effectiveness of the method.

Key words

three-dimensional reconstruction four-view stereo vision checkerboard pattern dense point 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    OLIVEIRA A, OLIVEIRA J F, PEREIRA J M, ARAÚJO B R D, BOAVIDA J. 3D modelling of laser scanned and photogrammetric data for digital documentation: The Mosteiro da Batalha case study [J]. Journal of Real-Time Image Processing, 2014, 9(4): 673–688.CrossRefGoogle Scholar
  2. [2]
    CHEN Zi-yue, XU Bing, DEVEREUX B. Urban landscape pattern analysis based on 3D landscape models [J]. Applied Geography, 2014, 55: 82–91.CrossRefGoogle Scholar
  3. [3]
    LI Hu, YANG Jian-yu, SU Peng-cheng, WANG Wan-shan. Computer aided modeling and pore distribution of bionic porous bone structure [J]. Journal of Central South University, 2012, 19(12): 3492–3499.CrossRefGoogle Scholar
  4. [4]
    LIU Xi-ling, LI Xi-bing, LI Fa-ben, ZHAO Guo-yan, QIN Yu-hui. 3D cavity detection technique and its application based on cavity auto scanning laser system [J]. Journal of Central South University of Technology, 2008, 15(2): 285–288.CrossRefGoogle Scholar
  5. [5]
    GOMES L, SILVA L, BELLON O R P. 3D reconstruction methods for digital preservation of cultural heritage: A survey [J]. Pattern Recognition Letters, 2014, 50: 3–14.CrossRefGoogle Scholar
  6. [6]
    SON H, KIM C, KIM C. 3D reconstruction of as-built industrial instrumentation models from laser-scan data and a 3D CAD database based on prior knowledge [J]. Automation in Construction, 2015, 49: 193–200.CrossRefGoogle Scholar
  7. [7]
    NEFTI-MEZIANI S, MANZOOR U, DAVIS S, PUPALA S K. 3D perception from binocular vision for a low cost humanoid robot NAO [J]. Robotics & Autonomous Systems, 2015, 68: 129–139.CrossRefGoogle Scholar
  8. [8]
    CHEN Sheng-yong, WANG Yue-hui, CATTANI C. Key issues in modeling of complex 3D structures from video sequences [J]. Mathematical Problems in Engineering, 2012, 2012: 856523.Google Scholar
  9. [9]
    CIACCIO E J, TENNYSON C A, BHAGAT G, LEWIS S K, GREEN P H R. Use of shape-from-shading to estimate three-dimensional architecture in the small intestinal lumen of celiac and control patients [J]. Computer Methods and Programs in Biomedicine, 2013, 111(3): 676–684.CrossRefGoogle Scholar
  10. [10]
    HARO G, PARDÀS M. Shape from incomplete silhouettes based on the reprojection error [J]. Image and Vision Computing, 2010, 28(9): 1354–1368.CrossRefGoogle Scholar
  11. [11]
    THELEN A, FREY S, HIRSCH S, HERING P. Improvements in shape-from-focus for holographic reconstructions with regard to focus operators, neighborhood-size, and height value interpolation [J]. IEEE Transactions on Image Processing, 2009, 18(1): 151–157.MathSciNetCrossRefGoogle Scholar
  12. [12]
    SABATER N, ALMANSA A, MOREL J M. Meaningful matches in stereovision [J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2012, 34(5): 930–942.CrossRefGoogle Scholar
  13. [13]
    SETTI F, BINI R, LUNARDELLI M, BOSETTI P, BRUSCHI S, CECCO M D. Shape measurement system for single point incremental forming (SPIF) manufacts by using trinocular vision and random pattern [J]. Measurement Science and Technology, 2012, 23(11): 115402.CrossRefGoogle Scholar
  14. [14]
    HAERTEL M E M, PINTO T L F C, JÚNIOR A A G. Trinocular stereo system with object space oriented correlation for inner pipe inspection [J]. Measurement, 2015, 73: 162–170.CrossRefGoogle Scholar
  15. [15]
    RASHIDIZAD H, RAHIMI A. Building three-dimensional scanner based on structured light technique using fringe projection pattern [J]. Journal of Computing & Information Science in Engineering, 2014, 14(3): 035001.CrossRefGoogle Scholar
  16. [16]
    TSAI R Y. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses [J]. IEEE Journal of Robotics & Automation, 1987, 3(4): 323–344.CrossRefGoogle Scholar
  17. [17]
    HARRIS C, STEPHENS M. A combined corner and edge detector [C]// Proceedings of the Fourth Alvey Vision Conference. Manchester, UK: The University of Sheffield Printing Unit, 1988: 147–151.Google Scholar
  18. [18]
    LAZAROS N, SIRAKOULIS G C, GASTERATOS A. Review of stereo vision algorithms: from software to hardware [J]. International Journal of Optomechatronics, 2008, 2(4): 435–462.CrossRefGoogle Scholar
  19. [19]
    XU Shuo-bo, XU Di-shi, FANG Hua. Stereo matching algorithm based on detecting feature points [J]. Advanced Materials Research, 2012, 433–440: 6190–6194.CrossRefGoogle Scholar
  20. [20]
    TSAI V J D. Delaunay triangulations in TIN creation: An overview and a linear-time algorithm [J]. International Journal of Geographical Information Systems, 1993, 7(6): 501–524.CrossRefGoogle Scholar
  21. [21]
    WRIGHT R S, HAEMEL N, SELLERS G, LIPCHAK B. OpenGL SuperBible: Comprehensive tutorial and reference [M]. 5th ed. New Jersey: Addison-Wesley, 2010.Google Scholar

Copyright information

© Central South University Press and Springer-Verlag GmbH Germany 2017

Authors and Affiliations

  • Jie Xiong (熊杰)
    • 1
  • Si-dong Zhong (仲思东)
    • 1
  • Yong Liu (刘勇)
    • 1
  • Li-fen Tu (屠礼芬)
    • 2
  1. 1.School of Electronic InformationWuhan UniversityWuhanChina
  2. 2.School of Physics and Electronic Information EngineeringHubei Engineering UniversityXiaoganChina

Personalised recommendations