Accurate Multi-View Stereo 3D Reconstruction for Cost-Effective Plant Phenotyping

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8815)

Abstract

Phenotyping, which underpins much of plant biology and breeding, involves the measurement of characteristics or traits. Traditionally, this has been often destructive and/or subjective but the dynamic objective measurement of traits as they change in response to genetic mutation or environmental influences is an important goal. 3-D imaging technologies are increasingly incorporated into mass produced consumer goods (3D laser scanning, structured light and digital photography) and may represent a cost-effective alternative to current commercial phenotyping platforms. We evaluate their performance, cost and practicability for plant phenotyping and present a 3D reconstruction method for plants from multi-view images acquired with domestic quality cameras. We exploit an efficient Structure-From-Motion followed by stereo matching and depth-map merging processes. Experimental results show that the proposed method is flexible, adaptable and inexpensive, and promising as an generalized groundwork for phenotyping various plant species.

Keywords

Plant phenotyping Multi-view images Structure from motion Stereovision 3D reconstruction 

References

  1. 1.
    Biskup, B., Scharr, H., Rascher, U.S.: A stereo imaging system for measuring structural parameters of plant canopies. Plant, Cell & Environment 30 (2007)Google Scholar
  2. 2.
    Cobb, J.N., et al.: Next-generation phenotyping: requirements and strategies for enhancing our understanding of genotype-phenotype relationships and its relevance to crop improvement. Theoretical and Applied Genetics 126, 867–887 (2013)CrossRefGoogle Scholar
  3. 3.
    Furukawa, Y., Ponce, J.: Accurate, dense, and robust multiview stereopsis. IEEE Tran. PAMI 32, 1362–1376 (2010)CrossRefGoogle Scholar
  4. 4.
    Granier, C., et al.: Phenopsis, an automated platform for reproducible phenotyping of plant responses to soil water defficit in arabidopsis thaliana permitted the identification of an accession with low sensitivity to soil water deffcit. New Phytologist 169, 623–635 (2006)CrossRefGoogle Scholar
  5. 5.
    Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press (2004)Google Scholar
  6. 6.
    Hirschmuller, H.: Stereo processing by semiglobal matching and mutual information. IEEE Trans. PAMI 30(2), 328–341 (2008)CrossRefGoogle Scholar
  7. 7.
    Ivanov, N., et al.: Computer stereo plotting for 3-d reconstruction of a maize canopy. Agricultural and Forest Meteorology 75, 85–102 (1995)CrossRefGoogle Scholar
  8. 8.
    Jancosek, M., Pajdla, T.: Multi-view reconstruction preserving weakly-supported surfaces. In: Proc. CVPR, pp. 3121–3128 (2011)Google Scholar
  9. 9.
    Kaminuma, E., Heida, N., et al.: Automatic quantification of morphological traits via three-dimensional measurement of arabidopsis. Plant 38, 358–365 (2004)CrossRefGoogle Scholar
  10. 10.
    Li, Y.Y., Fan, X.C., Mitra, N.J., Chamovitz, D., Cohen-Or, D., Chen, B.Q.: Analyzing growing plants from 4d point cloud data. ACM Trans. Graphics 32 (2013)Google Scholar
  11. 11.
    Lu, L., Yonghuai, L., Minglan, S., Jiwan, H., John, H.D.: A cost-effective automatic 3D reconstruction pipeline for plants using multi-view images. In: Proc. 15th Towards Autonomous Robotic Systems (2014)Google Scholar
  12. 12.
    Morel, J.M., Yu, G.: Asift: A new framework for fully affine invariant image comparison. SIAM J. Img. Sci. 2(2), 438–469 (2009)MathSciNetCrossRefMATHGoogle Scholar
  13. 13.
    Paproki, A., Sirault, X., Berry, S., Furbank, R., Fripp, J.: A novel mesh processing based technique for 3d plant analysis. BMC Plant Biology 12 (2012)Google Scholar
  14. 14.
    Quan, L., Tan, P., Zeng, G., Yuan, L., Wang, J.D., Kang, S.B.: Image-based plant modeling. ACM Trans. Graphics 25, 599–604 (2006)CrossRefGoogle Scholar
  15. 15.
    Reuzeau, C.: Traitmill (tm): A high throughput functional genomics platform for the phenotypic analysis of cereals. Vitro Cellular & Developmental Biology-Animal 43, S4–S4 (2007)Google Scholar
  16. 16.
    Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: Exploring photo collections in 3d. In: Proc. SIGGRAPH, pp. 835–846 (2006)Google Scholar
  17. 17.
    Santos, T., Oliveira, A.: Image-based 3d digitizing for plant architecture analysis and phenotyping. In: Proc. Workshop on Industry Applications in SIB-GRAPI (2012)Google Scholar
  18. 18.
    Yamazaki, S., et al.: The theory and practice of coplanar shadowgram imaging for acquiring visual hulls of intricate objects. IJCV 81, 259–280 (2009)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Lu Lou
    • 1
  • Yonghuai Liu
    • 1
  • Jiwan Han
    • 2
  • John H. Doonan
    • 2
  1. 1.Department of Computer ScienceAberystwyth UniversityAberystwythUK
  2. 2.NPPC, IBERSAberystwyth UniversityAberystwythUK

Personalised recommendations