A Cost-Effective Automatic 3D Reconstruction Pipeline for Plants Using Multi-view Images
Plant phenotyping involves the measurement, ideally objectively, of characteristics or traits. Traditionally, this is either limited to tedious and sparse manual measurements, often acquired destructively, or coarse image-based 2D measurements. 3D sensing technologies (3D laser scanning, structured light and digital photography) are increasingly incorporated into mass produced consumer goods and have the potential to automate the process, providing a cost-effective alternative to current commercial phenotyping platforms. We evaluate the performance, cost and practicability for plant phenotyping and present a 3D reconstruction method from multi-view images acquired with a domestic quality camera. This method consists of the following steps: (i) image acquisition using a digital camera and turntable; (ii) extraction of local invariant features and matching from overlapping image pairs; (iii) estimation of camera parameters and pose based on Structure from Motion(SFM); and (iv) employment of a patch based multi-view stereo technique to implement a dense 3D point cloud. We conclude that the proposed 3D reconstruction is a promising generalized technique for the non-destructive phenotyping of various plants during their whole growth cycles.
KeywordsPhenotyping multi-view images structure from motion multi-view stereo 3D reconstruction
Unable to display preview. Download preview PDF.
- 1.Alcantarilla, P.F., Nuevo, J., Bartoli, A.: Fast explicit diffusion for accelerated features in nonlinear scale spaces. In: British Machine Vision Conf., BMVC (2013)Google Scholar
- 2.Biskup, B., Scharr, H., Rascher, U.S.: A stereo imaging system for measuring structural parameters of plant canopies. Plant, Cell & Environment 30 (2007)Google Scholar
- 4.Cobb, J.N., DeClerck, G., Greenberg, A., Clark, R., McCouch, S.: Next-generation phenotyping: requirements and strategies for enhancing our understanding of genotype-phenotype relationships and its relevance to crop improvement. Theoretical and Applied Genetics 126, 867–887 (2013)CrossRefGoogle Scholar
- 9.Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press (2004)Google Scholar
- 12.Jancosek, M., Pajdla, T.: Multi-view reconstruction preserving weakly-supported surfaces. In: Proc. CVPR, pp. 3121–3128 (2011)Google Scholar
- 16.Organisation, E.P.S.: White paper of plant phenotyping. Tech. rep. (2010)Google Scholar
- 17.Paproki, A., Sirault, X., Berry, S., Furbank, R., Fripp, J.: A novel mesh processing based technique for 3d plant analysis. BMC Plant Biology 12 (2012)Google Scholar
- 18.Prince, S.J.D.: Computer Vision: Models, Learning, and Inference. Cambridge University Press (2012)Google Scholar
- 20.Seitz, S.M., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-view stereo reconstruction algorithms. In: Proc. CVPR, vol. 1, pp. 519–528 (2006)Google Scholar
- 21.Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: Exploring photo collections in 3d. In: Proc. SIGGRAPH, pp. 835–846 (2006)Google Scholar
- 22.Stephens, C.H.: Mike: A combined corner and edge detector. In: Proc. of Fourth Alvey Vision Conference, pp. 5–10 (1988)Google Scholar
- 23.Santos, T., Oliveira, A.: Image-based 3d digitizing for plant architecture analysis and phenotyping. In: Proc. Workshop on Industry Applications in SIB-GRAPI (2012)Google Scholar