The State of Motion Stereo About Plant Leaves Monitoring System Design and Simulation

  • Jiangchuan Fan
  • Xinyu GuoEmail author
  • Chuanyu Wang
  • Xianju Lu
  • Sheng Wu
Conference paper
Part of the IFIP Advances in Information and Communication Technology book series (IFIPAICT, volume 546)


A binocular stereo vision plant leaf motion monitoring system was proposed in this paper, the system includes a binocular camera, horizontal movement module, the vertical movement module, the image acquisition card, and a computer. The supporting structure holds camera above the measured maize leaf, the camera is able to capture image pair at 30 fps, An image processing program is installed in computer, the program includes image acquisition, image pre-processing, markers extraction, sub-pixel edge refinement, 3D reconstruction and other modules. A fluorescent ball (diameter 0.35 cm) with high reflectivity was chosen as a marker, and its intensity is higher than the background environment which makes it easier to extract contour of ball out of background. The spherical marker will keep its circular shape more or less after perspective projection. In order to further improve the accuracy of stereo matching, a sub-pixel edge detection method based on gradient magnitude was adopted, in the initial position of the edge, a set of reference points was selected according to the gradient magnitude threshold along gradient direction, the x and y coordination of reference points sum up weighted by gradient magnitude, the mean of weighted sum is the increments of initial edge in sub-pixel form. In the simulation experiment, the camera is set away from the measured object about 50 cm, the system measurement accuracy can reach to 0.0139 cm, it is able to detect the small changes of leaf position. In field experiments, the actual measurement of the movement leaf caused by growth and physiological responses achieved the desired results, this study provide a solution to continuous, non-destructive, non-contact acquire crop growth information in three-dimensional space.


Binocular stereo vision Plant leaf Growth monitoring Image processing Sub-pixel 


  1. 1.
    Howarth, M.S., Brandon, J.R., Searcy, S.W., et al.: Estimation of tip shape for carrot classification by machine vision. J Agri. Eng. Res. 53, 123–139 (1992)CrossRefGoogle Scholar
  2. 2.
    Szczypiński, P.M., Zapotoczny, P.: Computer vision algorithm for barley kernel identification, orientation estimation and surface structure assessment. Comput. Electron. Agric. 87(9), 32–38 (2012)CrossRefGoogle Scholar
  3. 3.
    Pearson, T.C., Schatzki, T.F.: Machine vision system for automated detection of aflatoxin contaminated pistachios. Agric. Food Chem. 46(6), 2248–2252 (1998)CrossRefGoogle Scholar
  4. 4.
    Ni, B., Paulsen, M.R., Reid, J.F.: Size grading of corn kernels with machine vision. Appl. Eng. Agric. 14(5), 567–571 (1998)CrossRefGoogle Scholar
  5. 5.
    Linker, R., Cohen, O., Naor, A.: Determination of the number of green apples in RGB images recorded in orchards. Comput. Electron. Agric. 81(2), 45–57 (2012)CrossRefGoogle Scholar
  6. 6.
    Wang, Q., Wang, H., Xie, L., et al.: Outdoor color rating of sweet cherries using computer vision. Comput. Electron. Agric. 87(9), 113–120 (2012)CrossRefGoogle Scholar
  7. 7.
    Confalonieri, R., Foi, M., Casa, R., et al.: Development of an app for estimating leaf area index using a smartphone trueness and precision determination and comparison with other indirect methods. Comput. Electron. Agric. 96(8), 67–74 (2013)CrossRefGoogle Scholar
  8. 8.
    Ahmad, I.S., Reid, J.F.: Evaluation of colour representations for maize images. J. Agric. Eng. Res. 63, 185–196 (1996)CrossRefGoogle Scholar
  9. 9.
    Romero, J.R., Roncallo, P.F., Akkiraju, P.C., et al.: Using classification algorithms for predicting durum wheat yield in the province of Buenos aires. Comput. Electron. Agric. 96(8), 173–179 (2013)CrossRefGoogle Scholar
  10. 10.
    Kacira, M., Sase, S.: Optimization of vent configuration by evaluating greenhouse and plant canopy ventilation rates under wind induced ventilation. Trans. ASAE 47(6), 2059–2067 (2004)CrossRefGoogle Scholar
  11. 11.
    Ishizuka, T., Tanabata, T., Takano, M., Shinomura, T.: Kinetic measuring method of rice growth in tillering stage using automatic digital imaging system. Environ. Control Biol. 43, 83–96 (2005)CrossRefGoogle Scholar
  12. 12.
    Ma, Z., Hiroshim, S., Gu, S.: Non-destructive measurement system for plant growth information based on machine vision. Trans. CSAE 26(9), 203–209 (2010)Google Scholar
  13. 13.
    Kise, M., Zhang, Q.: Reconstruction of a virtual 3D field scene from ground-based multi-spectral stereo imagery. In: 2006 ASABE Annual International Meeting Presentation, ASABE, 063098. ASABE, Portland (2006)Google Scholar
  14. 14.
    Jeon, H.Y., Tian, L.: Stereovision system and image processing algorithms for plant specific application. In: 2009 ASABE Annual International Meeting Presentation, ASABE, 090047. ASABE, Reno (2009)Google Scholar
  15. 15.
    Wang, C., Zhao, M., Yan, J.: Measurement of maize seedling morphological traits based on binocular stereo vision. Trans. Chin. Soc. Agric. Mach. 40(5), 144–148 (2009)Google Scholar
  16. 16.
    Lati, R.N., Filin, S., Eizenberg, H.: Estimating plant growth parameters using an energy minimization-based stereovision model. Comput. Electron. Agric. 98(10), 260–271 (2013)CrossRefGoogle Scholar
  17. 17.
    Andersen, H.J., Reng, L., Kirk, K.: Geometric plant properties by relaxed stereo vision using simulated annealing. Comput. Electron. Agric. 49(2), 219–232 (2005)CrossRefGoogle Scholar
  18. 18.
    Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)CrossRefGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2019

Authors and Affiliations

  • Jiangchuan Fan
    • 1
    • 2
    • 3
  • Xinyu Guo
    • 1
    • 2
    • 3
    Email author
  • Chuanyu Wang
    • 1
    • 2
    • 3
  • Xianju Lu
    • 1
    • 2
    • 3
  • Sheng Wu
    • 1
    • 2
    • 3
  1. 1.Beijing Research Center for Information Technology in AgricultureBeijingChina
  2. 2.National Engineering Research Center for Information Technology in AgricultureBeijingChina
  3. 3.Beijing Key Lab of Digital PlantBeijingChina

Personalised recommendations