Abstract
In recent years, plant phenotyping technologies have been widely applied to evaluate complex plant traits such as morphology, physiology, ecology, biochemistry, tolerance, growth and yield. Hyperspectral/multispectral cameras, artificial lighting sources, mechanisms and computers together capture images of different species of plants. Due to the non-uniform intensity of lighting sources in different wavelengths, raw images need to be calibrated using white references. Flat white panels are typically scanned as a white reference. However, geometrical factors such as leaf tilt angles cannot be calibrated by flat white references. In this publication, the effectiveness of using angled white reference to calibrate corresponding raw images was first demonstrated. Furthermore, a 3D white referencing library integrating different angles and spatial positions in the system of a hyperspectral camera and a Kinect V2 depth sensor was created. Thus, a pixel on the leaf surface can be calibrated by a point with the nearest tilt angle and spatial position in the 3D referencing library. The validating samples for this referencing library were soybean leaves grown in a greenhouse. The results showed that the reflectance spectra after 3D calibration were closer to the standard calibration (flat leaf calibrated by flat white reference) than the conventional flat white referencing calibration. Furthermore, the pixel-level normalized difference vegetation index (NDVI) distribution over the soybean leaf surface after 3D calibration was also closer to the standard calibration. This proposed 3D white referencing method had the potential to improve calibration quality of plant images. Integrating with LiDAR sensors, this new approach has an opportunity to be applied in field environments.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
An, N., Palmer, C. M., Baker, R. L., Markelz, R. J. C., Ta, J., Covington, M. F., et al. (2016). Plant high-throughput phenotyping using photogrammetry and imaging techniques to measure leaf length and rosette area. Computers and Electronics in Agriculture, 127, 376–394. https://doi.org/10.1016/j.compag.2016.04.002.
Behmann, J., Acebron, K., Emin, D., Bennertz, S., Matsubara, S., Thomas, S., et al. (2018). Specim IQ: Evaluation of a new, miniaturized handheld hyperspectral camera and its application for plant phenotyping and disease detection. Sensors, 18(2), 441. https://doi.org/10.3390/s18020441.
Behmann, J., Mahlein, A. K., Paulus, S., Kuhlmann, H., Oerke, E. C., & Plümer, L. (2015). Calibration of hyperspectral close-range pushbroom cameras for plant phenotyping. ISPRS Journal of Photogrammetry and Remote Sensing, 106, 172–182. https://doi.org/10.1016/j.isprsjprs.2015.05.010.
Behmann, J., Steinrücken, J., & Plümer, L. (2014). Detection of early plant stress responses in hyperspectral images. ISPRS Journal of Photogrammetry and Remote Sensing, 93, 98–111. https://doi.org/10.1016/j.isprsjprs.2014.03.016.
Bourgeon, M. A., Gée, C., Debuisson, S., Villette, S., Jones, G., & Paoli, J. N. (2017). «On-the-go» multispectral imaging system to characterize the development of vineyard foliage with quantitative and qualitative vegetation indices. Precision Agriculture, 18(3), 293–308. https://doi.org/10.1007/s11119-016-9489-y.
Bousquet, L., Lachérade, S., Jacquemoud, S., & Moya, I. (2005). Leaf BRDF measurements and model for specular and diffuse components differentiation. Remote Sensing of Environment, 98(2–3), 201–211. https://doi.org/10.1016/j.rse.2005.07.005.
Dhondt, S., Wuyts, N., & Inzé, D. (2013). Cell to whole-plant phenotyping: The best is yet to come. Trends in Plant Science, 18(8), 1360–1385. https://doi.org/10.1016/j.tplants.2013.04.008.
Eitel, J. U. H., Magney, T. S., Vierling, L. A., Brown, T. T., & Huggins, D. R. (2014). LiDAR based biomass and crop nitrogen estimates for rapid, non-destructive assessment of wheat nitrogen status. Field Crops Research, 159, 21–32. https://doi.org/10.1016/j.fcr.2014.01.008.
Elmasry, G., Sun, D. W., & Allen, P. (2012). Near-infrared hyperspectral imaging for predicting colour, pH and tenderness of fresh beef. Journal of Food Engineering, 110(1), 127–140. https://doi.org/10.1016/j.jfoodeng.2011.11.028.
ElMasry, G., Wang, N., ElSayed, A., & Ngadi, M. (2007). Hyperspectral imaging for nondestructive determination of some quality attributes for strawberry. Journal of Food Engineering, 81(1), 98–107. https://doi.org/10.1016/j.jfoodeng.2006.10.016.
Gowen, A. A., O’Donnell, C. P., Cullen, P. J., Downey, G., & Frias, J. M. (2007). Hyperspectral imaging-an emerging process analytical tool for food quality and safety control. Trends in Food Science and Technology, 18(12), 590–598. https://doi.org/10.1016/j.tifs.2007.06.001.
Granier, C., Aguirrezabal, L., Chenu, K., Cookson, S., Dauzat, M., Hamard, P., et al. (2006). PHENOPSIS, an automated platform for reproducible phenotyping of plant responses to soil water deficit in Arabidopsis thaliana permitted the identification of an accession with low sensitivity to soil water deficit. New Phytologist, 169(3), 623–635. https://doi.org/10.1111/j.1469-8137.2005.01609.x.
Guo, Q., Wu, F., Pang, S., Zhao, X., Chen, L., Liu, J., et al. (2018). Crop 3D—A LiDAR based platform for 3D high-throughput crop phenotyping. Science China Life Sciences, 61, 328–339. https://doi.org/10.1007/s11427-017-9056-0.
Hämmerle, M., & Höfle, B. (2014). Effects of reduced terrestrial LiDAR point density on high-resolution grain crop surface models in precision agriculture. Sensors, 14(12), 24212–24230. https://doi.org/10.3390/s141224212.
Huang, P., Luo, X., Jin, J., Wang, L., Zhang, L., Liu, J., et al. (2018). Improving high-throughput phenotyping using fusion of close-range hyperspectral camera and low-cost depth sensor. Sensors, 18(8), 2711. https://doi.org/10.3390/s18082711.
Jackson, R. D., Slater, P. N., & Pinter, P. J. (1983). Discrimination of growth and water stress in wheat by various vegetation indices through clear and turbid atmospheres. Remote Sensing of Environment, 13(3), 187–208. https://doi.org/10.1016/0034-4257(83)90039-1.
Jacquemoud, S., & Baret, F. (1990). PROSPECT: A model of leaf optical properties spectra. Remote Sensing of Environment, 34(2), 75–91. https://doi.org/10.1016/0034-4257(90)90100-Z.
Jacquemoud, S., Verhoef, W., Baret, F., Bacour, C., Zarco-Tejada, P. J., Asner, G. P., et al. (2009). PROSPECT+SAIL models: A review of use for vegetation characterization. Remote Sensing of Environment, 113(SUPPL. 1), S56–S66. https://doi.org/10.1016/j.rse.2008.01.026.
Kim, M. S., Chen, Y., & Mehl, P. M. (2001). Hyperspectral reflectance and fluorescence imaging system for food quality and safety. Tranactions of ASAE, 44(3), 721–729.
Li, L., Zhang, Q., & Huang, D. (2014). A review of imaging techniques for plant phenotyping. Sensors, 14(11), 20078–20111. https://doi.org/10.3390/s141120078.
Li, X., Li, R., Wang, M., Liu, Y., Zhang, B., & Zhou, J. (Eds.). (2017). Hyperspectral imaging and their applications in the nondestructive quality assessment of fruits and vegetables. In Hyperspectral imaging in agriculture, food and environment (Vol. 3, pp. 27–34). London, UK: IntechOpen Limited. https://dx.doi.org/10.5772/intechopen.72250.
Liu, X., & Bo, Y. (2015). Object-based crop species classification based on the combination of airborne hyperspectral images and LiDAR data. Remote Sensing, 7(1), 922–950. https://doi.org/10.3390/rs70100922.
Ma, D., Carpenter, N., Amatya, S., Maki, H., Wang, L., Zhang, L., et al. (2019). Removal of greenhouse microclimate heterogeneity with conveyor system for indoor phenotyping. Computers and Electronics in Agriculture, 166, 104979. https://doi.org/10.1016/j.compag.2019.104979.
Polder, G., & Heijden, G. V. D. (2001). Calibration and characterization of spectral imaging systems. Proceedings of SPIE-The International Society for Optical Engineering. https://doi.org/10.1117/12.441362.
Salas, E. A. L., & Henebry, G. M. (2014). A new approach for the analysis of hyperspectral data: Theory and sensitivity analysis of the moment distance method. Remote Sensing, 6(1), 20–41. https://doi.org/10.3390/rs6010020.
Schaepman-Strub, G., Schaepman, M. E., Painter, T. H., Dangel, S., & Martonchik, J. V. (2006). Reflectance quantities in optical remote sensing-definitions and case studies. Remote Sensing of Environment, 103(1), 27–42. https://doi.org/10.1016/j.rse.2006.03.002.
Tester, M., & Langridge, P. (2010). Breeding technologies to increase crop production in a changing world. Science, 327(5967), 818–822. https://doi.org/10.1126/science.1183700.
Xiong, X., Yu, L., Yang, W., Liu, M., Jiang, N., Wu, D., et al. (2017). A high-throughput stereo-imaging system for quantifying rape leaf traits during the seedling stage. Plant Methods, 13(1), 1–17. https://doi.org/10.1186/s13007-017-0157-7.
Yu, K., Zhao, Y., Li, X., Shao, Y., Liu, F., & He, Y. (2014). Hyperspectral imaging for mapping of total nitrogen spatial distribution in pepper plant. PLoS ONE, 9(12), 1–19. https://doi.org/10.1371/journal.pone.0116205.
Zhang, B., Fan, S., Li, J., Huang, W., Zhao, C., Qian, M., et al. (2015). Detection of early rottenness on apples by using hyperspectral imaging combined with spectral analysis and image processing. Food Analytical Methods, 8(8), 2075–2086. https://doi.org/10.1007/s12161-015-0097-7.
Zhang, L., Maki, H., Ma, D., Sánchez-Gallego, J. A., Mickelbart, M. V., Wang, L., et al. (2019). Optimized angles of the swing hyperspectral imaging system for single corn plant. Computers and Electronics in Agriculture, 156, 349–359. https://doi.org/10.1016/j.compag.2018.11.030.
Zhang, M., Li, C., & Yang, F. (2017). Classification of foreign matter embedded inside cotton lint using short wave infrared (SWIR) hyperspectral transmittance imaging. Computers and Electronics in Agriculture, 139, 75–90. https://doi.org/10.1016/j.compag.2017.05.005.
Zhao, Y., Yu, K., & He, Y. (2015). Hyperspectral imaging coupled with random frog and calibration models for assessment of total soluble solids in Mulberries. Journal of Analytical Methods in Chemistry, 2015, 343782. https://doi.org/10.1155/2015/343782.
Zhou, J., Khot, L. R., Boydston, R. A., Miklas, P. N., & Porter, L. (2018). Low altitude remote sensing technologies for crop stress monitoring: a case study on spatial and temporal monitoring of irrigated pinto bean. Precision Agriculture, 19(3), 555–569. https://doi.org/10.1007/s11119-017-9539-0.
Zou, X., Haikarainen, I., Haikarainen, I. P., Mäkelä, P., Mõttus, M., & Pellikka, P. (2018). Effects of crop leaf angle on LAI-sensitive narrow-band vegetation indices derived from imaging spectroscopy. Applied Sciences, 8(9), 1435. https://doi.org/10.3390/app8091435.
Zou, X., & Mõttus, M. (2015). Retrieving crop leaf tilt angle from imaging spectroscopy data. Agricultural and Forest Meteorology, 205, 73–82. https://doi.org/10.1016/j.agrformet.2015.02.016.
Acknowledgements
The authors would like to thank Julie M Young in Botany and Plant Pathology Department at Purdue University for providing the soybean plants. The authors are also grateful to Scott Brand, the machine shop manager in Agricultural & Biological Engineering Department at Purdue University, for helping us machine the Teflon white hemispheres.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interest:
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this publication.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhang, L., Jin, J., Wang, L. et al. A 3D white referencing method for soybean leaves based on fusion of hyperspectral images and 3D point clouds. Precision Agric 21, 1173–1186 (2020). https://doi.org/10.1007/s11119-020-09713-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11119-020-09713-7