Abstract
Calibration of crop model is standard practice, and it involves estimation of crop parameters based upon observed field data. It is the process of estimation of unknown parameters using practical observations. It is generally carried out manually by adjusting the parameters of the model. It consists of choosing the accurate numbers of coefficients that play a significant role in the adjustment of soil nitrogen, soil organic carbon, soil phosphorus, crop growth, phenological development, biomass accumulation, dry-matter partitioning, nutrients uptake, grain dry weight, grain numbers, grain yield, grain nitrogen (N) at maturity and protein content. A minimum data set (MDS) is required for the calibration of the model. A number of different steps could be used to calibrate the crop model. The initial step involves running of the model with default crop parameters and comparison of simulation outcomes with the observed data set. Afterwards, crop parameters are adjusted to have good agreement with observed and simulated data. It starts with phenology, then vegetative growth and biomass, afterwards yield components and finally yield. Optimization tools such as generalized likelihood uncertainty estimation (GLUE) and Markov chain Monte Carlo (MCMC) can be used for the calibration. Finally, evaluation of models needs to be performed with independent data set. The quantification of calibration and evaluation goodness should be evaluated by different skill scores such as root-mean-squared error (RMSE)/root-mean-square deviation (RMSD), relative RMSE (RRMSE) or normalized objective function (NOF), root-mean-square deviation-systematic error (RMSDse), root-mean-square deviation-non-systematic error (RMSDnse), mean absolute error (MAE), mean bias error (ME), coefficient of determination (R2), Nash-Sutcliffe modelling efficiency (EF) test, maximum difference (MD) and D index (index of agreement). These skill scores confirm the calibrated model performances under different sets of scenarios.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ahmad S, Ahmad A, Soler CMT, Ali H, Zia-Ul-Haq M, Anothai J, Hussain A, Hoogenboom G, Hasanuzzaman M (2012) Application of the CSM-CERES-Rice model for evaluation of plant density and nitrogen management of fine transplanted rice for an irrigated semiarid environment. Precis Agric 13(2):200–218. https://doi.org/10.1007/s11119-011-9238-1
Ahmad S, Ahmad A, Ali H, Hussain A, Garcia y Garcia A, Khan MA, Zia-Ul-Haq M, Hasanuzzaman M, Hoogenboom G (2013) Application of the CSM-CERES-Rice model for evaluation of plant density and irrigation management of transplanted rice for an irrigated semiarid environment. Irrig Sci 31(3):491–506. https://doi.org/10.1007/s00271-012-0324-6
Ahmad S, Nadeem M, Abbas G, Fatima Z, Zeb Khan RJ, Ahmed M, Ahmad A, Rasul G, Azam Khan M (2016) Quantification of the effects of climate warming and crop management on sugarcane phenology. Clim Res 71(1):47–61
Ahmad S, Abbas G, Fatima Z, Khan RJ, Anjum MA, Ahmed M, Khan MA, Porter CH, Hoogenboom G (2017) Quantification of the impacts of climate warming and crop management on canola phenology in Punjab, Pakistan. J Agron Crop Sci 203(5):442–452. https://doi.org/10.1111/jac.12206
Ahmad S, Abbas G, Ahmed M, Fatima Z, Anjum MA, Rasul G, Khan MA, Hoogenboom G (2019) Climate warming and management impact on the change of phenology of the rice-wheat cropping system in Punjab, Pakistan. Field Crop Res 230:46–61. https://doi.org/10.1016/j.fcr.2018.10.008
Ahmed M (2020) Introduction to modern climate change. Andrew E. Dessler: Cambridge University Press, 2011, 252 pp, ISBN-10: 0521173159. Sci Total Environ 734:139397. https://doi.org/10.1016/j.scitotenv.2020.139397
Ahmed M, Aslam MA, Hassan FU, Asif M, Hayat R (2014) Use of APSIM to model nitrogen use efficiency of rain-fed wheat. Int J Agric Biol 16:461–470
Ahmed M, Akram MN, Asim M, Aslam M, F-u H, Higgins S, Stöckle CO, Hoogenboom G (2016) Calibration and validation of APSIM-wheat and CERES-wheat for spring wheat under rainfed conditions: models evaluation and application. Comput Electron Agric 123:384–401. https://doi.org/10.1016/j.compag.2016.03.015
Ahmed M, Stöckle CO, Nelson R, Higgins S (2017) Assessment of climate change and atmospheric CO2 impact on winter wheat in the Pacific Northwest using a multimodel ensemble. Front Ecol Evol 5(51). https://doi.org/10.3389/fevo.2017.00051
Ahmed M, Ijaz W, Ahmad S (2018) Adapting and evaluating APSIM-SoilP-wheat model for response to phosphorus under rainfed conditions of Pakistan. J Plant Nutr 41(16):2069–2084. https://doi.org/10.1080/01904167.2018.1485933
Ahmed M, Stöckle CO, Nelson R, Higgins S, Ahmad S, Raza MA (2019) Novel multimodel ensemble approach to evaluate the sole effect of elevated CO2 on winter wheat productivity. Sci Rep 9(1):7813. https://doi.org/10.1038/s41598-019-44251-x
Anothai J, Patanothai A, Jogloy S, Pannangpetch K, Boote KJ, Hoogenboom G (2008) A sequential approach for determining the cultivar coefficients of peanut lines using end-of-season data of crop performance trials. Field Crop Res 108(2):169–178. https://doi.org/10.1016/j.fcr.2008.04.012
Balboa GR, Archontoulis SV, Salvagiotti F, Garcia FO, Stewart WM, Francisco E, Prasad PVV, Ciampitti IA (2019) A systems-level yield gap assessment of maize-soybean rotation under high- and low-management inputs in the Western US Corn Belt using APSIM. Agric Syst 174:145–154. https://doi.org/10.1016/j.agsy.2019.04.008
Bao Y, Hoogenboom G, McClendon R, Vellidis G (2017) A comparison of the performance of the CSM-CERES-maize and EPIC models using maize variety trial data. Agric Syst 150:109–119. https://doi.org/10.1016/j.agsy.2016.10.006
Beven K, Binley A (1992) The future of distributed models: model calibration and uncertainty prediction. Hydrol Process 6(3):279–298. https://doi.org/10.1002/hyp.3360060305
Beven KJ, Smith PJ, Freer JE (2008) So just why would a modeller choose to be incoherent? J Hydrol 354(1):15–32. https://doi.org/10.1016/j.jhydrol.2008.02.007
Boote KJ, Jones JW, Batchelor WD, Nafziger ED, Myers O (2003) Genetic coefficients in the CROPGRO–soybean model: links to field performance and genomics. Agron J 95(1):32–51. https://doi.org/10.2134/agronj2003.3200
Buddhaboon C, Jintrawet A, Hoogenboom G (2018) Methodology to estimate rice genetic coefficients for the CSM-CERES-rice model using GENCALC and GLUE genetic coefficient estimators. J Agric Sci 156(4):482–492. https://doi.org/10.1017/S0021859618000527
Dumont B, Leemans V, Mansouri M, Bodson B, Destain JP, Destain MF (2014) Parameter identification of the STICS crop model, using an accelerated formal MCMC approach. Environ Model Softw 52:121–135. https://doi.org/10.1016/j.envsoft.2013.10.022
Falconnier GN, Journet E-P, Bedoussac L, Vermue A, Chlébowski F, Beaudoin N, Justes E (2019) Calibration and evaluation of the STICS soil-crop model for faba bean to explain variability in yield and N2 fixation. Eur J Agron 104:63–77. https://doi.org/10.1016/j.eja.2019.01.001
Gao Y, Wallach D, Liu B, Dingkuhn M, Boote KJ, Singh U, Asseng S, Kahveci T, He J, Zhang R, Confalonieri R, Hoogenboom G (2020) Comparison of three calibration methods for modeling rice phenology. Agric For Meteorol 280:107785. https://doi.org/10.1016/j.agrformet.2019.107785
Gasparini M (1997) Markov chain Monte Carlo in practice. Technometrics 39(3):338–338. https://doi.org/10.1080/00401706.1997.10485132
Gilks WR, Richardson S, Spiegelhalter D (1995) Markov chain Monte Carlo in practice. Chapman and Hall/CRC
Guerra LC, Hoogenboom G, Garcia y Garcia A, Banterng P, Beasley JP (2008) Determination of cultivar coefficients for the CSM-CROPGRO-peanut model using variety trial data. Trans ASABE 51(4):1471–1481. https://doi.org/10.13031/2013.25227
He D, Wang E, Wang J, Robertson MJ (2017) Data requirement for effective calibration of process-based crop models. Agric For Meteorol 234-235:136–148. https://doi.org/10.1016/j.agrformet.2016.12.015
Hoogenboom G, Jones JW, Wilkens PW, Porter CH, Batchelor WD, Hunt LA, Boote KJ, Singh U, Uryasev O, Bowen WT, Gijsman AJ, du Toit AS, White JW, Tsuji GY (2004) Decision support system for Agrotechnology transfer version 4.0 [CD-ROM]. University of Hawaii, Honolulu, HI
Hunt LA, Boote KJ (1998) Data for model operation, calibration, and evaluation. In: Tsuji G, Hoogenboom G, Thornton P (eds) Understanding options for agricultural production, vol 7. Systems approaches for sustainable agricultural development. Springer, Dordrecht, pp 9–39. https://doi.org/10.1007/978-94-017-3624-4_2
Jin X, Xu C-Y, Zhang Q, Singh VP (2010) Parameter and modeling uncertainty simulated by GLUE and a formal Bayesian method for a conceptual hydrological model. J Hydrol 383(3):147–155. https://doi.org/10.1016/j.jhydrol.2009.12.028
Jing Q, Qian B, Bélanger G, VanderZaag A, Jégo G, Smith W, Grant B, Shang J, Liu J, He W, Boote K, Hoogenboom G (2020) Simulating alfalfa regrowth and biomass in eastern Canada using the CSM-CROPGRO-perennial forage model. Eur J Agron 113:125971. https://doi.org/10.1016/j.eja.2019.125971
Jones MR, Singels A (2018) Refining the Canegro model for improved simulation of climate change impacts on sugarcane. Eur J Agron 100:76–86. https://doi.org/10.1016/j.eja.2017.12.009
Leandro J, Gander A, Beg MNA, Bhola P, Konnerth I, Willems W, Carvalho R, Disse M (2019) Forecasting upper and lower uncertainty bands of river flood discharges with high predictive skill. J Hydrol 576:749–763. https://doi.org/10.1016/j.jhydrol.2019.06.052
Li ZT, Yang JY, Drury CF, Hoogenboom G (2015) Evaluation of the DSSAT-CSM for simulating yield and soil organic C and N of a long-term maize and wheat rotation experiment in the Loess Plateau of Northwestern China. Agric Syst 135:90–104. https://doi.org/10.1016/j.agsy.2014.12.006
Lobell DB (2013) Errors in climate datasets and their effects on statistical crop models. Agric For Meteorol 170(0):58–66. https://doi.org/10.1016/j.agrformet.2012.05.013
Lobell DB, Asseng S (2017) Comparing estimates of climate change impacts from process-based and statistical crop models. Environ Res Lett 12(1):015001. https://doi.org/10.1088/1748-9326/aa518a
Mavromatis T, Boote KJ, Jones JW, Irmak A, Shinde D, Hoogenboom G (2001) Developing genetic coefficients for crop simulation models with data from crop performance trials Florida Agric. Exp. Stn., J. Series No R-07163. Crop Sci 41(1):40–51. https://doi.org/10.2135/cropsci2001.41140x
Mavromatis T, Boote KJ, Jones JW, Wilkerson GG, Hoogenboom G (2002) Repeatability of model genetic coefficients derived from soybean performance trials across different states Florida Agricultural Experiment Station, Journal Series No. R-07981. Crop Sci 42(1):76–89. https://doi.org/10.2135/cropsci2002.7600
Mehrabi F, Sepaskhah AR (2019) Winter wheat yield and DSSAT model evaluation in a diverse semi-arid climate and agronomic practices. Int J Plant Prod. https://doi.org/10.1007/s42106-019-00080-6
Monteith JL (1965) Light distribution and photosynthesis in field crops. Ann Bot 29(1):17–37. https://doi.org/10.1093/oxfordjournals.aob.a083934
Rankinen K, Karvonen T, Butterfield D (2006) An application of the GLUE methodology for estimating the parameters of the INCA-N model. Sci Total Environ 365(1):123–139. https://doi.org/10.1016/j.scitotenv.2006.02.034
Ritchie J, Godwin D, Otter-Nacke S (1985) CERES-wheat: a user-oriented wheat yield model. Preliminary documentation. AGRISTARS Publication No. YM-U3-04442-JSC-18892
Seidel SJ, Palosuo T, Thorburn P, Wallach D (2018) Towards improved calibration of crop models – where are we now and where should we go? Eur J Agron 94:25–35. https://doi.org/10.1016/j.eja.2018.01.006
Sexton J, Everingham Y, Inman-Bamber G (2016) A theoretical and real world evaluation of two Bayesian techniques for the calibration of variety parameters in a sugarcane crop model. Environ Model Softw 83:126–142. https://doi.org/10.1016/j.envsoft.2016.05.014
Sheng M, Liu J, Zhu AX, Rossiter DG, Liu H, Liu Z, Zhu L (2019) Comparison of GLUE and DREAM for the estimation of cultivar parameters in the APSIM-maize model. Agric For Meteorol 278:107659. https://doi.org/10.1016/j.agrformet.2019.107659
Singels A, Bezuidenhout CN (2002) A new method of simulating dry matter partitioning in the Canegro sugarcane model. Field Crop Res 78(2):151–164. https://doi.org/10.1016/S0378-4290(02)00118-1
Suriharn B, Patanothai A, Pannangpetch K, Jogloy S, Hoogenboom G (2007) Determination of cultivar coefficients of peanut lines for breeding applications of the CSM-CROPGRO-peanut model. Crop Sci 47(2):607–619. https://doi.org/10.2135/cropsci2006.01.0050
Suriharn B, Patanothai A, Pannangpetch K, Jogloy S, Hoogenboom G (2008) Yield performance and stability evaluation of peanut breeding lines with the CSM-CROPGRO-peanut model. Crop Sci 48(4):1365–1372. https://doi.org/10.2135/cropsci2007.09.0523
Tan J, Cao J, Cui Y, Duan Q, Gong W (2019) Comparison of the generalized likelihood uncertainty estimation and Markov chain Monte Carlo methods for uncertainty analysis of the ORYZA_V3 model. Agron J 111(2):555–564. https://doi.org/10.2134/agronj2018.05.0336
Wallach D (2011) Crop model calibration: a statistical perspective. Agron J 103(4):1144–1151. https://doi.org/10.2134/agronj2010.0432
Wallach D, Hwang C, Correll MJ, Jones JW, Boote K, Hoogenboom G, Gezan S, Bhakta M, Vallejos CE (2018) A dynamic model with QTL covariables for predicting flowering time of common bean (Phaseolus vulgaris) genotypes. Eur J Agron 101:200–209. https://doi.org/10.1016/j.eja.2018.10.003
Wallach D, Palosuo T, Thorburn P, Seidel SJ, Gourdain E, Asseng S, Basso B, Buis S, Crout NMJ, Dibari C, Dumont B, Ferrise R, Gaiser T, Garcia C, Gayler S, Ghahramani A, Hochman Z, Hoek S, Horan H, Hoogenboom G, Huang M, Jabloun M, Jing Q, Justes E, Kersebaum KC, Klosterhalfen A, Launay M, Luo Q, Maestrini B, Mielenz H, Moriondo M, Nariman Zadeh H, Olesen JE, Poyda A, Priesack E, Pullens JWM, Qian B, Schütze N, Shelia V, Souissi A, Specka X, Srivastava AK, Stella T, Streck T, Trombi G, Wallor E, Wang J, Weber TKD, Weihermüller L, de Wit A, Wöhling T, Xiao L, Zhao C, Zhu Y (2019) How well do crop models predict phenology, with emphasis on the effect of calibration? bioRxiv:708578. https://doi.org/10.1101/708578
White JW, Hoogenboom G (2003) Gene-based approaches to crop simulation. Agron J 95(1):52–64. https://doi.org/10.2134/agronj2003.5200
Whitehead PG, Jin L, Macadam I, Janes T, Sarkar S, Rodda HJE, Sinha R, Nicholls RJ (2018) Modelling impacts of climate change and socio-economic change on the Ganga, Brahmaputra, Meghna, Hooghly and Mahanadi river systems in India and Bangladesh. Sci Total Environ 636:1362–1372. https://doi.org/10.1016/j.scitotenv.2018.04.362
Yang J, Drury C, Yang J, Li Z, Hoogenboom G (2014) EasyGrapher: software for data visualization and statistical evaluation of DSSAT cropping system model and the CANB model. Int J Comp Theory Eng 6(3):210
Zhao C, Liu B, Xiao L, Hoogenboom G, Boote KJ, Kassie BT, Pavan W, Shelia V, Kim KS, Hernandez-Ochoa IM, Wallach D, Porter CH, Stockle CO, Zhu Y, Asseng S (2019) A SIMPLE crop model. Eur J Agron 104:97–106. https://doi.org/10.1016/j.eja.2019.01.009
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Ahmed, M. et al. (2020). Models Calibration and Evaluation. In: Ahmed, M. (eds) Systems Modeling. Springer, Singapore. https://doi.org/10.1007/978-981-15-4728-7_5
Download citation
DOI: https://doi.org/10.1007/978-981-15-4728-7_5
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-4727-0
Online ISBN: 978-981-15-4728-7
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)