Abstract
Key messages
We investigate a method of extracting and fitting synthetic environmental covariates and pedigree information in multilocation trial data analysis to predict genotype performances in untested locations.
Abstract
Plant breeding trials are usually conducted across multiple testing locations to predict genotype performances in the targeted population of environments. The predictive accuracy can be increased by the use of adequate statistical models. We compared linear mixed models with and without synthetic covariates (SCs) and pedigree information under the identity, the diagonal and the factor-analytic variance-covariance structures of the genotype-by-location interactions. A comparison was made to evaluate the accuracy of different models in predicting genotype performances in untested locations using the mean squared error of predicted differences (MSEPD) and the Spearman rank correlation between predicted and adjusted means. A multi-environmental trial (MET) dataset evaluated for yield performance in the dry lowland sorghum (Sorghum bicolor (L.) Moench) breeding program of Ethiopia was used. For validating our models, we followed a leave-one-location-out cross-validation strategy. A total of 65 environmental covariates (ECs) obtained from the sorghum test locations were considered. The SCs were extracted from the ECs using multivariate partial least squares analysis and subsequently fitted in the linear mixed model. Then, the model was extended accounting for pedigree information. According to the MSEPD, models accounting for SC improve predictive accuracy of genotype performances in the three of the variance-covariance structures compared to others without SC. The rank correlation was also higher for the model with the SC. When the SC was fitted, the rank correlation was 0.58 for the factor analytic, 0.51 for the diagonal and 0.46 for the identity variance-covariance structures. Our approach indicates improvement in predictive accuracy with SC in the context of genotype-by-location interactions of a sorghum breeding in Ethiopia.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
In plant breeding, genotypic selection for a given target population of environments (TPEs) involves testing of several genotypes across multiple environments and therefore across locations and/or years (Piepho 1998a, b). Different statistical approaches for multi-environment trial (MET) data analysis were proposed over time to increase prediction precision of genotype performances accounting for genotype-by-environment interaction (GEI) effects (Gilmour et al. 1997; Piepho 1998a, b; Smith and Cullis 2018). The common statistical methods used for MET analysis rely on randomization-based models considering different variance–covariance structures for GEI. The simplest variance–covariance structure assumes an identity matrix for the GEI effects, multiplied by a constant variance, implying independence between environments where the genotype main effect is also considered in the model. The identity variance–covariance structure can be replaced by the diagonal and factor-analytic variance–covariance structures for GEI assuming different variances at each environment and/or dependence between environments. The classical approach of modeling MET is based on the fixed effects models (van Eeuwijk 1992; Vargas 1999). Later on, the multiplicative fixed effect model was extended to its random-effects equivalent related to factor-analytic variance–covariance structures in the context of linear mixed model (LMM) (Piepho 1997, 1998a, b; Smith et al. 2001, 2005).
In plant breeding, field trials are usually conducted at a limited number of locations in the TPE, and breeders use statistical methods allowing borrowing information through correlation between genotypes to predict genotypes performances using LMM (Li et al. 2021). In self-pollinated plants, sister lines are correlated through genetic kinship, and the covariance of their breeding values is equal to the additive genetic covariance among the individual lines (Crossa et al. 2006). Therefore, breeders have used methods to incorporate pedigree information and/or marker data in an LMM for predicting breeding values (Buntaran et al. 2022; Crossa et al. 2010; Henderson 1991; Mrode 2005; Pérez-Rodríguez et al. 2015). In the standard LMM, BLUP of breeding values of random genotypes allows borrowing of information among relatives through the coefficient of parentage. Hence, closely related genotypes tend to contribute more to an estimated breeding value than less related lines (Jarquín et al. 2014). Hence, considering the kinship matrix is expected to improve prediction precision of genotypes.
Recent work on MET data analysis has focused on incorporating environmental covariates (ECs) in predicting genotype performances (Li et al. 2021, 2022; Piepho 2022; Piepho and Blancon 2023). In most cases, the main ECs include weather data (for example, rainfall and temperature) and soil information (for example, soil texture, pH, total nitrogen, organic carbon content) are obtained from envirotyping (Xu 2016; Cooper et al. 2014). The ECs can be fitted as regressor variables for the main effects of locations and for genotypes-by-location interactions effects (Li et al. 2021, 2022; Piepho 2022; Resende et al. 2021). Furthermore, breeders may be interested in genotypic prediction for new locations, where the trials were yet not conducted using ECs. Even though the test locations are expected to be representative of the TPE, it can be hard to find a perfect match for new locations among the tested locations. The current advancement in enviromics can improve the selection accuracy across the TPE, including new locations (Resende et al. 2021). This advancement may help to increase prediction accuracy, especially in the case of a limited number of trials.
Often, a large number of ECs is available and regressing the main effect of locations and GEI on several ECs using multiple regression, also known as factorial regression (Denis 1988), may not be practical (Buntaran et al. 2021). One solution for such challenge is to extract a smaller number of synthetic covariates (SCs) that represent the actual ECs (Piepho 2022). In contrast to EC that show only information about a single covariate, SC potentially includes information on all covariates. The extraction of the SCs has been done through a multivariate partial least squares method where the genotype-by-location effects are regressed against the environmental covariates (Piepho and Blancon 2023). Our focus here is to investigate and compare different modeling strategies that provide precise genotypic predictions for untested locations through pedigree information and a large number of ECs. In order to mimic prediction scenarios in new locations, we followed a leave-one-location-out cross-validation (CV) mechanism.
In this study, we propose a modeling strategy for predicting genotype performances in untested locations using MET and evaluate their predictive ability. The general objective was to compare the predictive accuracy of models using MET data analysis (i) without pedigree and SC and (ii) with pedigree or/and SC, under three different variance–covariance structure of the GEI.
Material and methods
Data source
We used sorghum (Sorghum bicolor (L.) Moench) data from the Melkasa Agricultural Research Center (MARC), which is located near Adama City, southeast of Addis Ababa. MARC is responsible for the national sorghum breeding program in Ethiopia under the coordination of Ethiopian Institutes of Agricultural Research (EIAR). In this study, we used MET data of the year 2019 which comprises six trials. These trials represent a dry lowland sorghum breeding program of Ethiopia and yield performance of genotypes measured in kilogram per hectare was considered. The field trials were laid out as resolvable row-column designs. In each trial, the plot arrangement was 25 rows by four columns per replicate. One hundred genotypes including two checks (‘Melkam’ and ‘Argiti’) were replicated twice. These genotypes were in fact selected from the previous trials of the ongoing breeding program where 500 genotypes were randomized according to a partially replicated design at three locations. These 100 genotypes were the complete set of genotypes selected from the early breeding stage. Therefore, this dataset is extracted from the ongoing breeding program. All genotypes have pedigree information except for one check (‘Melkam’). Trial’s description and the environmental parameters used in this paper is described in Tables 1 and 2, respectively. The environmental parameters include weather data, and soil information taken at different soil layers. We obtained 65 ECs in total from each trial (Table 2). Most of the soil data were taken from EthioSIS map of 250 m spatial resolution, while some were obtained from ISRIC (FAO 2020). The weather data were obtained from weather stations of sorghum breeding trials in which the average temperature, and rainfall was considered.
Statistical methods
Our modeling strategy follows a stage-wise approach, where information from Stage I is forwarded to Stage II (Piepho et al. 2012). In Stage I, individual locations were subjected to an LMM analysis producing adjusted genotype means and associated variance–covariance matrix of genotype means. Adjusted means and their precision measure from Stage I were then forwarded to the second-stage analysis, where the combined analysis was conducted across locations.
Stage I analysis
The LMM used for each location in Stage I (Diriba and Piepho 2023) can be expressed as:
where \({y}_{ijkl}\) is the observed yield of the i-th genotype in the k-th row and l-th column within replicate j, \(\mu\) is the intercept, \({a}_{i}\) is the fixed effect of the i-th genotype, \({h}_{j}\sim N(0,{\sigma }_{h}^{2})\) is the random effect of the j-th replicate, \({r}_{jk}\sim N(0,{\sigma }_{r}^{2})\) is the random effect of the k-th row nested in the j-th replicate, \({c}_{jl}\sim N(0,{\sigma }_{c}^{2})\) is the random effect of the l-th column nested in the j-th replicate and \({e}_{ijkl}\sim N(0,{\sigma }_{e}^{2})\) is the error associated with \({y}_{ijkl}\). Using Eq. (1), we estimated genotype means (\({\overline{y} }_{im})\) for the i-th (i = 1, 2, …, I + 1) genotype at each of M locations (m = 1, 2, …, M). To forward information of Stage I analysis, genotype means of the m-th location sorted by genotype were put into a vector \({{\varvec{y}}}_{m}=({\overline{y} }_{1m}, {\overline{y} }_{2m}, \dots , {\overline{y} }_{Im})\). Note that only I genotype means per location were forwarded to Stage II as standard check ‘Melkam’ was dropped after estimating means in Stage I due to missing pedigree information. Furthermore, we defined the vector \({\varvec{y}}=({{\varvec{y}}}_{1}, {{\varvec{y}}}_{2}, \dots , {{\varvec{y}}}_{M})\) as a vector of genotype means across locations. To forward precision of genotype means, weights were calculated from the Stage I estimated error variance–covariance structure of genotype means \({{\varvec{y}}}_{m}\) denoted as \({{\varvec{\Omega}}}_{m}\). The inverse \({{\varvec{\Omega}}}_{m}^{-1}\) was approximated by a diagonal matrix formed by the diagonal elements of \({{\varvec{\Omega}}}_{m}^{-1}\) (Damesa et al. 2017; Smith et al. 2001). Hence, these diagonal elements were used as weights in the second stage. The matrix with the inverses of the weights down the diagonal approximates \({{\varvec{\Omega}}}_{m}\) and will be denoted as \({{\varvec{\Omega}}}_{m}^{(d)}\).
Stage II analysis
In Stage II, we considered genotype as the random factor. This allows to include pedigree information. In addition, location was considered as a random factor, too, so that prediction for new locations is possible. Therefore, with vector \({\varvec{a}} = {({a}_{1}, {a}_{2},\dots ,{a}_{I})}^{T}\) of genotype effects, vector \({\varvec{l}}={({l}_{1}, {l}_{2}, \dots , {l}_{M})}^{T}\) of location effects and vector \({\varvec{s}}={({s}_{11}, {s}_{12}, \dots ,{s}_{1M},{s}_{21},{s}_{22}\dots , {s}_{2M},\dots , {s}_{IM})}^{T}\) of genotype-by-location interaction effects, the basic model considered in Stage II analysis can be written as
where \({\varvec{y}}\) is a vector of estimated genotype-by-location means from Stage I, \({1}_{IM}\) is a vectors of ones, \(\mu\) is the intercept, \({\varvec{a}}\sim N(0,{\text{I}}_{I}{\sigma }_{a}^{2}), {\varvec{l}}\sim N(0,{\text{I}}_{M}{\sigma }_{l}^{2})\) and \({\varvec{s}}\sim N(0,{\text{I}}_{IM}{\sigma }_{s}^{2})\) are vectors of genotype, location and genotype-by-location interaction parameters where I is identity matrix with the subscript represent the dimension, \({{\varvec{Z}}}_{1},\boldsymbol{ }{{\varvec{Z}}}_{2}\) and \({{\varvec{Z}}}_{3}\) are the corresponding design matrices, respectively and \({\varvec{f}}\) is a vector of error containing sub-vectors \({{\varvec{f}}}_{m}\), with var(\({{\varvec{f}}}_{m})\)=\({{\varvec{\Omega}}}_{m}^{(d)}\). The total variance–covariance matrix of \({\varvec{f}}\) is given by
Modeling covariance structures and pedigree information
The basic model assumes homogeneous variances and independence between genotype, location and genotype-by-location interactions effects, fitting identity matrices with constant variance in the corresponding variance–covariance structures. The baseline model was modified in two ways. First, the identity matrix for the genotype-by-location interactions was modified to allow for diagonal or FA variance–covariance structures. Second, the independence between genotypes was modified to allow for a kinship matrix. The kinship matrix, multiplied by the genetic variance, contains the genetic variances on the diagonal while the off-diagonal elements are the genetic covariance between pairs of genotypes. Therefore, with \(\mathbf{\rm A}\) matrix representing the \(I\times I\) numerator relationship for \(I\) genotypes, the variance–covariance structures in Eq. (2) can be redefined as \({\varvec{a}}\sim N(0,{{\varvec{\Gamma}}\sigma }_{a}^{2})\), \({\varvec{l}}\sim N(0,{\mathbf{I}}_{M}{\sigma }_{l}^{2})\) and \({\varvec{s}}\sim N(0,{\varvec{\Gamma}}\otimes{\varvec{\Pi}})\), where \({\varvec{\Gamma}}=\mathbf{I}\) or \(\mathbf{A}\), \({\varvec{\Pi}}=\mathbf{I}{\sigma }_{s}^{2}\), \({\varvec{\Pi}}={\varvec{\Phi}}\) (diagonal) or \({\varvec{\Pi}}={\varvec{\Sigma}}\) (FA) with
and \(\otimes\) denotes Kronecker product (Burgueño et al 2012).
For the FA structure, multiplicative terms for approximating the variance–covariance matrix of the genotypes-by-location interaction effects (Piepho 1997, 1998a, b; Smith et al. 2001; Crossa et al. 2004, 2006; Burgueño et al. 2011, 2012) were used. In this case, the variance–covariance structure for the genotype-by-location interactions can be expressed as \(\text{FA}\left(K\right)={\varvec{\Sigma}}=\left(\wedge {\wedge }^{\boldsymbol{^{\prime}}}+{\varvec{\Phi}}\right)\), where K is the number of latent factors, \(\wedge\) is the \(M\times K\) matrix in which the k-th column contains location loadings for k-th latent factor and \({\varvec{\Phi}}\) is a \(M\times M\) diagonal matrix (Burgueño et al. 2012). When modeling the variance–covariance using FA structures, it is possible to consider more than one component; however, as the number of components gets larger, there can be numerical problems of fitting the model (Studnicki et al. 2017). In order to decide on the number of components, one can use information criteria like the Akaike Information Criterion (AIC) (Wolfinger 1993). In our case, we tried FA(1), FA(2) and FA(3) orders and selected the FA(2) structure based on AIC.
Modeling environmental covariates
For modeling environmental covariates, we extracted SCs from ECs for each location that represents the actual ECs following a method proposed by Piepho and Blancon (2023). This method extracts a set of SCs from a set of independent variables where the extraction is achieved through a set of orthogonal factors named as latent variables (Krishnan 2010). Before extracting SCs, the ECs were standardized to mean zero and unit variance. Then, the standardized covariates were fitted against genotype-environment means using a multivariate partial least squares (PLS) approach regarding each genotype’s response as a different variates to get the SC. We used the ‘mvr’ function in R package for extracting SCs.
Then the extension of the model of Eq. (2) when considering the first SC can be written as follows
where \(\beta\) is the slope of \({\varvec{t}}\), where \({\varvec{t}}\) is a vector of SC of different environments, \({\varvec{a}}\) is a vector of random intercepts and \({\varvec{b}}=({b}_{1}, {b}_{2},\dots , {b}_{I})\) is a vector of random slope effects with \({\text{Z}}_{4}\) is the corresponding design matrix. When allowing for an unstructured variance–covariance matrix for random coefficients \({\varvec{a}}\) for the intercept and \({\varvec{b}}\) for the slope of each genotype, \(\left[\begin{array}{c}{\varvec{a}} \\ {\varvec{b}}\end{array}\right]\sim N(0, {\varvec{G}}\otimes{\varvec{\Gamma}})\), where \({\varvec{G}}=\left[\begin{array}{cc}{\sigma }_{a}^{2}& {\sigma }_{ab}\\ {\sigma }_{ab}& {\sigma }_{b}^{2}\end{array}\right]\) and \({\varvec{\Gamma}}\) is either I or \(\mathbf{A}\). An extension to consider several SCs is straightforward, using the intercept \({\varvec{a}}\) and slopes \({{\varvec{b}}}_{1},\boldsymbol{ }{{\varvec{b}}}_{2}, \dots\) for the SCs. The basis for deciding on the number of SCs is to check if additional SC can improve prediction accuracy. The first SC is expected to explain the largest amount of variance compared to subsequent ones. We used coefficients of environmental covariates to identify the dominant variates in the extracted SC. In addition, characterization of environment using ECs was done by a PLS biplot.
Following Eq. (2) to Eq. (4), a series of 12 models in stage II analysis were fitted and compared for predictive accuracy of genotype performances in untested locations as summarized in Table 3 considering the first SC.
In Table 3, models M1–M4 were fitted considering the identity variance–covariance structure for the genotype-by-location interactions, M5–M8 were the diagonal and M9–M12 were the FA structures. Within each type of variance–covariance structure, the first model was fitted without SC and pedigree information, the second model with pedigree information, the third model with SC, and the fourth model with SC plus pedigree information.
Model evaluation
To mimic prediction scenarios in untested locations, a leave-one-location-out CV algorism was implemented. According to this CV, we dropped all genotype means of a given location at a time and assigned means from this location as a validation set whereas the genotype means from the remaining locations served as a training set. A certain limitation of this type of CV is that the prediction accuracy can be affected by population structure and family structure during genomic selection (Xavier 2021; Werner et al. 2020). However, despite this limitation, we think it is the best method for our purpose, which is to assess predictive accuracy for unseen environments. Prediction of genotype means for the dropped location was then made using the training data set. In this study, for the models with SC, the SC from the dropped locations was also considered. The model predictions for the genotypes-by-location means was expected to benefit from borrowing information like between lines in the same location, between genotypes across location and through correlated locations (Burgueño et al. 2012; Buntaran et al. 2021). The prediction of genotype means was computed across locations in all models. When modeling the covariances between locations in the genotype-by-location interactions, like that in the FA structure, predicting genotype means across locations based on the genotype main effect alone can be misleading since part of the genotype main effect may be absorbed in the interactions effect (Piepho and Williams 2024). For this reason, we added the best linear unbiased predictions (BLUPs) of the genotype main effect and average of BLUPs of the interaction effects for the genotype. Therefore, for the FA structure we considered both prediction scenarios. The model accuracy in predicting genotype performances for untested locations was then evaluated and compared.
The model comparison was made using Spearman rank correlation and mean squared errors of prediction differences (MSEPD). The correlation between estimated genotype-by-location means from Stage I and predicted values from Stage II analysis ignoring the corresponding location was computed. The correlation was first computed per location and then, averaged across locations to obtain average correlation for each specific model. The correlation between estimated and predicted values assesses the degree of consistency in genotype ranking (Roostaei et al. 2014). In addition, predictive accuracy of the model was also assessed using MSEPD for genotypes (Buntaran et al. 2021; Studnicki et al. 2017). As proposed by Piepho (1998a, b), the MSEPD focuses on comparing the difference between the observed difference between two genotypes in a given location \(\left({\overline{y} }_{im}-{\overline{y} }_{i{\prime}m}\right)\) and the corresponding predicted difference say \(\left({z}_{im}-{z}_{i{\prime}m}\right)\). The smallest MSEPD for the differences is an indication of the best model. The MSEPD is computed as
where M is the number of locations, and I is the number of genotypes as defined before. In our case, \({z}_{im}\) and \({z}_{i{\prime}m}\) are predicted values obtained from Stage II using data from all locations except of location m.
We used ASReml-R 4.1.0.130 (Butler et al. 2017) for fitting our models (Fig. 1).
Results
Figure 2 shows the PLS-biplot of Comp1 versus Comp2 obtained using the ‘pls’ package in R. In this figure, the first component (Comp1) explains 42.66% of the total variance, while the second component (Comp2) explains 27.61% of the total variance. Both Comp1 and Comp2 jointly explain 70.27% of the total variance.
Table 4 provides rank of the fifteen coefficients of the environmental covariates based on their absolute value. The clay soil property taken at different soil layers is the most dominant in the generated SC. The coefficients of all environmental covariates are provided as a supplementary (S1) file.
Table 5 shows the MSEPD and average rank correlations values of the cross-validation of 12 models. For models without the SC, fitting pedigree data shows some improvement in the diagonal and FA variance–covariance structures of the genotype-by-location interactions when compared to the model without pedigree information. The rank correlation resulted in small difference between models with and without pedigree information in three of the variance–covariance structures. When the first SC was fitted, the diagonal variance–covariance structure resulted in the minimum MSEPD (0.71342 t2/ha2) followed by the FA (0.90766 t2/ha2) and the identity (0.95536 t2/ha2) variance–covariance structures, respectively. Based on the rank correlations, the comparison indicates that the FA variance–covariance structure comes first (0.5837) followed by the diagonal (0.509) and the identity (0.4638) variance–covariance structures. When the first two SCs are considered, there is no gain in the fitted model compared to fitting only one SC for the identity and diagonal variance–covariance structures but a small gain is found with the FA variance–covariance structure according to MSEPD and average rank correlation. With the FA variance–covariance structure, the MSEPD changed from 0.90766 t2/ha2 when fitting one SC to 0.879093 t2/ha2 for fitting two SC, whereas the average rank correlation changed from 0.58367 to 0.588384.
Table 6 reports the mean squared error of predicted differences (MSEPD) and average rank correlation between adjusted means and predicted values for FA structures with one and without SC obtained by adding BLUP of the genotype main effect and the average of the BLUPs of the interaction effects for genotype. Fitting the SC shows smaller MSEPD and higher rank correlation when compared with others. Table 6 shows higher MSEPD compared with the one in Table 5 for many models and lower rank correlation for the FA structures. The standard errors of the correlations in Table 6 are smaller than those of the ones in Table 5 for all FA structures.
Figure 3 illustrate genotypes stability across locations using GGE biplot analysis. The red lines represent the location names, while the green represent list of genotypes. The plot shows there is a positive correlation between locations. Only ‘KB’ and ‘SR’ seem to be uncorrelated. Genotypes 2, 78, 83 and 14 seem to be good in all locations.
Genotype stability across locations obtained using GGE biplot analysis. The red color represents location names, and the green color represents genotypes. The acronyms for locations are resolved in Table 1
Figure 4 shows boxplot of yield response (t/ha) in different locations. On average, the ‘SH’ location shows high yield while ‘ER’ has low yield.
Boxplot plot of mean yield (t/ha) across different locations. The trial IDs are reported in Table 1
Discussion
Evaluation of genotype performances in the TPE is a core focus of plant breeders. One advantage of METs is the possibility of allowing borrowing of information among trials during the data analysis (Crossa et al. 2006; Piepho et al. 2008). The MET data analysis can follow either a one-stage or a stage-wise approach for predicting genotype performances in the TPEs. In Stage I of a stage-wise analysis, estimated genotype means and the respective variance–covariance matrix is saved per trial and used during Stage II analysis (Piepho et al. 2012). According to recent studies, a stage-wise analysis has many practical advantages over one-stage analysis (Piepho et al. 2012; Damesa et al. 2017). Three of these advantages are that it is computationally less demanding, that combining trials with different design background is straightforward, and that there are relatively less convergence problems. In our case, the main advantage of the stage-wise analysis was less computational time and fewer convergence problems. During Stage II analysis, different variance–covariance structures of the genotype-by-location interactions can easily be considered with less computational demand to allow for borrowing information through correlated locations. The FA variance–covariance structure is one of the commonly used models in plant breeding (Studnicki et al 2017).
One of the current advancements the plant breeding trials to improve prediction accuracy is incorporating ECs in the data analysis. The main challenge is how to deal with the large number of ECs to fit in the MET. For this purpose, several studies recommended the use of PLS analysis (Vargas et al. 1998, 1999; Crossa et al. 1999; Montesinos-López et al. 2022). It is also possible in principle to consider the actual ECs individually using factorial regression (Denis 1980) with a lower number of ECs; however, with large number of ECs, it is quite difficult to do so (Buntaran et al. 2021; Piepho 2022; Costa-Neto et al. 2023; Piepho and Blancon 2023). In our case, we extracted a smaller number of SCs from the actual ECs using a multivariate PLS technique. This technique considers different genotypes as variates to obtain a single linear combination of covariates to characterize each location (Piepho and Blancon 2023). It also possible to characterize environments through a PLS biplot (Fig. 1).
This study indicated a gain in prediction accuracy from fitting SC in MET compared to the model without SC when predicting genotype means for untested locations, which is also confirmed in other studies (Heslot et al. 2014; Buntaran et al. 2021; Montesinos-López et al. 2022). Jarquín et al. (2014) considered a kinship or kernel regression approach based on ECs to predict genotype performance in an incomplete trial. In our case, we extracted SC from the actual ECs to fit the model using LMM and make predictions. This method is more advantageous compared to fitting the actual ECs since a large number of ECs can be considered through extracting smaller number of SC and the prediction can easily be made for the new locations. Apart from extracting SC through multivariate PLS, different alternative methods of extracting SC were also illustrated in Piepho and Blancon (2023). Here, we favored PLS because it can deal with a larger number of EC. The number and kind of ECs depend on availability and potential of the environmental data. In our case, we consider the soil information more important than weather data since we considered a dry lowland sorghum breeding program, where the temperature and rainfall are relatively similar for all locations. In addition, coefficients of environmental covariates obtained from multivariate PLS analysis help to understand the dominant variates in the extracted SC (Table 4). We would like to stress that the success of GEI modeling depends crucially on the choice of EC and that more is not always better. It is a good strategy to judiciously choose the EC to be included in the analysis based on subject matter knowledge of the crop growth cycle and the key driving factors of growth.
More than one SCs can be fitted in the MET to make prediction. However, the best way is to start with the first SC and check for if there is a gain in fitting more than one SCs. Even if the first SC can capture less than 50%, the first SC capture larger parts of variance compared to all other SCs. Our results showed larger MSEPD and smaller rank correlations with fitting two SCs compared to only fitting the first SC except for FA as indicated in Table 5. We think this is primarily due to the small number of environments. Our results here are based on only six trials and single year data which can be considered as a rather limiting number of environments. However, we believe that a meaningful set of ECs were considered. If available, considering more trials will certainly be advantageous. Fitting two or more SCs in the MET is straightforward using the random coefficients of genotypes for the SCs. When fitting the SC, convergence problems may arise which we approached through setting different initial values of the variance parameters.
The predictive accuracy of pedigree-based models was evaluated, resulting in less gain compared to the one without pedigree and SC. Ideally, pedigree-based modeling allows borrowing strength across genotypes and thereby improving accuracy of genomic prediction. According to recent studies, marker-based models result in more accurate prediction compared to pedigree information (Crossa et al. 2010; Burgueño et al. 2012). Burgueño et al. (2012) compared the prediction accuracy of marker and pedigree-based models. The aim of the comparison was in predicting genotype performances in untested locations using multi-environment mixed models and concluded that marker-based model gives more accurate prediction than pedigree-based model. The basic idea behind fitting either pedigree or marker-based models is that the prediction accuracy is expected to be benefit from correlated information among relatives. In our case, we do not have marker data at hand. The results of fitting pedigree information plus SC are encouraging especially when the diagonal and FA variance–covariance structures for the genotype-by-location interactions were considered.
When different models are used in predicting genotype performances, it is necessary to evaluate the prediction accuracy of the candidate models. When allowing covariances between locations in the genotype-by-location interaction effects, part of the genotype main effect can be absorbed in the interaction effects. In this case, we may need to sum the BLUP of the genotype main effect and average of the BLUPs of the interaction effect for the genotype (Piepho and Williams 2024). The prediction precision of different models can be accessed by using MSEPD as proposed by Piepho (1998a, b) since breeders are more interested in the difference between genotypes means rather than the exact value of specific genotype mean. The model that resulted in the minimum MSEPD is considered as the best model. In our case, the smallest MSEPD was obtained when fitting the SC which highlights the importance of considering ECs for predicting genotype means in the new locations.
In all models, the rank correlation was positive between estimated genotype means and predicted values, with strong correlation obtained for the model with the SC. The strong correlation with the SC is an indication that genotype ranking can be improved through fitting SC. The results for both MSEPD and rank correlation confirm the importance of considering enviromics in genotypic prediction which is also recommended in a recent work (Resende et al. 2024). Particularly, the soil texture (clay and sandy) can be considered as major contributing factor as indicated in Table 4 and needs to be accounted for in the future in the sorghum breeding program.
In this paper, our methods were applied to a single mega-environment; however, the proposed method can also be adopted for more than one mega-environment. With different mega-environments, locations are clustered to form strata or zones where each stratum consisting of several environments (Buntaran et al. 2021). The extension of our proposed methods to several mega-environments is straight-forward, requiring inclusion of a fixed zone effect and its random interactions with genotypes and years in the Stage II analysis. Based on our findings and other recent studies, we conclude that the use of SC increase prediction accuracy in predicting genotype performances for untested locations given that an appropriate statistical model is used (Costa-Neto et al. 2023; Heslot et al. 2014).
Conclusion
From this study, we conclude that fitting SC can increase prediction accuracy in new locations while the model with both SC plus pedigree information is considered as a promising candidate. The fitted SC performs better in combination with the diagonal and the FA variance–covariance structures of genotype-by-location interactions than when the identity variance–covariance structure was used.
Data availability
The estimated yield data used in Stage II analysis, pedigree and environmetal covariates data are available as electronic Supplementary Materials.
Code availability
The R code is available as electronic Supplementary Materials.
References
Buntaran H, Forkman J, Piepho HP (2021) Projecting results of zoned multi-environment trials to new locations using environmental covariates with random coefficient models: accuracy and precision. Theor Appl Genet 134(5):1513–1530. https://doi.org/10.1007/s00122-021-03786-2
Buntaran H, Bernal-Vasquez AM, Gordillo A, Sahr M, Wimmer V, Piepho HP (2022) Assessing the response to genomic selection by simulation. Theor Appl Genet 135(8):2891–2905. https://doi.org/10.1007/s00122-022-04157-1
Burgueño J, Crossa J, Cotes M, San Vicente F, Das B (2011) Prediction assessment of linear mixed models for multienvironment trials. Crop Sci 51:944–954. https://doi.org/10.2135/cropsci2010.07.0403
Burgueño J, de los Campos G, Weigel K, Crossa J (2012) Genomic prediction of breeding values when modelling genotype × environment interaction using pedigree and dense molecular markers. Crop Sci 52(2):707–719. https://doi.org/10.2135/cropsci2011.06.0299
Butler DG, Cullis B, Gilmour A, Gogel BJ, Thompson R (2017) ASReml-R reference manual, version 4. University of Wollongong, Wollongong
Cooper M, Messina CD, Podlich D (2014) Predicting the future of plant breeding: complementing empirical evaluation with genetic prediction. Crop Pasture Sci 65:311–336
Costa-Neto G, Crespo-Herrera L, Fradgley N, Gardner K, Bentley AR, Dreisigacker S, Fritsche-Neto R, Montesinos-López OA, Crossa J (2023) Envirome-wide associations enhance multi-year genome-based prediction of historical wheat breeding data. G3. https://doi.org/10.1093/g3journal/jkac313
Crossa J, Vargas M, van Eeuwijk FA, Jiang C, Edmeades GO, Hoisington D (1999) Interpreting genotype × environment interaction in tropical maize using linked molecular markers and environmental covariables. Theor Appl Genet 99:611–625. https://doi.org/10.1007/s001220051276
Crossa J, Yang RC, Cornelius PL (2004) Studying crossover genotype × environment interaction using linear-bilinear models and mixed models. J Agric Biol Environ Stat 9:362–380. https://doi.org/10.1198/108571104X4423
Crossa J, Burgueño J, Cornelius PL, McLaren G, Trethowan R, Krishnamachari A (2006) Modelling genotype × environment interaction using additive genetic covariances of relatives for predicting breeding values of wheat genotypes. Crop Sci 46(4):1722–1733. https://doi.org/10.2135/cropsci2005.11-0427
Crossa J, De Los Campos G, Pérez P, Gianola D, Burgueño J, Araus JL, Makumbi D, Singh RP, Dreisigacker S, Yan J, Arief V, Banziger M, Braun HJ (2010) Prediction of genetic values of quantitative traits in plant breeding using pedigree and molecular markers. Genetics 186(2):713–724. https://doi.org/10.1534/genetics.110.118521
Damesa TM, Möhring J, Worku M, Piepho HP (2017) One step at a time: stage-wise analysis of a series of experiments. Agron J 109:845–857. https://doi.org/10.2134/agronj2016.07.0395
Denis JB (1980) Analyse de régression factorielle. Biom Praxim 20:1–34
Denis JB (1988) Two-way analysis using covariates. Statistics 19:123–132. https://doi.org/10.1080/02331888808802080
FAO (2020) Ten years of the Ethiopian agricultural transformation agency An FAO Evaluation of the Aagency’s Impact on Agricultural Growth and Poverty Reduction. Rome. https://doi.org/10.4060/cb2422en
Gilmour ArR, Cullis BR, Verbyla AP, Verbyla AP (1997) Accounting for natural and extraneous variation in the analysis of field experiments. J Agric Biol Environ Stat 2(3):269. https://doi.org/10.2307/1400446
Henderson CR (1991) Contributions to predicting genetic merit. L. R SCHAEFFER centre for genetic improvement of livestock university of Guelph, Guelph
Heslot N, Akdemir D, Sorrells ME, Jannink JL (2014) Integrating environmental covariates and crop modeling into the genomic selection framework to predict genotype by environment interactions. Theor Appl Genet 127(2):463–480. https://doi.org/10.1007/s00122-013-2231-5
Isik F, Holland J, Maltecca C (2017) Genetic data analysis for plant and animal breeding, 1st edn. Springer, New York
Jarquín D, Crossa J, Lacaze X, Du Cheyron P, Daucourt J, Lorgeou J, Piraux F, Guerreiro L, Pérez P, Calus M, Burgueño J, de los Campos G (2014) A reaction norm model for genomic selection using high-dimensional genomic and environmental data. Theor Appl Genet 127(3):595–607. https://doi.org/10.1007/s00122-013-2243-1
Krishnan A, Williams LJ, McIntosh AR, Abdi H (2011) Partial least squares (PLS) methods for neuroimaging: a tutorial and review. Neuroimage 56(2):455–475. https://doi.org/10.1016/j.neuroimage.2010.07.034
Li X, Guo T, Wang J, Bekele WA, Sukumaran S, Vanous AE, McNellie JP, Cortes LT, Lopes MS, Lamkey KR, Westgate ME, McKay JK, Archontoulis SV, Reynolds MP, Tinker NA, Schnable PS, Yu J (2021) An integrated framework reinstating the environmental dimension for GWAS and genomic selection in crops. Mol Plant 14(6):874–887. https://doi.org/10.1016/j.molp.2021.03.010
Li X, Guo T, Bai G, Zhang Z, See D, Marshall J, Garland-Campbell KA, Yu J (2022) Genetics-inspired data-driven approaches explain and predict crop performance fluctuations attributed to changing climatic conditions. Mol Plant 15(2):203–206. https://doi.org/10.1016/j.molp.2022.01.001
Montesinos-López OA, Montesinos-López A, Kismiantini ARG, Gardner K, Lillemo M, Fritsche-Neto R, Crossa J (2022) Partial least squares enhances genomic prediction of new environments. Front Genet. https://doi.org/10.3389/fgene.2022.920689
Mrode RA (2005) Linear models for the prediction of animal breeding values, 2nd edn. Scottish agricultural college Midlothian, Edinburgh
Pérez-Rodríguez P, Crossa J, Bondalapati K, Meyer GD, Pita F, de los Campos G (2015) A pedigree based reaction norm model for prediction of cotton yield in multienvironment trials. Crop Sci 55:1143–1151
Piepho HP (1997) Analyzing genotype-environment data by mixed models with multiplicative effects. Biometrics 53:761–766. https://doi.org/10.2307/2533976Piepho
Piepho HP (1998a) Empirical best linear unbiased prediction in cultivar trials using factor-analytic variance-covariance structures. Theor Appl Genet 97(1–2):195–201. https://doi.org/10.1007/s001220050885
Piepho HP (1998b) Methods for comparing the yield stability of cropping systems—a review. J Agron Crop Sci 180(4):193–213. https://doi.org/10.1111/j.1439-037X.1998.tb00526.x
Piepho HP (2022) Prediction of and for new environments: What’s your model? Mol Plant 15(4):581–582. https://doi.org/10.1016/j.molp.2022.01.018
Piepho HP, Blancon J (2023) Extending Finlay-Wilkinson regression with environmental covariates. Plant Breed. https://doi.org/10.1111/pbr.13130
Piepho HP, Ogutu JO (2002) A simple mixed model for trend analysis in wildlife populations. J Agric Biol Environ Stat. https://doi.org/10.1198/108571102366
Piepho HP, Möhring J, Melchinger AE, Büchse A (2008) BLUP for phenotypic selection in plant breeding and variety testing. Euphytica 161(1–2):209–228. https://doi.org/10.1007/s10681-007-9449-8
Piepho HP, Möhring J, Schulz-Streeck T, Ogutu JO (2012) A stage-wise approach for analysis of multi-environment trials. Biometrics 54:844–860. https://doi.org/10.1002/bimj.201100219
Piepho HP, Williams ER (2024) Factor-analytic variance-covariance structures for prediction into a target population of environments. Biom J (in press)
Resende RT, Piepho HP, Rosa GJM, Silva-Junior OB, e Silva FF, de Resende MDV, Grattapaglia D (2021) Enviromics in breeding: applications and perspectives on envirotypic-assisted selection. Theor Appl Genet 134(1):95–112. https://doi.org/10.1007/s00122-020-03684-z
Resende RT, Hickey L, Amaral CH, Peixoto LL, Marcatti GE, Xu Y (2024) Satellite-Enabled Enviromics to Enhance Crop Improvement. Mol Plant. https://doi.org/10.1016/j.molp.2024.04.005
Roostaei M, Mohammadi R, Amri A (2014) Rank correlation among different statistical models in ranking of winter wheat genotypes. Crop J 2:154–163. https://doi.org/10.1016/j.cj.2014.02.002
Smith AB, Cullis BR (2018) Plant breeding selection tools built on factor analytic mixed models for multi-environment trial data. Euphytica. https://doi.org/10.1007/s10681-018-2220-5
Smith A, Cullis BR, Thompson R (2001) Analyzing variety by environment data using multiplicative mixed models and adjustments for spatial field trend. Biometrics 57:1138–1147. https://doi.org/10.1111/j.0006-341X.2001.01138.x
Smith AB, Cullis BR, Thompson R (2005) The analysis of crop cultivar breeding and evaluation trials: an overview of current mixed model approaches. J Agric Sci 143(6):449–462. https://doi.org/10.1017/S0021859605005587
Studnicki M, Paderewski J, Piepho HP, Wójcik-Gront E (2017) Prediction accuracy and consistency in cultivar ranking for factor-analytic linear mixed models for winter wheat multienvironmental trials. Crop Sci. https://doi.org/10.2135/cropsci2017.01.0004
Tadese D, Piepho HP (2023) Spatial model selection and design evaluation in the Ethiopian sorghum breeding program. Agron J 115(6):2888–2899. https://doi.org/10.1002/agj2.21450
van Eeuwijk FA (1992) Interpreting genotype-environment interaction using redundancy analysis. Theor Appl Genet 85:92–100
Vargas M, Crossa J, Sayre K, Reynolds M, Ramírez ME, Talbot M (1998) Interpreting genotype x environment interaction using partial least squares regression. Crop Sci 38:679–689
Vargas M, Crossa J, Eeuwijk FA, Ramírez ME, Sayre K (1999) Using partial least squares regression, factorial regression, and AMMI models for interpreting genotype × environment interaction. Crop Sci 39(4):955–967. https://doi.org/10.2135/cropsci1999.0011183X003900040002x
Werner CR, Gaynor RC, Gorjanc G, Hickey JM, Kox T, Abbadi A, Leckband G, Snowdon RJ, Stahl A (2020) How population structure impacts genomic selection accuracy in cross-validation: Implications for practical breeding. Front Plant Sci 11:2028
Wolfinger R (1993) Covariance structure selection in general mixed models. SAS Institute, Inc., SAS. Campus drive, cary, North Carolina 27513–2414, U.S.A. https://doi.org/10.1080/03610919308813143
Xavier A (2021) Technical nuances of machine learning: implementation and validation of supervised methods for genomic prediction in plant breeding. Crop Breed Appl Biotechnol 21:e381421S2. https://doi.org/10.1590/1984-70332021v21sa15
Xu Y (2016) Envirotyping for deciphering environmental impacts on crop plants. Theor Appl Genet 129:653–673. https://doi.org/10.1007/s00122-016-2691-5
Acknowledgements
We acknowledge the Ethiopian Institute of Agricultural Research (EIAR), particularly lowland sorghum breeders, agrometeorology and GIS teams for accessibility and clarification of the data. DT thanks the Deutscher Akademischer Austauschdienst (DAAD) for supporting this study.
Funding
Open Access funding enabled and organized by Projekt DEAL. This work is funded by the Deutscher Akademischer Austauschdienst (DAAD) for supporting this study (grant 57507871).
Author information
Authors and Affiliations
Contributions
DT performed conceptualization, data curation, formal analysis, funding acquisition, investigation, methodology and writing—original draft. HPP provided methodology, resources, software, reading, editing, supervision and validation of the manuscript. JH presented methodology, resources, software, analysis, editing, reading and validation of the manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that there is no conflict of interest.
Additional information
Communicated by Daniela Bustos-Korts.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Tadese, D., Piepho, H. & Hartung, J. Accuracy of prediction from multi-environment trials for new locations using pedigree information and environmental covariates: the case of sorghum (Sorghum bicolor (L.) Moench) breeding. Theor Appl Genet 137, 181 (2024). https://doi.org/10.1007/s00122-024-04684-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00122-024-04684-z