Abstract
The quality of the talent development environment and how it supports youth athletes has been identified as one major factor of success. Nonetheless, in psychological talent assessment there is a lack of standardized instruments addressing environmental aspects. One well-known questionnaire is the Talent Development Environment Questionnaire (TDEQ; Martindale et al., 2010). Until recently, the TDEQ had been translated into several languages, but not into German. Within this study, the five-factor, 25-item TDEQ‑5 (Li, Wang, Pyun, & Martindale, 2015) was systematically forward and backward translated and administered to 276 German youth athletes from different sports, aged between 13 and 21 years (mean [M] = 16.01; standard deviation [SD] = 2.1). In addition, 63 of these athletes completed both the German and English TDEQ‑5 to test for quality of translation. Confirmatory factor analysis revealed that the five-factor structure was acceptable according to the chi-square test to degrees of freedom ratio (1.9), root mean square error of approximation (0.058), and standardized root mean square (0.061). The comparative fit index (CFI) of 0.88 and the Tucker-Lewis Index of 0.86 was slightly below the 0.90 cut-off value. The reliabilities of the TDEQ‑5 factors were considered moderate to satisfactory (α = 0.62 to 0.75). In conclusion, the German TDEQ‑5 appears to be an applicable tool for use in research and applied settings but needs further analysis. In particular, we encourage future research to test the construct validity and ecological validity of the German TDEQ‑5 and suggest practitioners to utilize the tool to test and drive applied interventions within talent development environments.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Talent development (TD) is a complex and dynamic process which influences the development of athletes in a multidimensional way, with the ultimate goal of maximizing their potential. Researchers used to emphasize various sources of influence on talent development. The focus of respective models lies, for example, on the early years of expertise development due to practice (Coutinho, Mesquita, & Fonseca, 2016), on athlete variables like motivation and physiology, and/or on social influences, coaches, parents, and clubs in particular (Gulbin, Croser, Morley, & Weissensteiner, 2013). In the following, we will concentrate on environmental variables, and—as some models of athlete development (see Gulbin et al., 2013; Li, Wang, & Pyun, 2014) tend to rely on Gagné’s Differentiated Model of Giftedness and Talent (DGMT)—we will shortly introduce this model first and afterwards proceed to the environmental aspects of athlete talent development in particular.
In the DGMT, Gagné (2020) distinguished between giftedness and talent. Giftedness is understood as the possession of natural abilities in any given domain (e.g., sensorimotor), which places someone in the top 10% of their peers. On the other hand, talent describes the mastery of skills through systematic training in a given field (e.g., sport; see Gagné, 2020). As such, talent is seen as influenceable over time, both through individual effort on the part of the person and through systematic support tailored to the person by the environment (Gulbin et al., 2013). Indeed, Collins and MacNamara (2017, p. 6) emphasize the high importance of achieving an optimal fit of “developing abilities in an appropriately challenging environment.” This highlights that “rather than focusing merely on intrapersonal factors such as athletes’ physical traits, key TD environmental factors should be identified and enhanced” (Li et al., 2015, p. 1831).
A crucial factor for such an athlete’s sport development pathway is the talent development environment (TDE), which refers to an organized system influencing the progression of athletes (Li et al., 2014; Martindale, Collins, & Daubney, 2005). This means that environmental variables should combine into a system with the goal of improving athletes’ performance and at the same time encourage their personal development. Most importantly, “this encompasses a more holistic ecological approach by examining the broader developmental context or environment in which athlete development takes place rather than focusing solely on the individual athlete” (Coutinho et al., 2016, p. 286). Over the past 15 to 20 years, there has been an increase in the number of researchers investigating the nature and structure of effective TDEs (e.g., Henriksen, Stambulova, & Roessler, 26,27,a, b; Martindale, Collins, & Abraham, 2007). Based on a literature review, Li et al. (2014) present a taxonomy of important environmental variables. Based on Gagné’s DGMT they distinguish three categories, namely milieu, individuals, and provisions. Milieu includes, among other things, sport culture and sport policy. Individuals is synonymous with social agents in the personal environment of the athlete, i.e., parents, coaches, and peers. Provisions focus on long-term development, quality preparation, and effective communication between coaches, managers, and club staff on the one hand and athletes on the other.
Interestingly, quantitative and qualitative research alike have shown that there are a number of factors that consistently seem to characterize successful environments across different contexts, sports, and cultures. Considering qualitative research, there are a number of studies that present key aspects of successful environments. For example, Martindale et al. (2007) studied a multisport sample of UK-based expert talent development coaches and found through interviews that four key principles emerged through effective environments. These included clear long-term aims and methods, wide-ranging coherent support and messages, an emphasis on appropriate development not early success, and individualized and ongoing development opportunities. Since then, a number of case studies of effective talent development environments across different cultures, sports, and contexts have found wider support for these key principles (e.g., Aalberg & Sæther, 2016; Gledhill & Harwood, 2015; Henriksen et al., 26,27,a, b, 2011, 2013; Larsen, Alfermann, Henriksen, & Christensen, 2013; Schacht & Kiewra, 2018; Seanor, Schinke, Stambulova, Ross, & Kpazai, 2017). As such, the features of successful athletic talent development environment case studies summarized by Henriksen and Stambulova (2017) include a focus on long-term development, strong and coherent organizational culture, integration of efforts, training groups with supportive relationships, proximal role models, support for sporting goals by a wider environment, training that allows for diversification, and support for the development of psychosocial skills.
Qualitative research has highlighted important principles of best practice, and usefully exemplified context-specific examples of how these principles have been implemented in various sport environments. Quantitative work has investigated the relationship between the environment and important developmental outcomes. This quantitative work has been made possible through development and use of the Talent Development Environment Questionnaire (TDEQ) (Martindale et al., 2010). The TDEQ was developed as a monitoring tool, “emphasizing the generic environmental features useful for facilitating the development of excellence across sports, stage/age, gender, and culture” (Martindale et al., p. 1216), to assess the perceived environment in the eyes of young developing athletes. The holistic key features were identified using a triangulated approach, including a literature review (Martindale et al., 2005), interviews with expert talent development coaches working within the United Kingdom, and interviews with developing athletes embedded within the talent pathway (Martindale et al., 2007). As outlined above, this led to four main areas on which effective talent development should be based, namely long-term aims and methods, wide-ranging coherent messages and support, emphasis on development not early success, and individualized and ongoing development.
Originally, 135 items were created based on these key factors which were further assessed by a panel of experts (sport psychologists, talent coaches) and by 82 developing athletes, aged 13 to 20 years (commenting on comprehensibility, relevance, and similarity of items). This process led to a 68-item questionnaire which was completed by 590 “junior athletes with identified potential” (Martindale et al., 2010, p. 1212), aged 13 to 21 years. The conducted exploratory factor analysis of this version with oblique rotation, principal axis factoring extraction, and reliability tests resulted in a 59-item seven-factor structure, the TDEQ‑7 (Martindale et al., 2010). The internal consistency (Cronbach’s alpha) of the seven factors ranged from 0.62 to 0.98.
The questionnaire has been further developed since its first publication, and in its most recent English language version (Li et al., 2015) it consists of 25 items with a five-factor structure (TDEQ-5), namely (1) long-term development focus (LTD), (2) communication (COM), (3) alignment of expectations (AOE), (4) holistic quality preparation (HQP), and (5) support network (SN). LTD describes (coaches’ or clubs’) initiatives to facilitate athletes’ long-term success. COM is concerned with the extent to which the coach communicates effectively with the athletes. AOE is focused on setting and communicating goals that are relevant for the athletes’ sport development. HQP includes interventions (e.g., mental skills training) for holistic development, and SN is focused on the social network (e.g., parents, professionals) that is available to the athlete. The five factors are described in greater detail in Table 1, including the items. The 25 items of the TDEQ‑5 are each answered on six-point Likert scales from 1 (“strongly disagree”) to 6 (“strongly agree”). Three of these factors (LTD, COM, HQP) correspond to the provision category presented by Li et al. (2014), the individual environment is exemplified by the factors SN and AOE.
To date, research using the TDEQ‑7 or the TDEQ‑5 has included investigation of the role of the talent development environment in predicting important outcomes such as progression and athlete motivation. For example, Martindale, Collins, Douglas, and Whike (2013) found that the TDEQ factors quality preparation and understanding the athlete were significant predictors of the progression rates of academy athletes to professional status. Other research investigating the relationship between the environment and athlete characteristics such as stress and wellbeing (Ivarsson et al., 2015, Thomas, Gastin, Abbott, & Main, 2021), mental toughness (Li, Martindale, & Sun, 2019), burnout (Li, Wang, & Pyun, 2017; Thomas et al., 2021), and motivational attributes (e.g., Wang, Sproule, McNeill, Martindale, & Lee, 2011, 2016) have highlighted the significance and positive role of environmental factors such as long-term development focus, communication, support network, and holistic quality preparation. In a longitudinal study with three points of measurement during one year, 195 Swedish young male soccer players filled in the TDEQ‑7 and measures of well-being. The perceived TDE at time 1 was categorized into three classes of high (n = 28 players), moderate (n = 118), and low quality (n = 51). A high TDE level was “characterized by a climate where the coach and the club have a clear and communicated vision for the players’ football development. The players have, with assistance from the coach been able to set clear performance goals, which are continuously evaluated and have a long-term development focus” (Ivarsson et al., 2015, p. 18). In addition, the TDE was rated higher in communication, understanding the athlete, and the support network than the TDE of moderate or low quality. The differences between the three TDE groups remained similar over the whole observation period. In addition, players with a high-quality TDE experienced less stress and increased subjective well-being over time (Ivarsson et al., 2015). This mental health development could be traced back to the TDE quality.
In a study with 92 Norwegian (U19) male academy soccer players who were affiliated either with highly ranked (top-five) or low-ranked (bottom-five) clubs filled in the TDEQ‑5. Independent of club quality, the players reported a highly supportive club environment with a focus on long-term development and social support. But significant differences emerged in the three other TDE dimensions of HQP, communication, and alignment of expectations, with higher scores for the highly ranked club environments (Gangsø, Aspvik, Mehus, Høigaard, & Sæther, 2021).
Research has also focused on capturing relevant information about the relative strengths and weaknesses of specific talent development environments in order to inform applied practitioners, coaches, and others responsible for the development and management of such environments (e.g., Gangsø et al., 2021; Gesbert, Crettaz von Roten, & Hauw, 2021; Gledhill & Harwood, 2019; Mills, Butt, Maynard, & Harwood, 2014; Thomas et al., 2021). Indeed, taking this a step further, Hall, Jones, and Martindale (2019) highlighted the utility of the TDEQ to not only identify relative strengths and weaknesses, but also to guide the development and evaluation of evidence-based interventions within elite sport contexts. A summary of research studies conducted so far with the different versions of the TDEQ can be found in Electronic Supplement Table ESM 1. When summarizing this research, it becomes obvious that it was undertaken for one or more of the following reasons: (1) developing a quantitative and valid measuring instrument for the TDE. This initiative started with the TDEQ‑7 (Martindale et al., 2010, 2013) and its modifications (TDEQ‑5 in particular; Li et al., 2015). This process of measurement optimization and of adaptation to different languages and cultures (Caribbean culture, Chinese, French, Greek, Polish, Spanish) is still ongoing and is the main objective of our study. (2) Another focus of research deals with the question of which aspects of athlete development (e.g., personality, mental health, performance) could be influenced by or traced back to the TDE. In this tradition, studies were undertaken in a number of countries, like China (Li et al., 2017), Greece (Andronikos et al., 2021), Korea (Wang et al., 2016), Singapore (Wang et al., 2011), Sweden (Ivarsson et al., 2015), and the United Kingdom (Mills et al., 2014). (3) Finally, the objective of research may focus on intervention in the field of talent environments by improving those aspects that are rated low (Gesbert et al., 2021; Hall et al., 2019). This research is quite rare to date and should definitely be expanded, preferably in combination with longitudinal designs and with measures of athletes’ variables like psychological skills or mental toughness.
The usefulness of measuring talent development experiences from an evidence-based perspective using the TDEQ has been shown through both enhancing our understanding of TDEs and also through driving applied practice. As such, it is perhaps unsurprising to see a number of translations of the TDEQ and TDEQ‑5 emerging in the literature. These include Spanish (Brazo-Sayavera, Olivares, Andronikos, & Martindale, 2017), Portuguese (Costa, Grazina, Miragaia, Crisóstomo, & de Carvalho, 2017), Swedish (Ivarsson et al., 2015), Korean (see Wang et al., 2016), Chinese (Li, Martindale, Wu, & Si, 2018), Polish (Siekańska & Wojtowicz, 2017), Norwegian (Gangsø et al., 2021), and French versions (Gesbert et al., 2021). However, to date, there exists no German TDEQ translation. Given the influence and renowned quality of sports in German speaking countries, namely Austria, Germany, and Switzerland, it seems pertinent to expand the possibilities of TDEQ-related research in these sports contexts.
In conclusion, it is widely agreed that environmental factors play a significant role in talent development. Nonetheless, attempts to systematize environmental influences are rare (for an exception, see Larsen et al., 2013). Therefore, questionnaires like the TDEQ, which enable quantification of the quality of environmental factors (Martindale et al., 2010), are an important contribution to investigate and identify key factors of talent development. As such, the aim of this study was to translate the TDEQ‑5 into German and test its psychometric properties with a sample of elite youth athletes across different sports.
Methods
Participants
Participants consisted of German-speaking elite athletes between the age of 13 and 21 years (mean [M] = 16.01; standard deviation [SD] = 2.1). Regarding performance level, inclusion criteria were set as having a squad status or performing at a high level in order to make sure that the athletes had a professional talent environment. The current talent development system in Germany at elite level in Olympic sports has been organized in the form of a squad system for over 30 years (Güllich, 2020), aiming to develop elite athletes to represent Germany at international competitions (Emrich, Pitsch, & Güllich, 2008). Especially in team sports, talent promotion most often takes place at clubs’ youth academies and gifted players are additionally sent to representative teams or they join sessions at a regional base (for talent promotion in Germany see Güllich & Emrich, 2012a). Consequently, besides squad status, competing at a high-performance level was chosen as an alternative inclusion criterium which matches the inclusion criteria in the above-described study of Martindale et al. (2010).
The link to the questionnaire was distributed to eligible athletes by multiple sport institutions, sport clubs, sport associations, and coaches previously contacted by one of the authors. In total, 588 respondents started the survey and provided consent to participate. However, 312 respondents terminated the questionnaire early or did not complete it according to the criteria for data analysis, leading to an average response rate of 47%. This response rate is in line with the average response rate regarding online surveys (Saleh & Bista, 2017).
The final sample consisted of N = 276 respondents (177 female athletes, 99 male athletes). The participants had a mean age of 16.01 years (SD = 2.1). They participated in various individual and team sports such as field hockey (126); basketball (91); soccer (12); American football (8); badminton and track and field (each 7); judo (6); rowing and golf (each 3); fencing, handball, gymnastics, and taekwondo (each 2); and tennis, volleyball, inline hockey, sailing, and table tennis (each 1). In total, 70.3% (n = 194) of all participants currently had a squad status including “Olympic squad,” “perspective,” “supplementary,” “junior,” and “federal state squad” (see Deutscher Olympischer Sportbund, 2017). Additionally, 29.7% (n = 82) did not have a squad status but competed at a high-performance level (minimum: regional level; “federal state league”).
Measures
Translation of the TDEQ-5 into German
The 25 items of the TDEQ‑5 (Li et al., 2015) were translated into German based on the recommendations of Banville, Desrosiers, and Genet-Volet (2000). This included a two-step process. The first step included preparation of a preliminary version. First, two bilingual native German researchers in sport science and sport psychology with in-depth knowledge about the area of research independently conducted two forward translation versions of the TDEQ‑5. The two versions were then discussed by the researchers with the aim of producing a single version, conceptually and semantically equivalent to the original questionnaire and easy to understand. In the next step, the combined German version was translated backward into English by two native English speakers (a professional interpreter and an expert in this area of research) who are fluent in German, creating a single backward translation. The next step included evaluation of the preliminary version and the preparation of an online version. Any misunderstandings and inaccuracies of the translation process were discussed and, if necessary, questions were revised in the German translation to retain the meaning of the original questionnaire’s items. To give an example, the item “My coach allows me to learn through making my own mistakes” (LTD4) was first translated to “Mein Trainer erlaubt mir zu lernen, indem ich meine eigenen Fehler mache,” but then, in the process of backward translation and as a result of expert discussion, adapted slightly to “Mein Trainer erlaubt mir eigene Fehler zu machen, um daraus zu lernen” (Table 1).
The resulting preliminary German language questionnaire was then administered to a sample of 17 respondents for pretesting (athletes, coaches of different sports) to determine whether the translation was easy to understand, clear, and comprehensible. Like in the original English version of Martindale et al. (2010), each item could be answered on a six-point Likert scale (1 = strongly agree/stimme völlig zu, 2 = agree/stimme zu, 3 = agree a little bit/stimme ein bisschen zu, 4 = disagree a little bit/stimme eher nicht zu, 5 = disagree/stimme nicht zu, 6 = strongly disagree/stimme überhaupt nicht zu). Participants were asked to go through the survey with a comment function and mention any obscurities they perceived. There were no comments that led to a change of the translated TDEQ‑5 according to this pretest. Therefore, we kept this German language version in the online survey. The list of the final English and German items is presented in Table 1.
Besides the TDEQ‑5, demographic information including age, gender, type of sport, coaches, support staff, squad status, and competition level were collected.
Procedure
The study was approved by the ethics committee of the second author’s university. Consent was requested at the start of the online survey; in case participants were under 18 years, parents additionally gave their consent. The collection of data was done according to the current German data privacy act.
The full survey was digitalized using www.soscisurvey.de (SoSci Survey GmbH, Marianne-Brandt-Str. 29, D-80807 München). The inquiry period was from October 12, 2020, until December 23, 2020. An email was sent containing the link to the survey as well as a flyer using a QR code as a direct link to the survey. Participants were explicitly addressed according to the inclusion criteria and the translation of the TDEQ was named as the primary aim of the study. The items of the TDEQ questionnaires were randomized for both the German and English versions. The 25 items were partitioned into five items per page. Contact information of the third author was available for questions and queries. After completing the German version of the TDEQ‑5, participants were thanked and additionally asked whether they were able and willing to also complete the English version of the questionnaire. This was done in order to get some further information on the quality of translation. A subsample of n = 63 athletes agreed. To check the language skills, participants were asked to state their highest English skill level. Of these, 58.8% had learnt English at school for at least 5 years, and 41.2% had a higher skill level which included, e.g., having been abroad in an English-speaking country for at least 1 year, studying English, or English being their second mother tongue.
Data analysis
To assess the quality of the translation, the answers of the n = 63 participants who also filled out the English version were analyzed using Pearson correlations and deviations of answers of more than one point on the Likert scale. A correlation of lower than ±0.5 in addition to a deviation > 20% was rated as critical. Reliability of the five TDEQ‑5 factors was also examined using the Cronbach’s alpha coefficient. Values of 0.70 or above are deemed acceptable (Hair, 2010). A minimum requirement of 250 participants was a priori identified to conduct the confirmatory factor analysis (CFA) in accordance with common guidelines estimating the number of participants to items ratio 10 to 1 (Hair, 2010; Wolf, Harrington, Clark, & Miller, 2013).
The main analysis including the CFA was conducted using IBM SPSS Amos 26 Graphics (IBM Corp., Armonk, NY, USA) to test the factorial validity of the TDEQ‑5. The assessment of the model data fit was based on commonly recommended indices which have previously been used in assessing the psychometric properties of the TDEQ (Li et al., 2015). These include the χ2/dƒ, comparative fit index (CFI), standardized root mean square residual (SRMR), and root mean square error of approximation (RMSEA). Additionally, factor loading estimates were calculated. For the χ2/dƒ, a value smaller than 3.0 indicates an adequate fit (Kline, 2016). A good model fit (χ2) would provide a non-significant result at a 0.05 threshold (Barrett, 2007). The CFI and the TLI reference values for a good fit are at 0.9 (Hooper, Coughlan, & Mullen, 2008). RMSEA cut-off values close to 0.06 and a stringent upper limit of 0.07 generally seem to be accepted. SRMR well-fitting models that obtain values less than 0.05 and values as high as 0.08 are deemed acceptable (Hooper et al., 2008). The factor loading estimates should be above 0.4 (Brown, 2015; Pituch & Stevens, 2015) and ideally greater than 0.7 (Hair, 2010).
Results
Descriptive statistics
The full range of the six-point Likert scale had been used for each item. Table 1 displays all five factors and 25 items in English (Li et al., 2015) and in the German translation. Based on the German sample of N = 276, means and standard deviations are provided as well as factor loading estimates and item-total correlations for the German version of TDEQ‑5. Higher values represent lower agreement with the items.
Overall, the majority of items had an acceptable level of factor loading estimates, using the cut-off value of 0.40. The analysis revealed four items lying below the recommended value (see Table 1 for factor loadings): items LTD2 (0.33), AOE2 (0.36), HQP5 (0.33), and HQP6 (0.39).
Confirmatory factor analysis
Model fit
The applied model with five factors and 25 items did not meet all of the thresholds of the utilized model fit indices. The model showed an acceptable fit based on the χ2 (dƒ = 265) = 509.52 (p < 0.001), χ2/dƒ (1.9), RMSEA (0.06) [0.05; 0.065], and SRMR (0.06). However, the CFI (0.88) and the Tucker–Lewis index (TLI; 0.86) were both slightly below the acceptable 0.90 reference value. Figure 1 shows the standard estimates and the CFA model.
Reliability
The internal consistency values for the factors alignment of expectations (0.70), communication (0.75), and holistic quality preparation (0.72) were acceptable and equal or above the 0.70 value, whereas the α‑coefficients for the factors long-term development focus (0.62) and support network (0.66) are below 0.70 and, thus, these two subscales may have limited applicability and require further improvement.
Comparison of the German and English versions
To compare the two versions, the deviation, shown as the percentage of answers deviating by more than 1 point (on the six-point Likert scale) between the results of the English and the German TDEQ‑5, as well as the Pearson correlations (r), were calculated. Only item 1 (r = −0.09, deviation 34.8%), item 3 (r = 0.23, deviation 36.5%), and item 5 (r = 0.34, deviation 30.2%) of the factor holistic quality preparation did not meet the criteria set in advance (see remarks on data analysis). All other items had a satisfactory similarity of answers and a moderate (four items between r = 0.54 and r = 0.63) to high (18 items between r = 0.65 and r = 0.91) correlation. Consequently, for future research, we revisited the items HQP1, HQP3, and HQP5 and rephrased them after discussing with the experts who had been involved in the translation process (see Table 1).
In an attempt to improve the model fit, two items (LTD 2 and AOE 2) were deleted. The items were chosen due to their low factor loadings in addition to an improvement of the factors’ reliability if the items are removed. A second CFI was conducted with this respecified 23-item five-factor model. These changes slightly improved the model fit when looking at the CFI (0.881), but still did not achieve a value above the recommended threshold. Additionally, the χ2 (dƒ = 199) = 4206.20 (p < 0.000), χ2/dƒ (2.1), RMSEA (0.064), and SRMR (0.064) got weaker. Based on these results, the deletion of single items did not improve the model fit.
Discussion
Within this study, the TDEQ‑5 (Li et al., 2015) was translated into German and applied to a sample of N = 276 elite youth athletes in different sports in order to test its structure. Additionally, evaluating the quality of the translation, n = 63 athletes also filled in the original English version, allowing for an analysis and discussion of the single items.
The review of guidelines for cross-cultural adaptation of questionnaires by Epstein, Santo, and Guillemin (2015) suggests that there are several methods available. Although there is no general consensus, most of them will achieve comparable results and the choice is a matter of preference and logistics (Epstein et al., 2015). The translation and evaluation were carried out based on common guidelines for translating questionnaires and inventories using a cross-cultural translation technique (Behr, 2018; Banville et al., 2000). In this context, back translation was considered not as a quality tool, but as a documentation tool (Son, 2018) that can help to better understand the meaning of the items in the language in question (here: German). This was helpful for rephrasing the three items of holistic quality preparation (items HQP 1, 3, 5) having a low or negligible correlation as well as the highest deviation in answers. This resulted in revising these items as a suggestion for future use of the German version. The HQP items may have led to the participants’ impression that the items did not meet their experiences or did not reflect the reality in their sport environment. Also, we should mention that all items of the HQP factor were inversely formulated which could have contributed to a suboptimal understanding of the meaning of the items and—accordingly—also of the answering scales. In addition, the translation may have been conducted too closely along the original item text even though the perceived environment could differ between the British and German culture. This “harmonization” of the items (Wolf, Schneider, Behr, & Joye, 2016) and a literal translation of items that may not correspond to the German TE could have led to a misunderstanding and/or a lack of understanding on the part of the German participants. All in all, the HQP items seem to combine a variety of coach behaviors which could contribute to more heterogeneity than can be found in the other four subscales.
These considerations lead to the question of equivalence of the environmental factors as they are assessed with the TDEQ. Do these factors have the same meaning (conceptual equivalence) and do they serve the same intentions (functional equivalence) for German athletes as for British (Chinese, Brazilian, Swiss etc.) athletes? Or, stated in other words, do we measure the most important environmental dimensions in German elite sports (which is assumed to be the intention of the TDEQ-5) and do these dimensions serve the same functions? One hint is the study of Güllich and Emrich (2012b) with 1557 athletes from different Olympic sports. They could show that athletes who specialized at a later age and, in consequence, had experienced a focus on long-term development and had realized more deliberate practice and competitions, were more successful than athletes with earlier specialization. In terms of TDE, this supports the assumption that the factors of LTD and HQP are important parts of a successful development in high level sports. Considering the other three factors, AEO, COM, and SN, there are so far not enough data available and we need to conduct more research with talented young German athletes in the future. We recommend considering cultural differences in TE regarding conceptual and functional equivalence.
CFA revealed that the five-factor structure was partly acceptable by meeting some but unfortunately not all criteria. The reference values of CFI and TLI did not meet the accepted quality of more than 0.90. When deleting two items from the analysis that loaded quite low on the respective factors, the picture did not change. Therefore, it should be a task of future studies to improve the model fit. The reliability of the TDEQ‑5 subscales was moderate to adequate (0.62–0.75). These values are lower than those of the original TDEQ‑5 (Li et al., 2015, Table 2) where they are reported to exceed 0.80 for each of the five subscales. One explanation for the model fit not being fully adequate might be the fact that athletes from a broad range of sports and performance levels were included in the study. Different settings in sport organizations and different cultures have to be taken into account and to expect a model fit across sport organizations and national cultures might be quite ambitious (Epstein et al., 2015). In fact, TDEQ translations in other languages showed a less than optimal fit for either the seven-factor structure (Polish: Siekańska & Wojtowicz, 2017) or one of the subscales (Spanish: Brazo-Sayavera et al., 2017; French: Gesbert et al., 2021). This may be attributed either to differences in cultural traditions or in the professional support system for developing talents, or both. Therefore, given the generic nature of the TDEQ, more information on specific talent environments is needed—no matter whether across sports or across cultures. Indeed, as an example, there have previously been calls for the development of a soccer-specific TDEQ (e.g., Gledhill & Harwood, 2019; Mills et al., 2014), and recent work has highlighted the importance of examining and understanding the environment across different age levels within an academy setting (e.g., Gesbert et al., 2021).
It appears that future research aiming to develop more context-specific versions of the TDEQ across sport and culture would enhance the utility of the TDEQ in those settings. From an applied perspective, including qualitative evaluation, efforts to contextualize the TDEQ findings are an important part of the process of identifying and targeting areas of most need for any particular context (e.g., Hall et al., 2019). In that way, the TDEQ could help to identify characteristics of an empowering climate and helpful support systems in the long-term development of youth athletes. Future work focusing on understanding the priority for environments within broader talent development pathways (e.g., elite, sub-elite, and amateur levels) may aid efforts to build coherent systems, enhancing the quality of environments throughout the pathway to maximize the talent pool and the developmental experience for all involved. Indeed, measurement tools such as the TDEQ based on the goal/level of the environment may be particularly useful.
For the comparison between the German and English versions, the English language knowledge of our participants was tested only as a self-rating. To the best of our knowledge, such a design of asking participants with knowledge of both languages to fill out both versions has not been considered in any of the previously reported studies. Still, as this direct comparison between two language versions is rarely done, it can be regarded as helpful in clarifying semantic aspects in translating items, and therefore should be encouraged in similar research moving forward. In those studies, the language skills of the participants could be assessed more precisely than we did in our study, e.g., by asking for certified levels of English language skills.
Apart from that, several limitations need to be mentioned. First of all, the heterogeneity of our sample with regard to the types of sport could have contributed to lower values of the CFI and of some subscale reliabilities. On the other hand, the heterogeneity of our sample can also be regarded as an advantage because the questionnaire may have greater external validity and can be used in various sports. The heterogeneity could even be expanded by administering the questionnaire to, for example, disabled athletes from paralympic sports (Radtke & Doll-Tepper, 2014). Another limitation is the age group of our sample. Quite a few athletes were still in their pubertal phase, which is well known to be critical with regard to physical, psychological, and performance development. Adolescents may be regarded as a vulnerable group that is particularly prone to sport career dropout during this phase (Larsen & Alfermann, 2017). Even though the original version was developed with young athletes of similar age, the question remains how stable and reliable the environment can be perceived by our participants. This aspect could be studied empirically in future studies. For example, possible differences in the perception of the TDE between participants of different age groups (e.g., preadolescence, adolescence, postadolescence) could be investigated. This might also contribute to a better understanding of the needs of the different age groups.
Another limitation is the answering rate. Even though the response rate can be seen as average, a higher answering rate would definitely be desirable. As most of the studies validating the TDEQ have been applied as paper and pencil tests and not online (see Table ESM1), the functional equivalence of the procedure has yet to be proven. In addition, it could be helpful to collect data with reverse answering scales to those used here. When lower scores correspond to less and higher scores to more agreement (which may correspond more to common sense), this could help to increase the reliability of the subscales.
Despite the limitations of this study, the authors would like to encourage further studies applying the German version of the TDEQ‑5, especially combining it with other questionnaires on talent environment to test its construct validity. Also, youth academy ratings evaluating talent environment or evaluations of coaches, staff, or parents could be added to test its ecological validity. For further exploration of the TDEQ‑5 validity from an applied perspective the descriptive analyses on an item level would allow insights into the athletes’ perceptions of environmental factors and social support, as well as insights into interactions of the stakeholders in talent development as perceived by athletes. This type of TDEQ analysis has proven useful in evaluating strengths and weaknesses across a range of environments (e.g., Gangsø et al., 2021; Gesbert et al., 2021; Gledhill & Harwood, 2019; Mills et al., 2014; Thomas, Abbott, Gastin, & Main, 2020; Thomas et al., 2021), and also in helping those responsible for effective talent development programs to design, deliver, and monitor evidence-based interventions across time. Future work on improving the validity and context specificity of the TDEQ, and also on developing its role and usefulness in helping to manage and develop the quality of environments in real-world athletic settings, would be highly appreciated.
References
Aalberg, R. R., & Sæther, S. A. (2016). The talent development environment in a Norwegian top-level football club. Sport Science Review, 25(3/4), 159–182. https://doi.org/10.1515/ssr-2016-0009.
Andronikos, G., Souglis, A., & Martindale, R. J. J. (2021). Relationship between the talent development environment and motivation, commitment, and confidence. Journal of Physical Education and Sport, 21(1), 208–217. https://doi.org/10.7752/jpes2021.01028.
Banville, D., Desrosiers, P., & Genet-Volet, Y. (2000). Translating questionnaires and inventories using a cross-cultural translation technique. Journal of Teaching in Physical Education, 19(3), 374–387. https://doi.org/10.1123/jtpe.19.3.374.
Barrett, P. (2007). Structural equation modelling: adjudging model fit. Personality and Individual Differences, 42(5), 815–824. https://doi.org/10.1016/j.paid.2006.09.018.
Behr, D. (2018). Translating questionnaires for cross-national surveys: a description of a genre and its particularities based on the ISO 17100 categorization of translator competencies. Translation & Interpreting. https://doi.org/10.12807/ti.110202.2018.a02.
Brazo-Sayavera, J., Olivares, P. R., Andronikos, G., & Martindale, R. J. J. (2017). Spanish version of the talent development environment questionnaire for sport: cultural adaptation and initial validation. PLoS ONE, 12(6), e177721. https://doi.org/10.1371/journal.pone.0177721.
Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd edn.). Methodology in the social sciences. Guilford.
Collins, D., & MacNamara, Á. (2017). From talent identification to talent development: an overview and critique. In M. H. Anshel, T. A. Petrie & J. A. Steinfeldt (Eds.), Sport psychology. APA handbook of sport and exercise psychology, (Vol. 1, pp. 111–128). Washington, DC: American Psychological Association. https://doi.org/10.1037/0000123-007.
Costa, A. M., Grazina, C., Miragaia, D., Crisóstomo, L., & de Carvalho, P. G. (2017). Contexto de desenvolvimento desportivo em clubes de natação: um estudo preliminar sobre as perceções dos nadadores portugueses. Revista Iberoamericana De Psicología Del Ejercicio Y El Deporte, 12(2), 231–236.
Coutinho, P., Mesquita, I., & Fonseca, A. M. (2016). Talent development in sport: a critical review of pathways to expert performance. International Journal of Sports Science & Coaching, 11(2), 279–293. https://doi.org/10.1177/1747954116637499.
Deutscher Olympischer Sportbund (DOSB) (2017). Anpassung der Kaderstrukturen/Kaderdefinitionen im Olympischen Sommer- und Wintersport zum 01.01.2018. https://cdn.dosb.de. Accessed 12 July 2022.
Emrich, E., Pitsch, W., Güllich, A., et al. (2008). Spitzensportförderung in Deutschland – Bestandsaufnahme und Perspektiven. Leistungssport, 38, 1–20. Beilage.
Epstein, J., Santo, R. M., & Guillemin, F. (2015). A review of guidelines for cross-cultural adaptation of questionnaires could not bring out a consensus. Journal of Clinical Epidemiology, 68(4), 435–441. https://doi.org/10.1016/j.jclinepi.2014.11.021.
Gagné, F. (2020). Differentiating giftedness from talent: the DMGT perspective on talent development. Routledge.
Gangsø, K., Aspvik, N. P., Mehus, I., Høigaard, R., & Sæther, S. A. (2021). Talent development environments in football: comparing the top-five and bottom-five-ranked football academies in Norway. International Journal of Environmental Research and Public Health, 18(3), 1321. https://doi.org/10.3390/ijerph18031321.
Gesbert, V., Crettaz von Roten, F., & Hauw, D. (2021). Reviewing the role of the environment in the talent development of a professional soccer club. PLoS ONE, 16(2), e246823. https://doi.org/10.1371/journal.pone.0246823.
Gledhill, A., & Harwood, C. (2015). A holistic perspective on career development in UK female soccer players: a negative case analysis. Psychology of Sport and Exercise, 21, 65–77. https://doi.org/10.1016/j.psychsport.2015.04.002.
Gledhill, A., & Harwood, C. (2019). Toward an understanding of players’ perceptions of talent development environments in UK female football. Journal of Applied Sport Psychology, 31(1), 105–115. https://doi.org/10.1080/10413200.2017.1410254.
Gulbin, J. P., Croser, M. J., Morley, E. J., & Weissensteiner, J. R. (2013). An integrated framework for the optimization of sport and athlete development: a practitioner approach. Journal of Sports Sciences, 31(12), 1319–1331. https://doi.org/10.1080/02640414.2013.781661.
Güllich, A. (2020). Talente im Sport: Talententwicklung, Talenterkennung und Talentförderung. In A. Güllich & M. Krüger (Eds.), Grundlagen von Sport und Sportwissenschaft. Springer. https://doi.org/10.1007/978-3-662-53384-0_11-1.
Güllich, A., & Emrich, E. (2012a). Individualistic and collectivistic approach in athlete support programmes in the German high-performance sport system. European Journal for Sport and Society, 9(4), 243–268. https://doi.org/10.1080/16138171.2012.11687900.
Güllich, A., & Emrich, E. (2012b). Considering long-term sustainability in the development of world class success. European Journal for Sport Science. https://doi.org/10.1080/17461391.2012.706320.
Hair, J. F. (2010). Multivariate data analysis (7th edn.). Pearson Prentice Hall.
Hall, A. J. A., Jones, L., & Martindale, R. J. J. (2019). The Talent Development Environment Questionnaire as a tool to drive excellence in elite sport environments. International Sport Coaching Journal, 6(2), 187–196. https://doi.org/10.1123/iscj.2018-0041.
Henriksen, K., & Stambulova, N. (2017). Creating optimal environments for talent development: a holistic ecological approach. In J. Baker, S. Cobley, J. Schorer & N. Wattie (Eds.), Routledge handbook of talent identification and development in sport (pp. 271–284). Routledge.
Henriksen, K., Stambulova, N., & Roessler, K. K. (2010a). Holistic approach to athletic talent development environments: a successful sailing milieu. Psychology of Sport and Exercise, 11(3), 212–222. https://doi.org/10.1016/j.psychsport.2009.10.005.
Henriksen, K., Stambulova, N., & Roessler, K. K. (2010b). Successful talent development in track and field: considering the role of environment. Scandinavian Journal of Medicine & Science in Sports, 20(s2), 122–132. https://doi.org/10.1111/j.1600-0838.2010.01187.x.
Henriksen, K., Stambulova, N., & Roessler, K. K. (2011). Riding the wave of an expert: a successful talent development environment in kayaking. The Sport Psychologist, 25(3), 341–362. https://doi.org/10.1123/tsp.25.3.341.
Henriksen, K., Larsen, C. H., & Christensen, M. K. (2013). Looking at success from its opposite pole: the case of a talent development golf environment in Denmark. International Journal of Sport and Exercise Psychology, 12(2), 134–149. https://doi.org/10.1080/1612197X.2013.853473.
Hooper, D., Coughlan, J., & Mullen, M. (2008). Structural equation modelling: guidelines for determining model fit. Electronic Journal of Business Research Methods, 6(1), 53–60. Available online at www.ejbrm.com.
Ivarsson, A., Stenling, A., Fallby, J., Johnson, U., Borg, E., & Johansson, G. (2015). The predictive ability of the talent development environment on youth elite football players’ well-being: a person-centered approach. Psychology of Sport and Exercise, 16(1), 15–23. https://doi.org/10.1016/j.psychsport.2014.09.006.
Kline, R. B. (2016). Principles and practice of structural equation modeling (4th edn.). Guilford.
Larsen, C. H., & Alfermann, D. (2017). Understanding dropout in the athlete development process. In J. Baker, S. Cobley, J. Schorer & N. Wattie (Eds.), Routledge handbook of talent identification and development in sport (pp. 325–335). Routledge. https://doi.org/10.4324/9781315668017.
Larsen, C. H., Alfermann, D., Henriksen, K., & Christensen, M. K. (2013). Successful talent development in soccer: the characteristics of the environment. Sport, Exercise, and Performance Psychology, 2(3), 190–206. https://doi.org/10.1037/a0031958.
Li, C., Wang, C. K. J., & Pyun, D. Y. (2014). Talent development environmental factors in sport: a review and taxonomic classification. Quest, 66(4), 433–447. https://doi.org/10.1080/00336297.2014.944715.
Li, C., Wang, C. K. J., Pyun, D. Y., & Martindale, R. (2015). Further development of the Talent Development Environment Questionnaire for Sport. Journal of Sports Sciences, 33(17), 1831–1843. https://doi.org/10.1080/02640414.2015.1014828.
Li, C., Wang, C. K. J., & Pyun, D. Y. (2017). Impacts of talent development environments on athlete burnout: a self-determination perspective. Journal of Sports Sciences, 35(18), 1–8. https://doi.org/10.1080/02640414.2016.1240370.
Li, C., Martindale, R. J. J., Wu, Y., & Si, G. (2018). Psychometric properties of the Talent Development Environment Questionnaire with Chinese talented athletes. Journal of Sports Sciences, 36(1), 79–85. https://doi.org/10.1080/02640414.2017.1282619.
Li, C., Martindale, R. J. J., & Sun, Y. (2019). Relationships between talent development environments and mental toughness: the role of basic psychological need satisfaction. Journal of Sports Sciences, 37(18), 2057–2065. https://doi.org/10.1080/02640414.2019.1620979.
Martindale, R. J., Collins, D., & Daubney, J. (2005). Talent development: a guide for practice and research within sport. Quest, 57(4), 353–375. https://doi.org/10.1080/00336297.2005.10491862.
Martindale, R. J. J., Collins, D., & Abraham, A. (2007). Effective talent development: the elite coach perspective in UK sport. Journal of Applied Sport Psychology, 19(2), 187–206. https://doi.org/10.1080/10413200701188944.
Martindale, R. J. J., Collins, D., Wang, C. K. J., McNeill, M., Lee, K. S., Sproule, J., & Westbury, T. (2010). Development of the talent development environment questionnaire for sport. Journal of Sports Sciences, 28(11), 1209–1221. https://doi.org/10.1080/02640414.2010.
Martindale, R. J. J., Collins, D., Douglas, C., & Whike, A. (2013). Examining the ecological validity of the Talent Development Environment Questionnaire. Journal of Sports Sciences, 31(1), 41–47. https://doi.org/10.1080/02640414.2012.718443.
Mills, A., Butt, J., Maynard, I., & Harwood, C. (2014). Examining the development environments of elite English football academies: the players’ perspective. International Journal of Sports Science and Coaching, 9(6), 1457–1472. https://doi.org/10.1260/1747-9541.9.6.1457.
Pituch, K. A., & Stevens, J. P. (2015). Applied multivariate statistics for the social sciences: analyses with SAS and IBM’s SPSS (6th edn.). Routledge. https://doi.org/10.4324/9781315814919.
Radtke, S., & Doll-Tepper, G. (2014). A cross-cultural comparison of talent identification and development in Paralympic Sports. Perceptions and opinions of athletes, coaches and officials. Sportverlag Strauß.
Saleh, A., & Bista, K. (2017). Examining factors impacting online survey response rates in educational research: perceptions of graduate students. Journal of MultiDisciplinary Evaluation, 13(29), 63–74.
Schacht, C. L. O., & Kiewra, K. A. (2018). The fastest humans on earth: environmental surroundings and family influences that spark talent development in olympic speed skaters. Roeper Review, 40, 21–35. https://doi.org/10.1080/02783193.2017.1393710.
Seanor, M., Schinke, R. J., Stambulova, N. B., Ross, D., & Kpazai, G. (2017). Cultivating olympic champions: a trampoline development environment from grass roots to podium. Journal of Sport Psychology in Action, 8(2), 96–108. https://doi.org/10.1080/21520704.2017.1327908.
Siekańska, M., & Wojtowicz, A. (2017). Polish version of research-based model of sport talent development environment and adaptation of talent development environment questionnaire. Studies in Sport Humanities, 22, 7–17. https://doi.org/10.5604/01.3001.0012.6519.
Son, J. (2018). Back translation as a documentation tool. The International Journal for Translation and Interpreting Research, 10(2), 89–100. https://doi.org/10.12807/ti.110202.2018.a07.
Thomas, C. E., Abbott, G., Gastin, P. B., & Main, L. C. (2020). Construct validity and reliability of the Talent Development Environment Questionnaire in Caribbean youth track and field athletes. PLoS ONE, 15(1), e227815. https://doi.org/10.1371/journal.pone.0227815.
Thomas, C. E., Gastin, P. B., Abbott, G., & Main, L. C. (2021). Impact of the talent development environment on the wellbeing and burnout of Caribbean youth track and field athletes. European Journal of Sport Science, 21(4), 590–603. https://doi.org/10.1080/17461391.2020.1775894.
Wang, C. K. J., Sproule, J., McNeill, M., Martindale, R. J. J., & Lee, K. S. (2011). Impact of the talent development environment on achievement goals and life aspirations in Singapore. Journal of Applied Sport Psychology, 23(3), 263–276. https://doi.org/10.1080/10413200.2010.543120.
Wang, C. K. J., Pyun, D. Y., Li, C., & Lee, M. S. (2016). Talent development environment and achievement goal adoption among Korean and Singaporean athletes: Does perceived competence matter? International Journal of Sports Science and Coaching, 11(4), 496–504. https://doi.org/10.1177/1747954116654779.
Wolf, E. J., Harrington, K. M., Clark, S. L., & Miller, M. W. (2013). Sample size requirements for structural equation models: an evaluation of power, bias, and solution propriety. Educational and Psychological Measurement, 76(6), 913–934. https://doi.org/10.1177/0013164413495237.
Wolf, C., Schneider, S. L., Behr, D., & Joye, D. (2016). Harmonizing survey questions between cultures and over time. In C. Wolf, D. Joye, T. W. Smith & Y. Fu (Eds.), The Sage handbook of survey methodology (pp. 502–524). SAGE.
Acknowledgements
We would like to thank the colleagues in the Department of Performance Psychology at the German Sport University Cologne and two anonymous reviewers for their helpful and constructive feedback.
Funding
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Funding
Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Contributions
Dorothee Alfermann: formal analysis, writing—original draft preparation, review, and editing. Babett H. Lobinger: conceptualization, supervision, validation, writing, review, and editing. Oliver Nesges: investigation, validation, methodology, writing—original draft preparation. Russell Martindale: methodology, supervision, review, and editing. George Andronikos: supervision, review, and editing
Corresponding author
Ethics declarations
Conflict of interest
D. Alfermann, B. Lobinger, O. Nesges, R. Martindale, and G. Andronikos declare that they have no competing interests.
For this article no studies with human participants or animals were performed by any of the authors. The study was approved by the ethics committee of the German Sport University Cologne, Germany. Consent was requested at the start of the online survey; in case participants were under 18 years, parents additionally gave their consent. The collection of data was done according to the current German data privacy act.
Additional information
The authors Dorothee Alfermann and Babett Lobinger share first authorship.
Supplementary Information
12662_2022_850_MOESM1_ESM.pdf
Table ESM1. Electronic Supplement: International studies with the talent development environment questionnaire (TDEQ‑7 and TDEQ-5).
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Alfermann, D., Lobinger, B.H., Nesges, O. et al. German version of the Talent Development Environment Questionnaire (TDEQ-5). Ger J Exerc Sport Res 53, 59–69 (2023). https://doi.org/10.1007/s12662-022-00850-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12662-022-00850-x