Abstract
Left-behind children (LBC) is a group of children who live without their parents and receive less parental care and education. Compared with non-left-behind children (NLBC), LBC are more likely to develop emotional or behavior problems. This study aimed to explore the psychometric properties and measurement invariance of the Chinese version of the Emotion Regulation Questionnaire (ERQ) in Chinese LBC. A sample of 2960 middle school students (44.35% male, 55.28% female; age: 12 to 20 years) including LBC (n = 1365) and NLBC (n = 1595) was used. The exploratory factor analysis (EFA); confirmatory factor analyses (CFA); tests of measurement invariance; t-tests of gender and left-behind experience differences; tests of reliability and convergent, discriminant, and criterion validity were conducted. The results showed that two factors were extracted, and the CFA replicated the original two-factor structure (S-Bχ2/df ≈ 106.778/34, P < .001, CFI = .948, TLI = .932, RMSEA = .056 [.044, .068]). The measurement invariance of the ERQ across genders, LBC and NLBC was also confirmed. Males use expressive suppression (ES) significantly more than females (t = 2.63, p < .01), and LBC use ES significantly more than NLBC (t = 2.11, p < .05). The internal consistency coefficients for ES and cognitive reappraisal (CR) were acceptable, and the test-retest reliability was .62 and .68, respectively. Good convergent, discriminant and criterion validity were also demonstrated. It can be concluded that the ERQ is a valid measure for investigating the use of two different emotion regulation strategies among Chinese left-behind children.
Similar content being viewed by others
![](https://media.springernature.com/w215h120/springer-static/image/art%3A10.1007%2Fs12144-022-03578-x/MediaObjects/12144_2022_3578_Fig1_HTML.png)
Avoid common mistakes on your manuscript.
Introduction
The physical and mental health of left-behind children (LBC), as a disadvantaged group created by the rapid urbanization and economic development of China, has long been a concern (Shao et al., 2018). The LBC refer to children under 18 years of age who have been left alone in their hometown, and one or both of the parents migrated to other places for work (Lan et al., 2019; Milton et al., 2010). With the progress of industrialization and the increasing economic gap between urban and rural areas in developing countries, more and more workers are choosing to leave their registered residential place for better-paid jobs. With the rural-to-urban migration, the workers had to leave their children in the countryside, and are unable to bring them to the cities due to destitute living conditions. Thus, these affected children are forced to live without their parents and receive less parental care and education (Tang et al., 2019; Wu et al., 2019). Studies have shown that parental migration has a negative effect on children’s mental health, resulting in low self-esteem, loneliness, anxiety, depression and even a high prevalence of suicidal ideation (Ai & Hu, 2014; Ding et al., 2019; Tang et al., 2018; Xiao et al., 2019). In fact, compared with non-left-behind children (NLBC), LBC are more likely to develop emotional or behavior problems and have significantly more emotional symptoms, more psychopathological behaviors and fewer pro-social behaviors (Fan et al., 2010; Wang et al., 2019). This may be because LBC and NLBC have differing emotional regulation capacities. Therefore, it is meaningful to closely examine emotion regulation in LBC.
Emotion regulation, as an important aspect of healthy psychological development, is the process by which individuals influence some aspects of their emotions, including what emotions they experience and how they express them and respond to them (Gross, 1999). A body of research indicates that effective emotion regulation is linked to affective functioning, social relations and more effective cognitive processing (Gross, 2001; Gullone & Taffe, 2012; Ochsner & Gross, 2008). In contrast, emotion dysregulation is implicated in depression, anxiety, maladaptive functioning and even many kinds of mental disorders (Aldao et al., 2010; Cisler et al., 2010; Moore et al., 2008).
Emotion Regulation Strategies
According to the process model of emotion regulation, there are two emotion regulation strategies based on how emotion unfolds over time. Gross (1999) pointed out that these strategies can be differentiated as antecedent-focused or response-focused respectively, depending on whether they occur before or after the generation of emotion (Gross, 1999; Gross & John, 2003). Cognitive reappraisal (CR) is an antecedent-focused strategy that refers to a cognitive change that occurs before the emotion has been generated or a related response has taken place and involves modifying the situation’s emotional impact. In contrast, expressive suppression (ES) is a response-focused strategy that occurs after the generation of emotion and involves the inhibition of emotion expression (Gross, 2001). Considering that these two strategies act at different points, they may also have different influences on individuals (Gross, 2002; Lopes et al., 2003). Studies have shown that emotion regulation can be accommodating or harmful based on the strategy individuals use to manage or change their responses to emotional situations. Numerous studies suggest that adequate emotion regulation strategies are related to better social relationships and life satisfaction. However, frequent use of inadequate strategies is negatively associated with emotion release, mood repair efforts, stress symptoms, and trait anxiety (English et al., 2012; Gómez-Ortiz et al., 2016; John & Gross, 2004; Spaapen et al., 2014; Teixeira et al., 2014).
Factor Structure of the Emotion Regulation Questionnaire
To analyze the individual differences in these two strategies, Gross and John (2003) developed the Emotion Regulation Questionnaire (ERQ), which consists of 10 items measuring the use of Reappraisal and Suppression strategies (Gross & John, 2003). A two-factor structure was obtained in the original study through model testing, and the scale has good reliability and validity. Further studies have tested the psychometric properties of the ERQ among different ethnic and cultural groups and obtained mixed results. The ERQ has primarily been employed in American (John & Gross, 2004; Moore et al., 2008) and French (D’Argembeau & Van der Linden, 2006) contexts, and the results confirmed the original two-factor structure. Then, Matsumoto et al. (2008) used the ERQ in a transcultural study of participants from 23 countries (Matsumoto et al., 2008); their results also supported the two-factor structure of the ERQ. A body of research has since widely employed the ERQ and its revised or age-specific version in German (Abler & Kessler, 2009), Australian (Gullone & Taffe, 2012), Chinese (Li & Wu, 2018; Liu et al., 2017), Portuguese (Teixeira et al., 2014), Italian (Balzarotti et al., 2010; Sala et al., 2012), American (Melka et al., 2011; Preece et al., 2021), Japanese (Namatame et al., 2020), and Spanish (Cabello et al., 2013; Gómez-Ortiz et al., 2016) contexts. All these studies supported the two-factor structure. However, two other studies conducted in Germany (Wiltink et al., 2011) and Australia (Spaapen et al., 2014) found more complicated results. Preece et al. (2019) summarized the existing research and found that the factor loading and structural results varied between university students and general community samples. They then conducted a study to further verify the psychometric properties of the ERQ in general community samples, replicating the original factor structure (Preece et al., 2019) (see Table 1).
The Present Study
Previous studies have mainly focused on healthy samples, and few studies have tested the reliability and validity of the ERQ in specific groups, including LBC. Moreover, the factor structure of the ERQ differs across samples. For instance, the original two-factor structure of the scale presents mixed results in general community samples (Preece et al., 2021; Spaapen et al., 2014; Wiltink et al., 2011) while it shows good stability in student samples (Abler & Kessler, 2009). In addition, considering that there are significant differences in emotional or behavioral problems between LBC and NLBC, these children may also differ in emotional regulation. Whether a questionnaire measures identical constructs is the premise for comparing validity across different groups (Dimitrov, 2010). Thus, it is important to determine whether the ERQ demonstrates consistent measurement characteristics across these two groups. In order to further verify the applicability and generalizability of the ERQ across different groups and to understand the differences in emotional regulation strategies between LBC and NLBC, this study aimed to test the psychometric properties and measurement invariance of the ERQ among Chinese LBC.
Materials and Methods
Participants
Our study was conducted in Guizhou province, which has a high percentage of left-behind children in China. In this study the target participant were secondary school students, and the cluster random sampling method was used. We adopted the definition for LBC according to the All-China Women’s Federation: minors under the year of 18 with one or both of their parents migrated out for work, and the continuous separation time was more than 3 months. Thus, the LBC in this study were defined by the following criteria: 1) children under 18 years old; 2) with one or both of the parents migrating for work; 3) being left behind for three consecutive months or more. It’s worth mentioning that although we have adopted the criterion of under 18 years old, due to the fact that some children in rural areas start school later and sometimes restudy, we have included students over 18 years old as they are still in the secondary school range. For those children with none of their parents migrating for work, they were defined as NLBC.
Sample 1: We completed the initial test in April 2019. The participants in this study were 2960 students from 7 middle schools spread across three cities in Guizhou Province, China. 1365 students (46.11%) were LBC and 1595 students (53.89%) were NLBC. The ages of the 2960 participants ranged from 12 to 20 (M = 15.74, SD = 2.50, 1.41% were missing), 44.39% of participants were male and 55.27% were female (.34% were missing). In accordance with the purpose of the data analysis, the sample was divided into two groups: LBC and NLBC.
The ages of the 1365 LBC ranged from 12 to 20 years (M = 15.80, SD = 2.45, 1.31% were missing). A total of 42.30% were male, and 57.26% were female (.44% were missing). Among them, the percentage of those whose parents were absent as migrant workers more than three months in a row was 32.24% (father works away from home), 12.55% (mother works away from home) and 55.22% (both parents work away from home). The age range of the 1595 NLBC was 12 to 20 years (M = 15.69, SD = 2.54, 1.50% were missing), 46.11% were male and 53.58% were female (.31% were missing).
Sample 2: After three months, 300 participants were retested, and 273 valid data points were retained, 41.76% of this sample was male and 57.14% female (1.10% were missing). The age ranged from 12 to 16 years (M = 13.66, SD = 1.01), 43.23% of them were LBC and 54.21% of them were NLBC (2.56% were missing).
Instruments
The Emotion Regulation Questionnaire (ERQ) (Gross & John, 2003) is a 10-item questionnaire which consists of two emotion-regulation strategies: ES (4 items) and CR (6 items), and using a 7-point Likert scale from strongly disagree to strongly agree (1 = strongly disagree and 7 = strongly agree). Before the development of the Chinese version of the ERQ, we contacted the developer of the original scale by email, obtained the permission for the use of the scale in China, and later sent back the translated version. The Chinese translation of the ERQ was developed with a backtranslation procedure by two independent groups. The one involved eight masters and one PhD in psychology, the other was a psychology master who had passed the Test for English Majors-Band 8 (TEM-8). We used a committee consensus approach to ensure the accuracy. The initial translation was done independently by the nine-person group, and then the questionnaire was translated back into English by the other group. Then, we compared the errors and inconsistencies between the reverse translation version and the original English version. In further reverse translation, we removed this content in repeated iterations until the version was semantically identical and was agreed upon by members of both groups. The final version of the questionnaire was obtained through backtranslation and discussion between the two groups.
The Emotion Regulation Scale (ERS) (Wang et al., 2007) is a self-report scale consists of 14 items to assess two dimensions of emotion regulation: CR (7 items) and ES (7 items). All these 14 items are rated on a Likert scale ranging from 1 (strongly disagree) to 7 (strongly agree), with higher scores for each dimension indicating a higher level of tendency for that emotion regulation strategy. Cronbach’s alpha in this study was .76 for Suppression and .81 for Reappraisal.
The General Health Questionnaire (GHQ) is a self-administered questionnaire developed to assess general psychological health. The 12-item version of the GHQ (GHQ-12) (Goldberg et al., 1997) was used in this study, which uses a 4-point Likert scale (1 = not at all true of me and 4 = exactly true of me) with higher scores indicating lower level of individual’s psychological health. To ensure accuracy, backtranslation procedure with a committee consensus approach was used to translate the scale from English into Chinese. Cronbach’s alpha in this study was .80.
The Rosenberg Self-Esteem Scale (RSES) is the most widely used measure to assess individual’s self-esteem. It is a unidimensional scale and composed of 10 items using a 4-point Likert scale ranging from strongly disagree to strongly agree. The higher the scores, the higher level of positive self-assessments. In this study, we used the Chinese version of the RSES (Wang et al., 1999). Cronbach’s alpha in this study was .82.
The University of California Los Angeles Loneliness Scale (ULS) was originally developed by Russell et al. (Russell et al., 1978). It is the most frequently used measure of loneliness and show good psychometric properties. A short-form version of ULS (ULS-8) (Hays & Dimatteo, 1987) was used in this study, which contains 8 items and the statements evaluated on a 4-point Likert scale (1 = strongly disagree and 4 = strongly agree). Backtranslation procedure with a committee consensus approach was used to translate the scale into Chinese. The higher the scores, the higher level of loneliness. Cronbach’s alpha in this study was .81.
Procedure
Participants were invited to complete afore-mentioned questionnaires while they were in school. In order to ensure the effectiveness of the answer, it was emphasized by the researchers that there were no right or wrong answers and participants only had to choose the one that matched their state. They independently completed the RSES, ULS, GHQ, ERS and ERQ in order, and all of them were finished privately. There was no time limit and the students completed the questionnaire in about 30 min. All participants completed the questionnaires under the supervision of a class teacher and then returned the questionnaires to researchers by the teacher. All participants volunteered to participate in this study and were informed of their right to anonymity. Informed consent was obtained from all participants in this study and this study was approved by the Ethics Committee of University of Guizhou Normal University.
Statistical Methods
We found missing data in demographic variables. However, since these missing data did not affect the data analysis of response, we retained these data in most of the data analysis. But these missing data are not included in the analysis of measurement invariance. Therefore, the test of measurement invariance only included 1365 LBC (42.85% was male) and 1595 NLBC.
First, skewness and kurtosis indices were examined to detect the normality. Items with univariate skewness above 3 and kurtosis above 10 should be removed (R. B. Kline, 2012). The sample of 1365 LBC was split in half using an odd-even method. One of the subset was used for exploratory factor analysis (EFA). The Kaiser-Meyer-Olkin test (KMO) with value closer to 1 and the significant Bartlett’s test of sphericity was carried out to verify if the data is suitable for the EFA (Carpenter, 2018). An EFA using principal component factor (PCF) was conducted to extract factors, and based on Kaiser’s criterion of eigenvalue equal or greater than 1.0 were considered (Kline, 1994; Nunnally & Bernstein, 1994). Varimax-rotation and promax-rotation were performed to explore factor loadings, and the item-factor loading should be at least 0.35 on a main factor (Namatame et al., 2020). As the eigenvalue-greater-than-1.0 rule tends to retain too many factors, a minimum average partial correlations (MAP) test was performed to confirm the number of factors to be retained. It was suggested that choosing a number of components at which the average squared partial correlations was minimum (Velicer, 1976). Then the confirmatory factor analyses (CFA) were performed to test whether the two-factor structure of the ERQ could be replicated in this study, and the maximum likelihood parameter estimates (MLM) was used given that it is more robust. In addition, the Satorra-Bentler rescaled chi-square statistic (S-Bχ2), root mean square error of approximation (RMSEA), comparative fit index (CFI) and Tucker-Lewis index (TLI) were used to evaluate the model fit. According to the guidelines suggested by Hu and Bentler (Hu & Bentler, 1998), the RMSEA value less than .08 indicate moderate model fit, below .06 indicate good fit. For the CFI and TLI, the value above .95 are taken as good, above .90 are taken as acceptable.
Second, measurement invariance across genders, LBC and NLBC was tested using multigroup confirmatory factor analysis (MCFA). There were four more progressively restricted models presented: model 1 (equal form), model 2 (equal factor loading), model 3 (equal indicator intercepts) and model 4 (equal indicator error variances). Considering that ∆ S-Bχ2 is susceptible to the influence of sample size, the use of other model fit indices (∆CFI and ∆TLI) is appropriate, and a value of < .01 is suggested (Putnick & Bornstein, 2016).
Third, gender and left-behind experience differences were examined with a t-test. Then, to provide reliability evidence, Cronbach’s alpha internal reliability coefficients, McDonald’s omega (ω) and test-retest reliability based on the Pearson correlation were calculated. Finally, the convergent, discriminant and criterion validity were tested based on Pearson correlations between ERQ, ERS, GHQ, RSES and ULS-8 scores. The results are presented below. The descriptive statistics and Pearson correlation coefficients were calculated and the exploratory factor analysis, reliability analysis and t-test analysis were conducted used STATA/MP 13.0. The confirmatory factor analyses and multigroup confirmatory factor analysis were performed using Mplus software version 8.3.
Results
Factor Structure
Firstly, we conducted the normality assessment (see Table 2). Although the results showed that the variables basically met the norms for univariate normality (all skewness values <3 and all kurtosis values <10), we found that the data showed slightly non-normality (all |skewness| < 1.25 and all |kurtosis| < 3.75) (Coenders et al., 1997; Flora & Curran, 2004). Before conducting EFA on each item of the ERQ scale, the KMO value and Bartlett’s test of sphericity were firstly used to investigate whether each item of the scale was suitable for exploratory factor analysis. The results showed that the KMO value of the data was 0.77, and the Bartlett spherical test value was χ2/df = 1746.59/45 ≈ 38.81, p < 0. 001, which indicated that the data met the premise of further EFA. An EFA was performed using both the traditional method of extracting the number of factors (Kaiser eigenvalues) and the MAP test. According to the results of Kaiser eigenvalues, two factors were extracted. The first factor was defined by the cognitive reappraisal items and the second factor was defined by the expressive suppression items. The results of varimax-rotation and promax-rotation showed that each item consistently loaded on the expected factor, and the factor structure was substantially clear (see Table 2). In addition, the results of the MAP also suggested retaining two factors (see Table 3).
Following the results of EFA, we adopted the two-factor model. CFA was conducted for the LBC sample using the MLM method, and Fig. 1 shows the two-factor model of the ERQ. According to the chi-square and fit statistics for this model, the fit for the LBC sample was moderately satisfactory (S-Bχ2/df≈106.778/34, P < .001, CFI = .948, TLI = .932, RMSEA = .056 [.044, .068]), indicating that the model was a good representation of the data and that the original two-factor structure was replicated in this study.
Measurement Invariance
To determine if the ERQ demonstrates consistent measurement characteristics across genders, LBC and NLBC, a multi-group confirmatory factor analysis (MCFA) was performed (see Tables 4, 5). The fit indices for the male, female, LBC and NLBC data sets were all good, indicating that it was appropriate to test the measurement invariance. First, for different genders in LBC, the first model (configural invariance) was supported. Then, three highly constrained model were tested (i.e., model 2: metric invariance, model 3: scalar invariance, model 4: strict invariance). The results seemed to show that the ERQ was consistent across different genders in LBC in this study, as all the ∆CFI and ∆TLI values were < .01. In addition, for LBC and NLBC group, same results were obtained as all differences were less than .01, supporting the measurement invariance across these two groups.
Gender, LBC and NLBC Differences
After the measurement invariance is established, the comparison of the manifest variables is meaningful (Meade et al., 2005). To examine gender and left-behind experience differences, a t-test was performed (see Table 6). As found by other studies, there were no significant gender differences for CR in LBC (t = .89, ns; effect size d = .04). In contrast, the ES score for males (M = 4.26, SD = 1.33) was higher than that for females (M = 4.06, SD = 1.45), t = 2.63, p < .01, effect size d = .14. Moreover, as predicted, a significant difference in the two emotion regulation strategies was found between LBC and NLBC. The scores of LBC (M = 4.14, SD = 1.40) were higher than those of NLBC (M = 4.03, SD = 1.44) on ES, t = 2.11, p < .05, effect size d = .07. However, there were no significant differences in CR between LBC and NLBC (t = −1.96, ns; effect size d = − .06). Thus, LBC may use the ES strategy more than NLBC.
Reliability
To test the internal consistency coefficient of the ERQ in the LBC sample, the Cronbach’s alpha and the McDonald’s ω of the ES and CR subscales were respectively examined (see Table 7). Cronbach’s α=.79 for ES (with item-total correlations ranging from .73 to .81, all p < .001), and α=.78 for CR (with item-total correlations ranging from .66 to .74, all p < .001). Both Cronbach’s α coefficients for ES and CR are higher than in many other studies (Abler & Kessler, 2009; John & Gross, 2004; Matsumoto et al., 2008; Sala et al., 2012). In addition, McDonald’s ω = .80 for ES, and ω = .78 for CR, indicating that the ERQ has good homogeneity reliability in LBC. Moreover, to test the stability of the ERQ, the test-retest reliability based on Pearson correlation was calculated. The correlation coefficients over a 3-month period for ES and CR were .62 and .68, respectively.
Convergent, Discriminant and Criterion Validity
In accordance with the original and other studies (Gross & John, 2003; Moore et al., 2008), the low intercorrelations between ES and CR subscales were replicated (r = .08, P < .01), indicating that the relationship between these two factors was independent. Moreover, the correlation coefficient between the ERQ and other scales can be seen in Table 7. As with the ERQ-CR and ERS-CR correlation (r = .64, p < .001), the ERQ-ES was also highly significantly related to the ERS-ES (r = .58, p < .001), indicating that both the ERQ-CR and ERQ-ES have good convergent validity. Given that a significant but low correlation was found between the ERQ-ES and ERS-CR (r = .07, p < .01) and a significant but low correlation was found between the ERQ-CR and ERS-ES (r = .26, p < .001), indicating that both the ERQ-CR and ERQ-ES have good discriminant validity.
In addition, the ERQ-CR was significantly positively related with the RSES (r = .28, p < .001) and significantly negatively related with the GHQ (r = −.34, p < .001) and ULS-8 (r = −.16, p < .001). In contrast, the ERQ-ES showed a significant negative correlation with the RSES (r = −.22, p < .001) and significant positive correlations with the GHQ (r = .26, p < .001) and ULS-8 (r = .32, p < .001). In sum, all these results indicated that the ERQ has satisfactory criterion validity.
Discussion
This study aimed to test the psychometric properties and measurement invariance of the ERQ in Chinese LBC. Although two studies have validated the psychometric properties of the Chinese version of the ERQ, both used a revised (Li & Wu, 2018) or age-specific version (Liu et al., 2017). Considering that the original scale (Gross & John, 2003) has been widely used in various countries and groups and shows good reliability and validity, we further verified the performance of the ERQ in Chinese LBC and investigated the difference between LBC and NLBC in their use of ES and CR of as emotional regulation strategies.
First, the exploratory factor analysis suggested remaining two factors, and the two-factor model achieved satisfactory model fit, indicating that the original two-factor structure was replicated in the Chinese LBC sample. This result is similar to many other studies (Balzarotti et al., 2010; Gómez-Ortiz et al., 2016; Gullone & Taffe, 2012; John & Gross, 2004; Teixeira et al., 2014), indicating that the ERQ shows very good structural validity in different countries and groups. In addition, given that the differences in fit indices across the four different models in MCFA all reached the criterion, sufficient evidence of measurement invariance across genders, LBC and NLBC was obtained. In other words, all the items on the ERQ have the same function and meaning in Chinese LBC and NLBC samples and across genders in LBC. Regarding group differences in the two emotion regulation strategies, consistent with other studies, males reported significantly higher levels of ES than females in the LBC sample. Furthermore, as we expected, LBC reported significantly higher levels of ES than NLBC. This may be because LBC in rural China experience more loneliness and depression than NLBC (Wang et al., 2019; Wen & Lin, 2012), which leads them to bury their emotions. Because of their long-term separation from their parents, LBC are more likely to feel lonely, isolated or abandoned (Ai & Hu, 2014). These feelings and the lack of someone to talk to may lead to less self-expression and more use of the ES strategy in LBC experiencing emotional problems. This phenomenon may explain the differences between LBC and NLBC in this study. In addition, the present study verified that each item of ES and CR has a good item-total correlation, and both scales showed good reliability coefficients. In other word, the ERQ has good internal consistency. The test–retest correlations suggested reasonable stability for the scale over time. It is worth noting that the result of stability is consistent with that in another study that also suggests that there is more variation of ES strategy over time compared with CR (Liu et al., 2017). However, it differs from the findings of other studies that suggest less variability for the ES over time (Balzarotti et al., 2010; Cabello et al., 2013; Gómez-Ortiz et al., 2016; Gullone & Taffe, 2012). We noticed that Liu et al. also included Chinese rural students in their sample. Regarding the abovementioned results, LBC may use the ES strategy more, and one study showed that a longer duration of being left behind is significantly associated with emotional symptoms (Fan et al., 2010). In other words, it is reasonable to assume that the ES strategy is more likely to change in concert with the increase in the amount of time LBC are separated from their parents. Finally, the ERQ showed adequate convergent and discriminant validity, and the criterion validity was also acceptable.
Limitations
First and foremost, the samples in this study were all from the same province in China, which may limit the generalization performance of these conclusions of this scale in other regions. In addition, in this study we found low stability of the ES strategy over time, though it is similar to another study which also contained Chinese LBC sample, it is different from other studies which all shows less variability for the ES. Thus, more studies are needed to verify these conclusions in other groups.
Conclusion
The Emotion Regulation Questionnaire is a good two-dimensional measurement to be used in Chinese LBC to investigate the extent of their use of these two different emotional regulation strategies.
References
Abler, B., & Kessler, H. (2009). Emotion regulation questionnaire– Eine deutschsprachige Fassung des ERQ von Gross und John[emotion regulation questionnaire – A German-language version of the ERQ by Gross and John]. Diagnostica, 55(3), 144–152. https://doi.org/10.1026/0012-1924.55.3.144
Ai, H., & Hu, J. (2014). Psychological resilience moderates the impact of social support on loneliness of “left-behind” children. Journal of Health Psychology, 21(6), 1066–1073. https://doi.org/10.1177/1359105314544992
Aldao, A., Nolen-Hoeksema, S., & Schweizer, S. (2010). Emotion-regulation strategies across psychopathology: A meta-analytic review. Clinical Psychology Review, 30(2), 217–237. https://doi.org/10.1016/j.cpr.2009.11.004
Balzarotti, S., John, O. P., & Gross, J. J. (2010). An italian adaptation of the emotion regulation questionnaire. European Journal of Psychological Assessment, 26(1), 61–67. https://doi.org/10.1027/1015-5759/a000009
Cabello, R., Salguero, J. M., Fernández-Berrocal, P., & Gross, J. J. (2013). A Spanish adaptation of the emotion regulation questionnaire. European Journal of Psychological Assessment, 29(4), 234–240. https://doi.org/10.1027/1015-5759/a000150
Cisler, J. M., Olatunji, B. O., Feldner, M. T., & Forsyth, J. P. (2010). Emotion regulation and the anxiety disorders: An integrative review. Journal of Psychopathology and Behavioral Assessment, 32(1), 68–82. https://doi.org/10.1007/s10862-009-9161-1
Coenders, G., Satorra, A., & Saris, W. E. (1997). Alternative approaches to structural modeling of ordinal data: A Monte Carlo study. Structural Equation Modeling, 4, 261–282. https://doi.org/10.1080/10705519709540077
D’Argembeau, A., & Van der Linden, M. (2006). Individual differences in the phenomenology of mental time travel: The effect of vivid visual imagery and emotion regulation strategies. Consciousness and Cognition, 15(2), 342–350. https://doi.org/10.1016/j.concog.2005.09.001
Dimitrov, D. M. (2010). Testing for factorial invariance in the context of construct validation. Measurement and Evaluation in Counseling and Development, 43(2), 121–149. https://doi.org/10.1177/0748175610373459
Ding, L., Yuen, L. W., Buhs, E. S., & Newman, I. M. (2019). Depression among Chinese left-behind children: A systematic review and meta-analysis. Child: Care, Health and Development, 45(2), 189–197. https://doi.org/10.1111/cch.12642
English, T., John, O. P., Srivastava, S., & Gross, J. J. (2012). Emotion regulation and peer-rated social functioning: A 4-year longitudinal study. Journal of Research in Personality, 46(6), 780–784. https://doi.org/10.1016/j.jrp.2012.09.006
Fan, F., Su, L., Gill, M. K., & Birmaher, B. (2010). Emotional and behavioral problems of Chinese left-behind children: A preliminary study. Social Psychiatry and Psychiatric Epidemiology, 45(6), 655–664. https://doi.org/10.1007/s00127-009-0107-4
Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466–491. https://doi.org/10.1037/1082-989X.9.4.466
Goldberg, D. P., Gater, R., Sartorius, N., Ustun, T. B., Piccinelli, M., Gureje, O., & Rutter, C. (1997). The validity of two versions of the GHQ in the WHO study of mental illness in general health care. Psychological Medicine, 27(1), 191–197. https://doi.org/10.1017/s0033291796004242
Gómez-Ortiz, O., Romera, E. M., Rosario, O. R., Rosario, C., & Fernández-Berrocal, P. (2016). Analysis of emotion regulation in Spanish adolescents: Validation of the emotion regulation questionnaire. Frontiers in Psychology, 6, 1959–1969. https://doi.org/10.3389/fpsyg.2015.01959
Gross, J. J. (1999). Emotion regulation: Past, present, future. Cognition and Emotion, 13(5), 551–573. https://doi.org/10.1080/026999399379186
Gross, J. J. (2001). Emotion regulation in adulthood: Timing is everything. Current Directions in Psychological Science, 10(6), 214–219. https://doi.org/10.1111/1467-8721.00152
Gross, J. J. (2002). Emotion regulation: Affective, cognitive, and social consequences. Psychophysiology, 39(3), 281–291. https://doi.org/10.0000/PMID12212647
Gross, J. J., & John, O. P. (2003). Individual differences in two emotion regulation processes: Implications for affect, relationships, and well-being. Journal of Personality and Social Psychology, 85(2), 348–362. https://doi.org/10.1037/0022-3514.85.2.348
Gullone, E., & Taffe, J. (2012). The emotion regulation questionnaire for children and adolescents (ERQ-CA): A psychometric evaluation. Psychological Assessment, 24(2), 409–417. https://doi.org/10.1037/a0025777
Hays, R. D., & Dimatteo, M. R. (1987). A short-form measure of loneliness. Journal of Personality Assessment, 51(1), 69–81. https://doi.org/10.1207/s15327752jpa5101_6
Hu, L. T., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424–453. https://doi.org/10.1037/1082-989X.3.4.424
John, O. P., & Gross, J. J. (2004). Healthy and unhealthy emotion regulation: Personality processes, individual differences, and life span development. Journal of Personality, 72(6), 1301–1334. https://doi.org/10.1111/j.1467-6494.2004.00298.x
Kline, P. (1994). An easy guide to factor analysis.
Lan, T., Jia, X. J., Lin, D. H., & Liu, X. (2019). Stressful life events, depression, and non-suicidal self-injury among chinese left-behind children: Moderating effects of self-esteem. Frontiers in Psychology, 10, 244–253. https://doi.org/10.3389/fpsyt.2019.00244
Li, C. H., & Wu, J. J. (2018). Psychometric evaluation of the Chinese version of the emotion regulation questionnaire in Taiwanese college students. Assessment, 27(6), 1–10. https://doi.org/10.1177/1073191118773875.
Liu, W., Chen, L., & Tu, X. (2017). Chinese adaptation of emotion regulation questionnaire for children and adolescents (ERQ-CCA): A psychometric evaluation in Chinese children. International Journal of Psychology, 52(5), 398–405. https://doi.org/10.1002/ijop.12233
Lopes, P. N., Salovey, P., & Straus, R. (2003). Emotional intelligence, personality, and the perceived quality of social relationships. Personality and Individual Differences, 35(3), 641–658. https://doi.org/10.1016/S0191-8869(02)00242-8
Matsumoto, D., Yoo, S. H., & Nakagawa, S. (2008). Culture, emotion regulation, and adjustment. Journal of Personality and Social Psychology, 94(6), 925–937. https://doi.org/10.1037/0022-3514.94.6.925
Meade, A. W., Lautenschlager, G. J., & Hecht, J. E. (2005). Establishing measurement equivalence and invariance in longitudinal data with item response theory. International Journal of Testing, 5(3), 279–300. https://doi.org/10.1207/s15327574ijt0503_6
Melka, S. E., Lancaster, S. L., Bryant, A. R., & Rodriguez, B. F. (2011). Confirmatory factor and measurement invariance analyses of the emotion regulation questionnaire. Journal of Clinical Psychology, 67(12), 1283–1293. https://doi.org/10.1002/jclp.20836
Milton, C. C., Zhang, X., Albanese, N. O., & Harvey, K. F. (2010). Differential requirement of Salvador-warts-hippo pathway members for organ size control in drosophila melanogaster. Development, 137(5), 735–743. https://doi.org/10.1242/dev.042309
Moore, S. A., Zoellner, L. A., & Mollenholt, N. (2008). Are expressive suppression and cognitive reappraisal associated with stress-related symptoms? Behaviour Research and Therapy, 46(9), 993–1000. https://doi.org/10.1016/j.brat.2008.05.001
Namatame, H., Fujisato, H., Ito, M., & Sawamiya, Y. (2020). Development and validation of a Japanese version of the emotion regulation questionnaire for children and adolescents. Neuropsychiatric Disease and Treatment, 16, 209–219. https://doi.org/10.2147/ndt.s211175
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill Inc
Ochsner, K. N., & Gross, J. J. (2008). Cognitive emotion regulation: Insights from social cognitive and affective neuroscience. Current Directions in Psychological Science, 17(2), 153–158. https://doi.org/10.1111/j.1467-8721.2008.00566.x
Preece, D. A., Becerra, R., Hasking, P., McEvoy, P. M., Boyes, M., Sauer-Zavala, S., & Gross, J. J. (2021). The emotion regulation questionnaire: Psychometric properties and relations with affective symptoms in a United States general community sample. Journal of Affective Disorders, 284, 27–30. https://doi.org/10.1016/j.jad.2021.01.071
Preece, D. A., Becerra, R., Robinson, K., & Gross, J. J. (2019). The emotion regulation questionnaire: Psychometric properties in general community samples. Journal of Personality Assessment, 101, 1–9. https://doi.org/10.1080/00223891.2018.1564319
Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004
Russell, D., Peplau, L. A., & Ferguson, M. L. (1978). Developing a measure of loneliness. JoumaJ of Personality Assessment, 42(3), 290–294. https://doi.org/10.1207/s15327752jpa4203_11
Sala, M. N., Molina, P., Abler, B., Kessler, H., Vanbrabant, L., & Rens, V. D. S. (2012). Measurement invariance of the emotion regulation questionnaire (ERQ). A crossnational validity study. European Journal of Developmental Psychology, 96(6), 751–757. https://doi.org/10.1080/17405629.2012.690604
Shao, J., Zhang, L., Ren, Y., Xiao, L., & Zhang, Q. (2018). Parent–child cohesion, basic psychological needs satisfaction, and emotional adaptation in left-behind children in China: An indirect effects model. Frontiers in Psychology, 9, 1023–1034. https://doi.org/10.3389/fpsyg.2018.01023
Spaapen, D. L., Waters, F., Brummer, L., Stopa, L., & Bucks, R. S. (2014). The emotion regulation questionnaire: Validation of the ERQ-9 in two community samples. Psychological Assessment, 26(1), 46–54. https://doi.org/10.1037/a0034474
Tang, D., Choi, W. I., Deng, L., Bian, Y., & Hu, H. (2019). Health status of children left behind in rural areas of Sichuan province of China: A cross-sectional study. BMC International Health and Human Rights, 19(1), 4–14. https://doi.org/10.1186/s12914-019-0191-9
Tang, W., Wang, G., Hu, T., Dai, Q., Xu, J., Yang, Y., & Xu, J. (2018). Mental health and psychosocial problems among Chinese left-behind children: A cross-sectional comparative study. Journal of Affective Disorders, 241, 133–141. https://doi.org/10.1016/j.jad.2018.08.017
Teixeira, A., Silva, E., Tavares, D., & Freire, T. (2014). Portuguese validation of the emotion regulation questionnaire for children and adolescents (ERQ-CA): Relations with self-esteem and life satisfaction. Child Indicators Research, 8(3), 605–621. https://doi.org/10.1007/s12187-014-9266-2
Velicer, W. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41(3), 321–327. https://doi.org/10.1007/BF02293557
Wang, F., Lin, L., Xu, M., Li, L., Lu, J., & Zhou, X. (2019). Mental health among left-behind children in rural China in relation to parent-child communication. International Journal of Environmental Research and Public Health, 16(10), 1855–1864. https://doi.org/10.3390/ijerph16101855
Wang, L., Lu, Y. P., & Li, Z. Q. (2007). Test of emotion regulation scale in adolescents. Chinese Journal of Clinical Psychology, 15(3), 236–238. https://doi.org/10.3969/j.issn.1005-3611.2007.03.005
Wang, X. D., Wang, X. L., & Ma, H. (1999). Rating scales for mental health. Chinese Mental Health Periodical Office
Wen, M., & Lin, D. (2012). Child development in rural China: Children left behind by their migrant parents and children of nonmigrant families. Child Development, 83(1), 120–136. https://doi.org/10.1111/j.1467-8624.2011.01698.x
Wiltink, J., Glaesmer, H., Canterino, M., Wölfling, K., Knebel, A., Kessler, H., Brähler, E., & Beutel, M. E. (2011). Regulation of emotions in the community: Suppression and reappraisal strategies and its psychometric properties. GMS Psycho-Social-Medicine, 8, 1–12. https://doi.org/10.3205/psm000078
Wu, W., Qu, G., Wang, L., Tang, X., & Sun, Y.-H. (2019). Meta-analysis of the mental health status of left-behind children in China. Journal of Paediatrics and Child Health, 55, 260–270. https://doi.org/10.1111/jpc.14349
Xiao, Y., Chen, Y., Meng, Q., Tian, X., He, L., Yu, Z., & Wang, Y. (2019). Suicide ideation and suicide plan in Chinese left-behind children: Prevalence and associated factors. Journal of Affective Disorders, 257, 662–668. https://doi.org/10.1016/j.jad.2019.07.072
Funding
This research was funded by 教育部人文社会科学研究青年基金项目 (Grant no. 18XJC190001), Natural Science Research Funding Project of Department of Education Guizhou Provience (Grant no. Qian Ke He KY Zi [2021]299), 贵州省教育厅高等学校人文社会科学研究项目 (Grant no. 2022ZD006), and Research results of humanities and social sciences project of higher education department of Guizhou province (Grant no. 2018ssd25)..
Author information
Authors and Affiliations
Contributions
Chen Wei made main contribution to this study, including come up with ideal, plan, execution and provide data analysis strategies of this study. Both Zhang Guyin and Tian Xue participated in the issuance of questionnaires and data input. Zhang Guyin performed all statistical analysis and interpreted the data, and drafted the manuscript. Wang Li provided suggestions on revision and confirmed the final version to be published. All authors of this research paper have participated in the discussion of theoretical framework and content modification.
Corresponding author
Ethics declarations
Ethical Approval
This study was approved by the Ethics Committee of University of Guizhou Normal University.
Informed Consent
Informed consent was obtained from all participants in this study.
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Guyin Zhang is the Co-first author
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Chen, W., Zhang, G., Tian, X. et al. Psychometric properties and measurement invariance of the emotion regulation questionnaire in Chinese left-behind children. Curr Psychol 42, 8833–8843 (2023). https://doi.org/10.1007/s12144-021-02155-y
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12144-021-02155-y