Skip to main content
SpringerLink
Log in

Is the Youth Self-Report Total Score a Reliable Measure of both a General Factor of Psychopathology and Achenbach’s Eight Syndromes? A cross-cultural Study

  • Published:
Journal of Psychopathology and Behavioral Assessment Aims and scope Submit manuscript

Abstract

The idea that there is a p factor, i.e., a general factor of psychopathology underlying internalizing, externalizing, and thought disorders, is gaining increasing support, creating the need for instruments to assess this factor. The purpose of this study is to determine whether the total score of the Achenbach and Rescorla’s (2001) Youth Self-Report (YSR), an instrument that measures eight syndromes of internalizing, externalizing, and thought disorders, provides a reliable measure of the p factor in adolescents. For this purpose, we tested a bifactor model using exploratory structural equation modeling on a large cross-cultural sample of Algerian, French and Tunisian adolescents (N = 3,705). The results established that the YSR total score is a reliable measure of a general factor of psychopathology that explains two thirds of the common variance. Most syndrome scales are reliable measures of the whole formed by the general factor and the syndrome they are designed to measure, but only the Rule-Breaking Behavior syndrome scale explains a significant proportion of the variance above and beyond what is attributable to the general factor. Multigroup analyses showed that the total score and the Rule-Breaking Behavior scale score are reasonably invariant across genders, age groups, and countries, allowing for the examination of differences between subgroup latent means. The YSR total score thus appears to provide a reliable measure of the general factor of psychopathology that is robust across genders, ages, and countries.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Achenbach, T. M. (1966). The classification of children’s psychiatric symptoms: a factor-analytic study. Psychological Monographs: general and applied, 80(7), 1.

    Article  PubMed  Google Scholar 

  • Achenbach, T. M. (1974). Developmental Psychopathology. Ronald Press.

  • Achenbach, T. M., & Edelbrock, C. S. (1978). The classification of child psychopathology: A review and analysis of empirical efforts. Psychological Bulletin, 85(6), 1275–1130. https://doi.org/10.1037/0033-2909.85.6.1275.

    Article  PubMed  Google Scholar 

  • Achenbach, T. M., & Edelbrock, C. S. (1983). Manual for the Child Behavior Checklist and Revised Child Behavior Profile. University of Vermont, Department of Psychiatry.

  • Achenbach, T. M., & Edelbrock, C. S. (1987). Manual for the Youth Self-Report and Profile. University of Vermont, Department of Psychiatry.

  • Achenbach, T. M., & Rescorla, L. (2001). Manual for the ASEBA school-age forms & profiles: An integrated system of multi-informant assessment. Aseba.

  • Achenbach, T. M., & Rescorla, L. A. (2007). Multicultural supplement to the manual for the ASEBA school-age forms & profiles. University of Vermont Research Center for Children, Youth, & Families.

  • Althoff, R. R., Rettew, D. C., Ayer, L. A., & Hudziak, J. J. (2010). Cross-informant agreement of the Dysregulation Profile of the Child Behavior Checklist. Psychiatry Research, 178(3), 550–555. https://doi.org/10.1016/j.psychres.2010.05.002.

    Article  PubMed  PubMed Central  Google Scholar 

  • American Psychiatric Association (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Author.

  • Asparouhov, T., & Muthén, B. (2009). Exploratory structural equation modeling. Structural Equation Modeling: a Multidisciplinary Journal, 16(3), 397–438.

    Article  Google Scholar 

  • Balázs, J., Miklósi, M., Keresztény, A., Hoven, C. W., Carli, V., Wasserman, C., & Wasserman, D. (2013). Adolescent subthreshold-depression and anxiety: psychopathology, functional impairment and increased suicide risk. Journal of Child Psychology and Psychiatry, 54, 670–677. https://doi.org/10.1111/jcpp.12016.

    Article  PubMed  Google Scholar 

  • Capron, C., van der Ende, J., & Verhulst, F. (2005). Auto-questionnaire pour les jeunes de 11 à 18 ans Erasmus MC Sophia-Nederland.

  • Carver, C. S., Johnson, S. L., & Timpano, K. R. (2017). Toward a functional view of the p factor in psychopathology. Clinical Psychological Science, 5(5), 880–889. https://doi.org/10.1177%2F2167702617710037.

    Article  PubMed  PubMed Central  Google Scholar 

  • Caspi, A., Houts, R. M., Belsky, D. W., Goldman-Mellor, S. J., Harrington, H., Israel, S., & Moffitt, T. E. (2014). The p factor: one general psychopathology factor in the structure of psychiatric disorders? Clinical Psychological Science, 2(2), 119–137. doi: https://doi.org/10.1177/2167702613497473.

    Article  PubMed  PubMed Central  Google Scholar 

  • Caspi, A., & Moffitt, T. E. (2018). All for one and one for all: Mental disorders in one dimension. American Journal of Psychiatry, 175(9), 831–844. https://doi.org/10.1176/appi.ajp.2018.17121383.

    Article  PubMed  Google Scholar 

  • Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: a Multidisciplinary Journal, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5.

    Article  Google Scholar 

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Routledge. https://doi.org/10.4324/9780203771587

  • de la Osa, N., Penelo, E., Navarro, J. B., Trepat, E., & Ezpeleta, L. (2019). Prevalence, comorbidity, functioning and long-term effects of subthreshold oppositional defiant disorder in a community sample of preschoolers. European Child & Adolescent Psychiatry, 28, 1385–1393. https://doi.org/10.1007/s00787-019-01300-0.

    Article  Google Scholar 

  • Deutz, M. H., Geeraerts, S. B., Belsky, J., Deković, M., van Baar, A. L., Prinzie, P., & Patalay, P. (2020). General psychopathology and dysregulation profile in a longitudinal community sample: Stability, antecedents and outcomes. Child Psychiatry & Human Development, 51(1), 114–126. doi:https://doi.org/10.1017/S0954579417000955.

    Article  Google Scholar 

  • Forbes, M. K., Greene, A. L., Levin-Aspenson, H. F., Watts, A. L., Hallquist, M., Lahey, B. B., & Krueger, R. F. (2021). Three recommendations based on a comparison of the reliability and validity of the predominant models used in research on the empirical structure of psychopathology. Journal of Abnormal Psychology. https://doi.org/10.1037/abn0000533.

    Article  PubMed  Google Scholar 

  • Gignac, G. E., & Watkins, M. W. (2013). Bifactor modeling and the estimation of model-based reliability in the WAIS-IV. Multivariate Behavioral Research, 48(5), 639–662. https://doi.org/10.1080/00273171.2013.804398.

    Article  PubMed  Google Scholar 

  • Goodman, R. (1997). The Strengths and Difficulties Questionnaire: a research note. Journal of Child Psychology and Psychiatry, 38(5), 581–586.

    Article  PubMed  Google Scholar 

  • Goodman, R., Meltzer, H., & Bailey, V. (1998). The Strengths and Difficulties Questionnaire: a pilot study on the validity of the self-report version. European Child & Adolescent Psychiatry, 7(3), 125–130.

    Article  Google Scholar 

  • Haltigan, J. D., Aitken, M., Skilling, T., Henderson, J., Hawke, L., Battaglia, M., & Andrade, B. F. (2018). “P” and “DP:” examining symptom-level bifactor models of psychopathology and dysregulation in clinically referred children and adolescents. Journal of the American Academy of Child & Adolescent Psychiatry, 57(6), 384–396. https://doi.org/10.1016/j.jaac.2018.03.010.

    Article  Google Scholar 

  • Harden, K. P., Engelhardt, L. E., Mann, F. D., Patterson, M. W., Grotzinger, A. D., Savicki, S. L., & Tucker-Drob, E. M. (2020). Genetic associations between executive functions and a general factor of psychopathology. Journal of the American Academy of Child & Adolescent Psychiatry, 59(6), 749–758. https://doi.org/10.1016/j.jaac.2019.05.006.

    Article  Google Scholar 

  • Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118.

    Article  Google Scholar 

  • Ivanova, M. Y., Achenbach, T. M., Rescorla, L. A., Dumenci, L., Almqvist, F., Bilenberg, N., & Verhulst, F. C. (2007). The generalizability of the Youth Self-Report syndrome structure in 23 societies. Journal of Consulting and Clinical Psychology, 75(5), 729–738. https://doi.org/10.1037/0022-006X.75.5.729.

    Article  PubMed  Google Scholar 

  • Ivanova, M. Y., Achenbach, T. M., Rescorla, L. A., Guo, J., Althoff, R. R., Kan, K. J., & Verhulst, F. C. (2019). Testing syndromes of psychopathology in parent and youth ratings across societies. Journal of Clinical Child & Adolescent Psychology, 48(4), 596–609. https://doi.org/10.1080/15374416.2017.1405352.

    Article  Google Scholar 

  • Jordan, P., Rescorla, L. A., Althoff, R. R., & Achenbach, T. M. (2016). International Comparison of the Youth Self-Report Dysregulation Profile: Latent class analyses in 34 societies. Journal of the American Academy of Child and Adolescent Psychiatry, 55, 1046–1053. https://doi.org/10.1016/j.jaac.2016.08.012.

    Article  PubMed  Google Scholar 

  • Kline, R. B. (2011). Principles and Practice of Structural equation modeling (3rd ed.). Guilford.

  • Kotov, R., Jonas, K. G., Carpenter, W. T., Dretsch, M. N., Eaton, N. R., & Forbes, M. K. (2020). … HiTOP Utility Workgroup. Validity and utility of hierarchical taxonomy of psychopathology (HiTOP): I. Psychosis superspectrum. World Psychiatry, 19 (2), 151–172. https://doi.org/10.1002/wps.20730

  • Kotov, R., Krueger, R. F., & Watson, D. (2018). A paradigm shift in psychiatric classification: the Hierarchical Taxonomy Of Psychopathology (HiTOP). World Psychiatry, 17(1), 24. https://dx.doi.org/10.1002%2Fwps.20478.

    Article  PubMed  PubMed Central  Google Scholar 

  • Kotov, R., Krueger, R. F., Watson, D., Achenbach, T. M., Althoff, R. R., Bagby, R. M., & Zimmerman, M. (2017). The Hierarchical Taxonomy of Psychopathology (HiTOP): A dimensional alternative to traditional nosologies. Journal of Abnormal Psychology, 126(4), 454. https://doi.org/10.1037/abn0000258.

    Article  PubMed  Google Scholar 

  • Kotov, R., Krueger, R. F., Watson, D., Cicero, D. C., Conway, C. C., DeYoung, C. G., & Wright, A. G. (2021). The Hierarchical Taxonomy of Psychopathology (HiTOP): A quantitative nosology based on consensus of evidence. Annual Review of Clinical Psychology, 17, 83–108. https://doi.org/10.1146/annurev-clinpsy-081219-093304.

    Article  PubMed  Google Scholar 

  • Krueger, R. F. (1999). The structure of common mental disorders. Archives of General Psychiatry, 56(10), 921–926. doi:https://doi.org/10.1001/archpsyc.56.10.921.

    Article  PubMed  Google Scholar 

  • Krueger, R. F., Hobbs, K. A., Conway, C. C., Dick, D. M., Dretsch, M. N., & Eaton, N. R. (2021). … HiTOP Utility Workgroup. Validity and utility of hierarchical taxonomy of psychopathology (HiTOP): II. Externalizing superspectrum. World Psychiatry, 20(2), 171–193. https://doi.org/10.1002/wps.20844

  • Krueger, R. F., McGue, M., & Iacono, W. G. (2001). The higher-order structure of common DSM mental disorders: Internalization, externalization, and their connections to personality. Personality and Individual Differences, 30(7), 1245–1259. https://doi.org/10.1016/S0191-8869(00)00106-9.

    Article  Google Scholar 

  • Lahey, B. B., Applegate, B., Hakes, J. K., Zald, D. H., Hariri, A. R., & Rathouz, P. J. (2012). Is there a general factor of prevalent psychopathology during adulthood ? Journal of Abnormal Psychology, 121(4), 971. https://doi.org/10.1037/a0028355.

    Article  PubMed  PubMed Central  Google Scholar 

  • Lahey, B. B., Krueger, R. F., Rathouz, P. J., Waldman, I. D., & Zald, D. H. (2017). Validity and utility of the general factor of psychopathology. World Psychiatry, 16(2), 142. https://doi.org/10.1002%2Fwps.20410.

    Article  PubMed  PubMed Central  Google Scholar 

  • Levin-Aspenson, H. F., Watson, D., Clark, L. A., & Zimmerman, M. (2021). What is the general factor of psychopathology? Consistency of the p factor across samples. Assessment, 28(4), 1035–1049. https://doi.org/10.1177%2F1073191120954921.

    Article  PubMed  Google Scholar 

  • Marsh, H. W., Morin, A. J. S., Parker, P. D., & Kaur, G. (2014). Exploratory structural equation modeling: An integration of the best features of exploratory and confirmatory factor analysis. Annual Review of Clinical Psychology, 10, 85–110. https://doi.org/10.1146/annurev-clinpsy-032813-153700.

    Article  PubMed  Google Scholar 

  • Marsh, H. W., Muthén, B., Asparouhov, T., Lüdtke, O., Robitzsch, A., Morin, A. J., & Trautwein, U. (2009). Exploratory structural equation modeling, integrating CFA and EFA: Application to students’ evaluations of university teaching. Structural Equation Modeling: A Multidisciplinary Journal, 16, 439–476. https://doi.org/10.1080/10705510903008220.

    Article  Google Scholar 

  • McDonald, R. P. (1999). Test theory: A unified treatment. Lawrence Erlbaum.

  • Muthén, L. K., & Muthén, B. O. (1998/2010). Mplus. Version 6.0.Author.

  • Perreira, T. A., Morin, A. J., Hebert, M., Gillet, N., Houle, S. A., & Berta, W. (2018). The short form of the Workplace Affective Commitment Multidimensional Questionnaire (WACMQ-S): A bifactor-ESEM approach among healthcare professionals. Journal of Vocational Behavior, 106, 62–83. https://doi.org/10.1016/j.jvb.2017.12.004.

    Article  Google Scholar 

  • Pettersson, E., Larsson, H., D’Onofrio, B. M., Bölte, S., & Lichtenstein, P. (2020). The general factor of psychopathology: a comparison with the general factor of intelligence with respect to magnitude and predictive validity. World Psychiatry, 19(2), 206–213. https://doi.org/10.1002/wps.20763.

    Article  PubMed  PubMed Central  Google Scholar 

  • Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696. https://doi.org/10.1080/00273171.2012.715555.

    Article  PubMed  PubMed Central  Google Scholar 

  • Rescorla, L., Achenbach, T. M., Ivanova, M. Y., Dumenci, L., Almqvist, F., Bilenberg, N., & Verhulst, F. (2007). Epidemiological comparisons of problems and positive qualities reported by adolescents in 24 countries. Journal of Consulting and Clinical Psychology, 75(2), 351. https://doi.org/10.1037/0022-006X.75.2.351.

    Article  PubMed  Google Scholar 

  • Rescorla, L., Ivanova, M. Y., Achenbach, T. M., Begovac, I., Chahed, M., Drugli, M. B., & Zhang, E. Y. (2012). International epidemiology of child and adolescent psychopathology II: integration and applications of dimensional findings from 44 societies. Journal of the American Academy of Child & Adolescent Psychiatry, 51(12), 1273–1283. https://doi.org/10.1016/j.jaac.2012.09.012.

    Article  Google Scholar 

  • Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016a). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21(2), 137. https://doi.org/10.1037/met0000045.

    Article  PubMed  Google Scholar 

  • Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016b). Applying bifactor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 98(3), 223–237. https://doi.org/10.1080/00223891.2015.1089249.

    Article  PubMed  Google Scholar 

  • Selzam, S., Coleman, J. R., Caspi, A., Moffitt, T. E., & Plomin, R. (2018). A polygenic p factor for major psychiatric disorders. Translational Psychiatry, 8(1), 1–9. DOI https://doi.org/10.1038/s41398-018-0217-4.

    Article  Google Scholar 

  • Smith, G. T., Atkinson, E. A., Davis, H. A., Riley, E. N., & Oltmanns, J. R. (2020). The general factor of psychopathology. Annual Review of Clinical Psychology, 16, 75–98. https://doi.org/10.1146/annurev-clinpsy-071119-115848.

    Article  PubMed  Google Scholar 

  • Wang, J., & Wang, X. (2020). Structural Equation Modeling (2nd ed.). Wiley.

  • Watkins, M. W., & Beaujean, A. A. (2014). Bifactor structure of the Wechsler Preschool and Primary Scale of Intelligence—Fourth Edition. School Psychology Quarterly, 29, 52.

    Article  PubMed  Google Scholar 

  • Watson, D., Levin-Aspenson, H. F., Waszczuk, M. A., Conway, C. C., Dalgleish, T., Dretsch, M. N., & Zinbarg, R. E. (2022). Validity and utility of Hierarchical Taxonomy of Psychopathology (HiTOP): III. Emotional dysfunction superspectrum. World Psychiatry, 21(1), 26–54. https://doi.org/10.1002/wps.20943.

    Article  PubMed  PubMed Central  Google Scholar 

  • Widiger, T. A., Sellbom, M., Chmielewski, M., Clark, L. A., DeYoung, C. G., Kotov, R., & Wright, A. G. (2019). Personality in a hierarchical model of psychopathology. Clinical Psychological Science, 7(1), 77–92. https://doi.org/10.1177%2F2167702618797105.

    Article  Google Scholar 

  • World Health Organization. (2022). International Statistical Classification of Diseases and Related Health Problems (p. ICD11). Author.

  • Wright, A. G. C., Krueger, R. F., Hobbs, M. J., Markon, K. E., Eaton, N. R., & Slade, T. (2013). The structure of psychopathology: Toward an expanded quantitative empirical model. Journal of Abnormal Psychology, 122(1), 281–294. https://doi.org/10.1037/a0030133.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

NA

Funding

Not applicable.

Author information

Authors and Affiliations

  1. Université de Paris-Nanterre, laboratoire CLIPSYD EA 4430, 200, avenue de la République, 92001, Nanterre, France

    Djaouida Petot & Jean-Michel Petot

  2. Université de Tunis El Manar, Institut Supérieur des Sciences Humaines de Tunis, 1007, Tunis, Tunisie

    Myriam Chahed

Authors
  1. Djaouida Petot
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jean-Michel Petot
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Myriam Chahed
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Djaouida Petot.

Ethics declarations

Conflict of Interest

The authors have no relevant financial or non-financial interests to disclose.

Ethical Approval

This study was performed in accordance with the ethical standards as laid down in the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards. All participants and their legal guardians signed an informed consent form. The Algerian, French and Tunisian legislations do not require that psychological research be approved by an ethics committee.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Petot, D., Petot, JM. & Chahed, M. Is the Youth Self-Report Total Score a Reliable Measure of both a General Factor of Psychopathology and Achenbach’s Eight Syndromes? A cross-cultural Study. J Psychopathol Behav Assess 45, 58–74 (2023). https://doi.org/10.1007/s10862-022-10004-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10862-022-10004-w

Keywords

Search

Navigation