Skip to main content
SpringerLink
Log in

Who Are the Comorbid Adolescents? Agreement Between Psychiatric Diagnosis, Youth, Parent, and Teacher Report

  • Published:
Journal of Abnormal Child Psychology Aims and scope Submit manuscript

Abstract

The investigators examined the rates of psychiatric comorbidity for externalizing and internalizing behavior problems, using semistructured diagnostic interview and parent, teacher, and youth report on the Achenbach checklists. The study also evaluated the effects of conjunctive, compensatory, and disjunctive data combination strategies. Using the same data and identical diagnostic thresholds, between 5 and 74% of 189 youths presenting to an outpatient clinic were identified as having comorbid internalizing and externalizing problems. Parent report and semistructured interview indicated the highest comorbidity rates. Despite good cross-source agreement (rs .29–.58), there was very little agreement about which specific youths presented with comorbid internalizing and externalizing problems (kappas .14–.40). Results also indicate that single DSM-IV disorders, such as bipolar disorder, can manifest “comorbid” patterns of behavior problems on checklists.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Abikoff, H., Courtney, M., Pelham, W. E., & Koplewicz, H. S. (1993). Teachers' ratings of disruptive behaviors: The influence of halo effects. Journal of Abnormal Child Psychology, 21, 519-533.

    PubMed  Google Scholar 

  • Achenbach, T. M. (1991a). Integrative guide for the 1991 CBCL/4-18, YSR, and TRF profiles. Burlington: University of Vermont, Department of Psychiatry.

    Google Scholar 

  • Achenbach, T. M. (1991b). Manual for the Child Behavior Checklist/4-18 and 1991 profile. Burlington: University of Vermont, Department of Psychiatry.

    Google Scholar 

  • Achenbach, T. M. (1991c). Manual for the Teacher's Report Form and 1991 profile. Burlington: University of Vermont, Department of Psychiatry.

    Google Scholar 

  • Achenbach, T. M. (1991d). Manual for the Youth Self Report Form and 1991 profile. Burlington: University of Vermont, Department of Psychiatry.

    Google Scholar 

  • Achenbach, T. M. (1995). Empirically based assessment and taxonomy: Applications to clinical research. Psychological Assessment, 7, 261-274.

    Google Scholar 

  • Achenbach, T. M. (2000). Bibliography of published studies using ASEBA instruments. Retrieved August 28, 2001, from www.aseba.org

  • Achenbach, T. M., & Dumenci, L. (2001). Advances in empirically based assessment: Revised cross-informant syndromes and new DSM-oriented scales for the CBCL, YSR, and TRF: Comment on Lengua, Sadowski, Friedrich, and Fisher (2001). Journal of Consulting & Clinical Psychology, 69, 699-702.

    Google Scholar 

  • Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implication of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213-232.

    PubMed  Google Scholar 

  • Aiken, L. S., & West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Newbury Park: Sage.

    Google Scholar 

  • American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.

    Google Scholar 

  • Anastasi, A., & Urbina, S. (1997). Psychological testing (7th ed.). New York: MacMillan.

    Google Scholar 

  • Angold, A., Costello, E. J., & Erkanli, A. (1999). Comorbidity. Journal of Child Psychology & Psychiatry & Allied Disciplines, 40, 57-87.

    Google Scholar 

  • Barkley, R. A. (1998). Attention-deficit hyperactivity disorder: A handbook for diagnosis and treatment (2nd ed.). New York: Guilford.

    Google Scholar 

  • Beauchaine, T. P. (2001). Vagal tone, development, and Gray's motivational theory: Toward an integrated model of autonomic nervous system functioning in psychopathology. Development & Psychopathology, 13, 183-214.

    Google Scholar 

  • Beyers, J. M., & Loeber, R. (2003). Developmental aspects of delinquency and co-occurring aggression and depressed mood in male adolescents. Journal of Abnormal Child Psychology, 31(3), 247-266.

    PubMed  Google Scholar 

  • Biederman, J., Wozniak, J., Kiely, K., Ablon, S., Faraone, S., Mick, E., et al. (1995). CBCL clinical scales discriminate prepubertal children with structured interview-derived diagnosis of mania from those with ADHD. Journal of the American Academy of Child and Adolescent Psychiatry, 34, 464-471.

    PubMed  Google Scholar 

  • Bradley, S. J. (2000). Affect regulation and the development of psychopathology. New York: The Guilford Press.

    Google Scholar 

  • Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by multitrait–multimethod matrix. Psychological Bulletin, 56, 81-105.

    PubMed  Google Scholar 

  • Caron, C., & Rutter, M. (1991). Comorbidity in child psychopathology: Concepts, issues and research strategies. Journal of Child Psychology & Psychiatry & Allied Disciplines, 32, 1063-1080.

    Google Scholar 

  • Carson, R. C. (1996). Aristotle, Galileo, and the DSM taxonomy: The case of schizophrenia. Journal of Consulting and Clinical Psychology, 64, 1133-1139.

    PubMed  Google Scholar 

  • Carson, R. C. (1997). Costly compromises: A critique of the Diagnostic and Statistical Manual of Mental Disorders. In S. Fisher & R. P. Greenberg (Eds.), From placebo to panacea (pp. 98-112). New York: John Wiley and Sons, Inc.

    Google Scholar 

  • Caruso, J. C., & Cliff, N. (2000). Increasing the reliability of Wechsler Intelligence Scale for Children—Third edition difference scores with reliable component analysis. Psychological Assessment, 12, 89-96.

    PubMed  Google Scholar 

  • Clarke, G. N. (1995). Improving the transition from basic efficacy research to effectiveness studies: Methodological issues and procedures. Journal of Consulting and Clinical Psychology, 63, 718-725.

    PubMed  Google Scholar 

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale: Lawrence Erlbaum.

    Google Scholar 

  • Cohen, J. A. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46.

    Google Scholar 

  • Conners, C. K., Sitarenios, G., Parker, J. D. A., & Epstein, J. N. (1998a). The revised Conners' Parent Rating Scale (CPRS-R): Factor structure, reliability, and criterion validity. Journal of Abnormal Child Psychology, 26, 257-268.

    PubMed  Google Scholar 

  • Conners, C. K., Sitarenios, G., Parker, J. D. A., & Epstein, J. N. (1998b). Revision and restandardization of the Conners Teacher Rating Scale (CTRS-R): Factor structure, reliability, and criterion validity. Journal of Abnormal Child Psychology, 26, 279-291.

    PubMed  Google Scholar 

  • Danielson, C. K., Youngstrom, E. A., Findling, R. L., & Calabrese, J. R. (2003). Discriminative validity of the General Behavior Inventory using youth report. Journal of Abnormal Child Psychology, 31, 29-39.

    PubMed  Google Scholar 

  • Elkin, I., Shea, M. T., Watkins, J. T., Imber, S. D., Sotsky, S. M., Collins, J. F., et al. (1989). National Institute of Mental Health Treatment of Depression Collaborative Research Program: General effectiveness of treatments. Archives of General Psychiatry, 46, 971-982.

    PubMed  Google Scholar 

  • Embretson, S. E. (1996). The new rules of measurement. Psychological Assessment, 8, 341-349.

    Google Scholar 

  • Farrington, D. P., & Loeber, R. (2000). Some benefits of dichotomization in psychiatric and criminological research. Criminal Behaviour & Mental Health, 10, 100-122.

    Google Scholar 

  • Findling, R. L., Gracious, B. L., McNamara, N. K., Youngstrom, E. A., Demeter, C., & Calabrese, J. R. (2001). Rapid, continuous cycling and psychiatric co-morbidity in pediatric bipolar I disorder. Bipolar Disorders, 3, 202-210.

    PubMed  Google Scholar 

  • Findling, R. L., Youngstrom, E. A., Danielson, C. K., DelPorto, D., Papish-David, R., Townsend, L., et al. (2002). Clinical decision-making using the General Behavior Inventory. Bipolar Disorders, 4, 34-42.

    PubMed  Google Scholar 

  • Fowles, D. C. (1994). A motivational theory of psychopathology. In W. D. Spaulding (Ed.), Integrative views of motivation, cognition, and emotion. (Vol. 41, pp. 181-238). Lincoln, NE: University of Nebraska Press.

    Google Scholar 

  • Geller, B., Warner, K., Williams, M., & Zimerman, B. (1998). Prepubertal and young adolescent bipolarity versus ADHD: Assessment and validity using the WASH-U-KSADS, CBCL and TRF. Journal of Affective Disorders, 51, 93-100.

    PubMed  Google Scholar 

  • Guion, R. M. (1998). Assessment, measurement, and prediction for personnel decisions. Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Holm, V. A., Cassidy, S. B., Butler, M. G., Hanchett, J. M., Greenswag, L. R., Whitman, B. Y., et al. (1993). Prader-Willi syndrome: Consensus diagnostic criteria. Pediatrics, 91, 398-402.

    PubMed  Google Scholar 

  • Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996). Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress. American Psychologist, 51, 1059-1064.

    PubMed  Google Scholar 

  • Jensen, P., Roper, M., Fisher, P., & Piacentini, J. (1995). Test-retest reliability of the Diagnostic Interview Schedule for Children (DISC 2.1): Parent, child, and combined algorithms. Archives of General Psychiatry, 52, 61-71.

    PubMed  Google Scholar 

  • Kamphaus, R. W., & Frick, P. J. (1996). Clinical assessment of child and adolescent personality and behavior. Needham Heights, MA: Allyn and Bacon.

    Google Scholar 

  • Kamphaus, R. W., Huberty, C. J., DiStefano, C., & Petoskey, M. D. (1997). A typology of teacher-rated child behavior for a national U.S. sample. Journal of Abnormal Child Psychology, 25, 453-463.

    PubMed  Google Scholar 

  • Kaufman, J., Birmaher, B., Brent, D., Rao, U., Flynn, C., Moreci, P., et al. (1997). Schedule for Affective Disorders and Schizophrenia for School-Age Children—Present and Lifetime version (K-SADS-PL): Initial reliability and validity data. Journal of the American Academy of Child and Adolescent Psychiatry, 36, 980-988.

    PubMed  Google Scholar 

  • Kazdin, A. E. (Ed.). (1992). Methodological issues and strategies in clinical research. Washington, DC: American Psychological Association.

    Google Scholar 

  • Keiley, M. K., Lofthouse, N., Bates, J. E., Dodge, K. A., & Pettit, G. S. (2003). Differential risk factors in covarying and pure components in mother and teacher reports of externalizing and internalizing behavior across ages 5 to 14. Journal of Abnormal Child Psychology, 31(3), 267-283.

    PubMed  Google Scholar 

  • Kihlstrom, J. F. (2001). To honor Kraepelin: From symptoms to pathology in the diagnosis of mental illness. In L. E. Beutler & M. Malik (Eds.), Rethinking the DSM: Psychological perspectives. Washington, D.C.: American Psychological Association.

    Google Scholar 

  • Klein, D. N., Ouimette, P. C., Kelly, H. S., Ferro, T., & Riso, L. P. (1994). Test-retest reliability of team consensus best-estimate diagonses of Axis I and II disorders in a family study. American Journal of Psychiatry, 151, 1043-1047.

    PubMed  Google Scholar 

  • Kraemer, H. C. (1992). Coping strategies in psychiatric clinical research. In A. E. Kazdin (Ed.), Methodological issues and strategies in clinical research (pp. 539-556). Washington, DC: American Psychological Association.

    Google Scholar 

  • Krueger, R. F. (1999). The structure of common mental disorders. Archives of General Psychiatry, 56, 921-926.

    PubMed  Google Scholar 

  • Krueger, R. F., Caspi, A., Moffitt, T. E., & Silva, P. A. (1998). The structure and stability of common mental disorders (DSM-III-R): A longitudinal–epidemiological study. Journal of Abnormal Psychology, 107, 216-227.

    PubMed  Google Scholar 

  • Lengua, L. J., Sadowski, C. A., Friedrich, W. N., & Fisher, J. (2001). Rationally and empirically derived dimensions of children's symptomatology: Expert ratings and confirmatory factor analyses of the CBCL. Journal of Consulting & Clinical Psychology, 69, 683-698.

    Google Scholar 

  • Lilienfeld, S. O. (2003). Comorbidity. Journal of Abnormal Child Psychology, 31(3) 285-291.

    PubMed  Google Scholar 

  • Lilienfeld, S. O., Waldman, I. D., & Israel, A. C. (1994). A critical examination of the use of the term and concept of comorbidity in psychopathology research. Clinical Psychology Science and Practice, 1, 71-83.

    Google Scholar 

  • Little, T. D. (1997). Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32, 53-76.

    Google Scholar 

  • Loeber, R., Farrington, D. P., Stouthamer-Loeber, M., Moffitt, T. E., & Caspi, A. (1998). The development of male offending: Key findings from the first decade of the Pittsburgh Youth Study. Studies on Crime and Prevention, 7, 141-171.

    Google Scholar 

  • Loeber, R., Green, S. M., & Lahey, B. B. (1990). Mental health professionals' perception of the utility of children, mothers, and teachers as informants on childhood psychopathology. Journal of Clinical Child Psychology, 19, 136-143.

    Google Scholar 

  • Loeber, R., Green, S. M., Lahey, B. B., & Stouthamer-Loeber, M. (1989). Optimal informants on childhood disruptive behaviors. Development and Psychopathology, 1, 317-337.

    Google Scholar 

  • Mash, E. J., & Wolfe, D. A. (1999). Abnormal Child Psychology. New York: Brooks/Cole Wadsworth.

    Google Scholar 

  • Meehl, P. E. (1995). Bootstraps taxometrics: Solving the classification problem in psychopathology. American Psychologist, 50, 266-275.

    PubMed  Google Scholar 

  • Meyer, G. J. (2001). Implications of information gathering methods for a refined taxonomy of psychopathology. In L. E. Beutler & M. Malik (Eds.), Rethinking the DSM: Psychological perspectives. Washington, DC: American Psychological Association.

    Google Scholar 

  • Mineka, S., Watson, D., & Clark, L. A. (1998). Comorbidity of anxiety and unipolar mood disorders. Annual Review of Psychology, 49, 377-412.

    PubMed  Google Scholar 

  • Moffit, T. E., Caspi, A., Dickson, N., Silva, P., & Stanton, W. (1996). Childhood-onset versus adolescent-onset antisocial conduct problems in males: Natural history from ages 3 to 18 years. Development and Psychopathology, 8, 399-424.

    Google Scholar 

  • MTA Cooperative Group. (1999). A 14-month randomized clinical trial of treatment strategies for Attention-Deficit/Hyperactivity Disorder. Archives of General Psychiatry, 56, 1073-1086.

    Google Scholar 

  • Offord, D. R., Boyle, M. H., & Racine, Y. (1989). Ontario Child Health Study: Correlates of disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 28, 856-860.

    PubMed  Google Scholar 

  • Offord, D. R., Boyle, M. H., Racine, Y., Szatmari, P., Fleming, J. E., Sanford, M., et al. (1996). Integrating assessment data from multiple informants. Journal of the American Academy of Child and Adolescent Psychiatry, 35, 1078-1085.

    PubMed  Google Scholar 

  • Orvaschel, H. (1995). Schizophrenia and Affective Disorders Schedule for children-Epidemiological Version (KSADS-E). Unpublished manuscript, Nova University.

  • Perloff, J. M., & Persons, J. B. (1988). Biases resulting from the use of indexes: An application to attributional style and depression. Psychological Bulletin, 103, 95-104.

    PubMed  Google Scholar 

  • Phares, V. (1997). Accuracy of informants: Do parents think that mother knows best? Journal of Abnormal Child Psychology, 25, 165-171.

    PubMed  Google Scholar 

  • Piacentini, J. C., Cohen, P., & Cohen, J. (1992). Combining discrepant diagnostic information from multiple sources: Are complex algorithms better than simple ones? Journal of Abnormal Child Psychology, 20, 51-63.

    PubMed  Google Scholar 

  • Rubio-Stipec, M., Canino, G. J., Shrout, P., Dulcan, M., Freeman, D., & Bravo, M. (1994). Psychometric properties of parents and children as informants in child psychiatry epidemiology with the Spanish Diagnostic Interview Schedule for Children (DISC.2). Journal of Abnormal Child Psychology, 22, 703-720.

    PubMed  Google Scholar 

  • Ruscio, J., & Ruscio, A. M. (2000). Informing the continuity controversy: A taxometric analysis of depression. Journal of Abnormal Psychology, 109, 473-487.

    PubMed  Google Scholar 

  • Silverstein, A. B. (1993). Type I, Type II, and other types of errors in pattern analysis. Psychological Assessment, 5, 72-74.

    Google Scholar 

  • Traub, R. E. (1991). Reliability for the social sciences. Newbury Park, CA: Sage.

    Google Scholar 

  • Tsujimoto, R. N., Hamilton, M., & Berger, D. E. (1990). Averaging multiple judges to improve validity: Aid to planning cost-effective clinical research. Psychological Assessment, 2, 432-437.

    Google Scholar 

  • Waldman, I. D., & Slutske, W. S. (2000). Antisocial behavior and alcoholism: A behavioral genetic perspective on comorbidity. Clinical Psychology Review, 20, 255-287.

    PubMed  Google Scholar 

  • Waller, N. G., & Meehl, P. E. (1998). Multivariate taxometric procedures: Distinguishing types from continua (Vol. 9). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Weiss, B. (1998). Routine monitoring of the effectiveness of child psychotherapy. Journal of Child Psychology & Psychiatry & Allied Disciplines, 39, 943-950.

    Google Scholar 

  • Weiss, B., Suesser, K., & Catron, T. (1998). Common and specific features of childhood psychopathology. Journal of Abnormal Psychology, 107, 118-127.

    PubMed  Google Scholar 

  • Youngstrom, E. A., Findling, R. L., Danielson, C. K., & Calabrese, J. R. (2001). Discriminative validity of parent report of hypomanic and depressive symptoms on the General Behavior Inventory. Psychological Assessment, 13, 267-276.

    PubMed  Google Scholar 

  • Youngstrom, E. A., Loeber, R., & Stouthamer-Loeber, M. (2000). Patterns and correlates of agreement between parent, teacher, and male youth behavior ratings. Journal of Consulting & Clinical Psychology, 68, 1038-1050.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Psychology, Case Western Reserve University, Cleveland, Ohio

    Eric A. Youngstrom, Robert L. Findling & Joseph R. Calabrese

  2. University Hospitals of Cleveland, Cleveland, Ohio

    Eric A. Youngstrom, Robert L. Findling & Joseph R. Calabrese

Authors
  1. Eric A. Youngstrom
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Robert L. Findling
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Joseph R. Calabrese
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Eric A. Youngstrom.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Youngstrom, E.A., Findling, R.L. & Calabrese, J.R. Who Are the Comorbid Adolescents? Agreement Between Psychiatric Diagnosis, Youth, Parent, and Teacher Report. J Abnorm Child Psychol 31, 231–245 (2003). https://doi.org/10.1023/A:1023244512119

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1023244512119

Search

Navigation