Advertisement

A Measurement Framework to Determine the Construct Validity of ADHD/ODD Rating Scales: Additional Evaluations of the Child and Adolescent Disruptive Behavior Inventory

  • Girwan Khadka
  • G. Leonard Burns
Article

Abstract

A multiple group confirmatory factor analysis was used to test the invariance of an attention-deficit/hyperactivity disorder-inattention, attention-deficit/hyperactivity disorder-hyperactivity/impulsivity, oppositional defiant disorder toward adults, academic and social competence five-factor model across of independent groups of Thai adolescents with the Child and Adolescent Disruptive Behavior Inventory (CADBI). Mothers and fathers’ ratings on 872 adolescents were compared to mothers and fathers’ ratings on a different group of 983 adolescents. The design allowed four invariance analyses (i.e., mothers’ ratings of the first group compared to mothers’ ratings of the second group; fathers’ ratings of first group compared to fathers’ ratings of the second group; mothers’ ratings of first group compared to fathers’ ratings of the second group; and fathers’ ratings of first group compared to mothers’ ratings of second group). Support was found for the invariance of like-symptom loadings and symptom intercepts as well as like-factor variances, covariances, and factor means across the four invariance analyses. The findings further expand the construct validity of the CADBI. The paper also introduces a multiple indicators by multiple traits by multiple methods by multiple sources by multiple occasions by multiple groups’ measurement matrix to guide the evaluation of the construct validity of ADHD/ODD rating scales.

Keywords

Attention-deficit/hyperactivity disorder Oppositional defiant disorder Confirmatory factor analysis Multiple group invariance analyses Construct validity Measurement framework for ADHD/ODD scales Thai adolescents 

References

  1. Barkley, R. A. (2012). Distinguishing sluggish cognitive tempo from ADHD in children and adolescents: executive functioning, impairment, and comorbidity. Journal of Clinical Child and Adolescent Psychology. doi: 10.1080/15374416.2012.734259. Advance online publication.
  2. Bauermeister, J. J., Canino, G., Polanczyk, G., & Rohde, L. A. (2010). ADHD across cultures: Is there evidence for a bidimensional organization of symptoms? Journal of Clinical Child and Adolescent Psychology, 39, 362–372.Google Scholar
  3. Burns, G. L., Boe, B., Walsh, J. A., Sommers-Flanagan, R., & Teegarden, L. A. (2001). A confirmatory factor analysis on the DSM-IV ADHD and ODD symptoms: what is the best model for the organization of these symptoms? Journal of Abnormal Child Psychology, 29, 339–349.PubMedCrossRefGoogle Scholar
  4. Burns, G. L., Taylor, T., Rusby, J. (2001). Child and adolescent disruptive behavior inventory—Version 2.3 (Parent). Unpublished manuscript.Google Scholar
  5. Burns, G. L., Walsh, J. A., & Gomez, R. (2003). Convergent and discriminant validity of trait and source effects in ADHD-inattention and hyperactivity/impulsivity measures across a 3-month interval. Journal of Abnormal Child Psychology, 15, 529–541.Google Scholar
  6. Burns, G. L., Walsh, J. A., Gomez, R., & Hafetz, N. (2006). Measurement and structural invariance of parent ratings of ADHD and ODD symptoms across gender for American and Malaysian children. Psychological Assessment, 18, 452–457.PubMedCrossRefGoogle Scholar
  7. Burns, G. L., Moura, M. A., Walsh, J. A., Desmul, C., Silpakit, C., & Sommers-Flanagan, J. (2008). Invariance and convergent and discriminant validity between mothers’ and fathers’ ratings of oppositional defiant disorder toward adults, ADHD-HI, ADHD-IN, and academic competence factors within Brazilian, Thai, and American children. Psychological Assessment, 20, 121–130.PubMedCrossRefGoogle Scholar
  8. Burns, G. L., Desmul, C., Walsh, J. A., Silpakit, C., & Ussahawanitchakit, P. (2009). A multitrait (ADHD-IN, ADHD-HI, ODD toward adults, academic and social competence) by multisource (mothers and fathers) evaluation of the invariance and convergent/discriminant validity of the Child and Adolescent Disruptive Behavior Inventory with Thai Adolescents. Psychological Assessment, 21, 635–641.PubMedCrossRefGoogle Scholar
  9. Burns, G. L., Walsh, J. A., Servera, M., Lorenzo-Seva, U., Cardo, E., & Rodríguez-Fornells, A. (2012). Construct validity of ADHD/ODD rating scales: recommendations for the evaluation of the forthcoming DSM-V ADHD/ODD scales. Journal of Abnormal Child Psychology. doi: 10.1007/s10802=012=9660-5. Advance online publication.
  10. Byrne, B. M. (2012). Structural equation modeling with Mplus: basic concepts, applications, and programming. New York: Routledge.Google Scholar
  11. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validity by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.PubMedCrossRefGoogle Scholar
  12. Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504.CrossRefGoogle Scholar
  13. Frick, P. J., & McMahon, R. J. (2008). Child and adolescent conduct problems. In J. Hunsley & E. J. Mash (Eds.), A guide to assessments that work (pp. 17–40). New York: Oxford Press.Google Scholar
  14. Geiser, C., & Lockhart, G. (2012). A comparison of four approaches to method effects in latent state-trait analyses. Psychological Methods, 17, 255–283.PubMedCrossRefGoogle Scholar
  15. Geiser, C., Eid, M., Nussbeck, F. W., Courvoisier, D. S., & Cole, D. A. (2010). Analyzing true change in longitudinal multitrait-multimethod studies: application of a multimethod change model to depression and anxiety in children. Developmental Psychology, 46, 29–45.PubMedCrossRefGoogle Scholar
  16. Gomez, R., Burns, G. L., Walsh, J. A., & Moura, M. A. (2003). A multitrait-multisource factor analytic approach to the construct validity of ADHD rating scales. Psychological Assessment, 15, 3–16.PubMedCrossRefGoogle Scholar
  17. Johnston, C., & Mah, J. W. T. (2008). Child attention-deficit/hyperactivity disorder. In J. Hunsley & E. J. Mash (Eds.), A guide to assessments that work (pp. 41–66). New York: Oxford Press.Google Scholar
  18. Moura, M. A., & Burns, G. L. (2010). Oppositional defiant behavior toward adults and oppositional defiant behavior toward other children: Evidence for two separate constructs with mothers' and fathers' ratings of Brazilian children. Journal of Child Psychology and Psychiatry, 51, 23–30.Google Scholar
  19. Muthén, L. K., & Muthén, B. O. (1998–2010). Mplus User’s Guide (6th ed.). Los Angeles, CA: Muthén & Muthén.Google Scholar
  20. Servera, M., Lorenzo-Seva, U., Cardo, E., Rodriguez-Fornells, A., & Burns, G. L. (2010). Understanding trait and source effects in attention-deficit/hyperactivity disorder and oppositional defiant disorder rating scales: Mothers, fathers and teachers' ratings of children from the Balearic Islands. Journal of Clinical Child and Adolescent Psychology, 39, 1–11.Google Scholar
  21. Shipp, F., Burns, G. L., & Desmul, C. (2010). Construct validity of ADHD-IN, ADHD-HI, ODD toward adults, academic and social competence dimensions in teacher ratings of Thai adolescents: additional validity for the child and adolescent disruptive behavior inventory. Journal of Psychopathology and Behavioral Assessment, 32, 557–564.CrossRefGoogle Scholar
  22. Taylor, T. K., Burns, G. L., Rusby, J. C., & Foster, E. M. (2006). Oppositional defiant disorder toward peers: initial evidence for two separate constructs. Psychological Assessment, 18, 439–443.PubMedCrossRefGoogle Scholar
  23. Toplak, M. E., Sorge, G. B., Flora, D. B., Chen, W., Banaschewski, T., Buitelaar, J., & Farone, S. V. (2012). The hierarchical factor model of ADHD: invariant across age and national groupings? Journal of Child Psychology and Psychiatry, 53, 292–303.PubMedCrossRefGoogle Scholar
  24. Willcut, E. G., Nigg, J. T., Pennington, B. F., Solanto, M. V., Rohde, L. A., Tannock, R., & Lahey, B. B. (2012). Validity of DSM-IV attention-deficit/hyperactivity disorder symptom dimensions and subtypes. Journal of Abnormal Psychology. doi: 10.1037/a0027347. Advance online publication.

Copyright information

© Springer Science+Business Media New York 2012

Authors and Affiliations

  1. 1.Department of PsychologyWashington State UniversityPullmanUSA

Personalised recommendations