Abstract
Exploratory structural equation modeling (SEM) was applied to a multiple indicator (26 individual symptom ratings) by multitrait (ADHD-IN, ADHD-HI and ODD factors) by multiple source (mothers, fathers and teachers) model to test the invariance, convergent and discriminant validity of the Child and Adolescent Disruptive Behavior Inventory with 872 Thai adolescents and the ADHD Rating Scale-IV and ODD scale of the Disruptive Behavior Inventory with 1,749 Spanish children. Most of the individual ADHD/ODD symptoms showed convergent and discriminant validity with the loadings and thresholds being invariant over mothers, fathers and teachers in both samples (the three latent factor means were higher for parents than teachers). The ADHD-IN, ADHD-HI and ODD latent factors demonstrated convergent and discriminant validity between mothers and fathers within the two samples. Convergent and discriminant validity between parents and teachers for the three factors was either absent (Thai sample) or only partial (Spanish sample). The application of exploratory SEM to a multiple indicator by multitrait by multisource model should prove useful for the evaluation of the construct validity of the forthcoming DSM-V ADHD/ODD rating scales.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
American Psychiatric Association. (1980). Diagnostic and statistical manual of mental disorders (3rd ed.). Washington, DC: Author.
Asparouhov, T., & Muthén, B. (2009). Exploratory structural equation modeling. Structural Equation Modeling, 16, 397–438.
Barkley, R. A. (2011). Distinguishing Sluggish Cognitive Tempo from Attention-Deficit Hyperactivity Disorder in adults. Journal of Abnormal Psychology. Advance online publication. doi:10.1037/a0023961.
Barkley, R. A., & Murphy, K. R. (2005). Attention-deficit hyperactivity disorder: A clinical workbook (3rd ed.). New York: Guilford.
Bauermeister, J. J., Canino, G., Polanczyk, G., & Rohde, L. A. (2010). ADHD across cultures: is there evidence for a bidimensional organization of symptoms? Journal of Clinical Child and Adolescent Psychology, 39, 362–372.
Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York: Guilford.
Burns, G. L., & Haynes, S. N. (2006). Clinical psychology: Construct validation with multiple sources of information and multiple settings. In M. Eid & E. Diener (Eds.), Handbook of multimethod measurement in psychology. Washington, DC: American Psychological Association.
Burns, G. L., Taylor, T., & Rusby, J. (2001a). Child and adolescent disruptive behavior inventory—Version 2.3 (Parent). Unpublished manuscript.
Burns, G. L., Taylor, T., & Rusby, J. (2001b). Child and adolescent disruptive behavior inventory—Version 2.3 (Teacher). Unpublished manuscript.
Burns, G. L., Walsh, J. A., Boe, B., Sommers-Flanagan, R., & Teegarden, L. A. (2001c). A confirmatory factor analysis on the DSM-IV ADHD and ODD symptoms: what is the best model for the organization of these symptoms? Journal of Abnormal Child Psychology, 29, 339–349.
Burns, G. L., Moura, M. A., Walsh, J. A., Desmul, C., Silpakit, C., & Sommers-Flanagan, J. (2008). Invariance and convergent and discriminant validity between mothers’ and fathers’ ratings of oppositional defiant disorder toward adults, ADHD-HI, ADHD-IN, and academic competence factors within Brazilian, Thai, and American children. Psychological Assessment, 20, 121–130.
Burns, G. L., Desmul, C., Walsh, J. A., Silpakit, C., & Ussahawanitchakit, P. (2009). A multitrait (ADHD-IN, ADHD-HI, ODD toward adults, academic and social competence) by multisource (mothers and fathers) evaluation of the invariance and convergent/discriminant validity of the Child and Adolescent Disruptive Behavior Inventory with Thai Adolescents. Psychological Assessment, 21, 635–641.
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504.
Dumenci, L., Achenbach, T. M., & Windle, M. (2011). Measuring context-specific and cross-contextual components of hierarchical constructs. Journal of Psychopathology and Behavioral Assessment, 33, 3–10.
DuPaul, G. J., Power, T. J., McGoey, K. E., Ikeda, M. J., & Anastopoulos, A. D. (1998). Reliability and validity of parent and teacher ratings of attention-deficit/hyperactivity disorder symptoms. Journal of Psychoeducational Assessment, 16, 55–68.
Eid, M., Lischetzke, T., & Nussbeck, F. W. (2006). Structural equation modeling for multitrait-multimethod data. In M. Eid & E. Diener (Eds.), Handbook of multimethod measurement in psychology (pp. 283–299). Washington, DC: American Psychological Association.
Geiser, C., Eid, M., Nussbeck, F. W., Courvoisier, D. S., & Cole, D. A. (2010). Analyzing true change in longitudinal multitrait-multimethod studies: application of a multimethod change model to depression and anxiety in children. Developmental Psychology, 46, 29–45.
Kline, R. B. (2011). Principles and practice of structural equation modeling (3rd ed.). New York: Guilford.
Moura, M. A., & Burns, G. L. (2010). Oppositional defiant disorder toward adults and oppositional defiant disorder toward other children: evidence for two separate constructs with mothers and fathers’ ratings of Brazilian children. Journal of Child Psychology and Psychiatry, 51, 23–30.
Muthén, L. K., & Muthén, B. O. (1998–2010). Mplus User’s Guide (6th ed.). Los Angeles, CA: Muthén & Muthén.
Servera, M., & Cardo, E. (2007). Las ADHD Rating Scale-IV en una muestra escolar española: datos normativos y consistencia interna para maestros, padres y madres (ADHD Rating Scale-IV in a sample of Spanish schoolchildren: normative data and internal consistency of teacher and parents). Revista de Neurología, 45(7), 393–399.
Servera, M., Lorenzo-Seva, U., Cardo, E., Rodríguez-Fornells, A., & Burns, G. L. (2010). Understanding trait and source effects in Attention Deficit Hyperactivity Disorder and Oppositional Defiant Disorder rating scales: mothers, fathers and teachers’ ratings of children from the Balearic Islands. Journal of Clinical Child and Adolescent Psychology, 39, 1–11.
Shipp, F., Burns, G. L., & Desmul, C. (2010). Construct validity of ADHD-IN, ADHD-HI, ODD toward adults, academic and social competence dimensions in teacher ratings of Thai Adolescents. Journal of Psychopathology and Behavioral Assessment, 32, 557–564.
Skansgaard, E. P., & Burns, G. L. (1998). Comparison of DSM-IV ADHD combined type and predominantly inattentive types: correspondence between teacher ratings and direct observations of inattention, hyperactivity/impulsivity, slow cognitive tempo, oppositional defiant disorder, and overt conduct disorder symptoms. Child and Family Behavior Therapy, 20, 1–14.
Taylor, T. K., Burns, G. L., Rusby, J. C., & Foster, E. M. (2006). Oppositional defiant disorder toward adults and oppositional defiant disorder toward peers: Initial evidence for two separate constructs. Psychological Assessment, 18, 439–433.
Toplak, M. E., Pitch, A., Flora, D. B., Iwenofu, L., Ghelani, K., Jain, U., & Tannock, R. (2009). The unity and diversity of inattention and hyperactivity/impulsivity in ADHD: evidence for a general factor with separable dimensions. Journal of Abnormal Child Psychology, 37, 1137–1150.
Toplak, M. E., Sorge, G. B., Flora, D. B., Chen, W., Banaschewski, T., Buitelaar, J., et al. (2012). The hierarchical factor model of ADHD: invariant across age and national groupings? Journal of Child Psychology and Psychiatry, 53, 292–303.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Burns, G.L., Walsh, J.A., Servera, M. et al. Construct Validity of ADHD/ODD Rating Scales: Recommendations for the Evaluation of Forthcoming DSM-V ADHD/ODD Scales. J Abnorm Child Psychol 41, 15–26 (2013). https://doi.org/10.1007/s10802-012-9660-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10802-012-9660-5