Advertisement

Application of the Bifactor S – 1 Model to Multisource Ratings of ADHD/ODD Symptoms: an Appropriate Bifactor Model for Symptom Ratings

  • G. Leonard BurnsEmail author
  • Christian Geiser
  • Mateu Servera
  • Stephen P. Becker
  • Theodore P. Beauchaine
Article
  • 76 Downloads

Abstract

The symmetrical bifactor model is often applied to attention-deficit/hyperactivity disorder (ADHD)-hyperactive/impulsive (HI), ADHD-inattentive (IN), and oppositional defiant disorder (ODD) symptoms, but this model frequently yields anomalous or inadmissible results. An alternative model, the bifactor S – 1 model, is more appropriate for examining the hierarchical structure of ADHD/ODD symptoms. Both models were applied to ADHD-HI, ADHD-IN, and ODD symptom ratings by mothers, fathers, and teachers for 2142 Spanish children (49.49% girls; ages 8–13 years). The symmetrical bifactor model yielded the typical anomalous loadings, with a weakly defined ADHD-HI specific factor and difficult to interpret associations of general and specific factors with correlates. In contrast, the bifactor S – 1 model with ADHD-HI symptoms as general reference factor produced clearly interpretable results. For mothers and fathers, slightly more than 50% of true score variance in ADHD-IN and ODD symptoms represented specific residual variance not shared with the general ADHD-HI reference factor. For teachers, approximately 69% and 39% of true score variance in ADHD-IN and ODD symptoms, respectively, represented specific residual variance not shared with the general ADHD-HI reference factor. The general ADHD-HI reference factor and specific ADHD-IN and ODD residual factors showed convergent and discriminant validity across sources, along with unique associations with peer rejection, social impairment, and academic impairment factors. The bifactor S – 1 model also yielded results consistent with predictions from trait-impulsivity theory of ADHD/ODD development. Researchers should use the bifactor S – 1 model rather than the symmetrical bifactor model if hypotheses involve the latent hierarchical structure of ADHD/ODD symptoms.

Keywords

Attention-deficit/hyperactivity disorder Bifactor model Bifactor S – 1 model Disruptive behavior disorders Oppositional defiant disorder P factor Trait impulsivity theory 

Notes

Acknowledgements

This research was supported by two grants from the Ministry of Economy and Competitiveness of Spanish Government under award numbers PSI2014-52605-R and PSI2017-82550-R (AEI/FEDER, UE), and a predoctoral fellowship co-financed by MINECO (Spanish Government) and the European Social Fund (BES-2015-075142). Stephen Becker is supported by award number K23MH108603 from the National Institute of Mental Health (NIMH). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health (NIH) or the Spanish Government. We thank Cristina Trias for assistance with the study.

Compliance with Ethical Standards

Conflict of Interest

The authors of the current study have no conflicts of interest.

Ethical Approval

The research protocol was approved by the Research Ethics Committee (Institutional Review Board [IRB]) of the University of the Balearic Islands.

Informed Consent

Mothers, fathers, and teachers provided written informed consent.

Supplementary material

10802_2019_608_MOESM1_ESM.docx (15 kb)
ESM 1 (DOCX 14 kb)

References

  1. Arias, V. B., Ponce, F. P., & Núñez, D. E. (2018). Bifactor models of attention-deficit/hyperactivity disorder (ADHD): An evaluation of three necessary but underused psychometric indexes. Assessment, 25, 885–897.  https://doi.org/10.1177/1073191116679260.CrossRefPubMedGoogle Scholar
  2. Beauchaine, T. P. (2015). Future directions in emotion dysregulation and youth psychopathology. Journal of Clinical Child and Adolescent Psychology, 44, 875–896.  https://doi.org/10.1080/15374416.2015.1038827.CrossRefPubMedGoogle Scholar
  3. Beauchaine, T. P., & Constantino, J. N. (2017). Redefining the endophenotype concept to accommodate transdiagnostic vulnerabilities and etiological complexity. Biomarkers in Medicine, 11, 769–780.  https://doi.org/10.2217/bmm-2017-0002.CrossRefPubMedPubMedCentralGoogle Scholar
  4. Beauchaine, T. P., & McNulty, T. (2013). Comorbidities and continuities as ontogenic processes. Toward a developmental spectrum model of externalizing psychopathology. Development and Psychopathology, 25, 1505–1528.  https://doi.org/10.1017/S0954579413000746.CrossRefPubMedPubMedCentralGoogle Scholar
  5. Beauchaine, T. P., Zisner, A., & Sauder, C. L. (2017). Trait impulsivity and the externalizing spectrum. Annual Review of Clinical Psychology, 13, 343–368.  https://doi.org/10.1146/annurev-clinpsy-021815-093253.CrossRefPubMedGoogle Scholar
  6. Becker, S. P., Burns, G. L., Schmitt, A. P., Epstein, J. N., & Tamm, L. (2019). Toward establishing a standard symptom set for assessing sluggish cognitive tempo in children: Evidence from teacher ratings in a community sample. Assessment, 26, 1128–1141.  https://doi.org/10.1177/1073191117715732.CrossRefPubMedGoogle Scholar
  7. Burns, G. L., & Becker, S. P. (2019). Sluggish cognitive tempo and ADHD symptoms in a nationally representative sample of U.S. children: Differentiation using categorical and dimensional approaches. Journal of Clinical Child and Adolescent Psychology. Advance online publication.  https://doi.org/10.1080/15374416.2019.1678165.
  8. Burns, G. L., Lee, S., Servera, M., McBurnett, K., & Becker, S. P. (2015). Child and adolescent behavior inventory–Parent version 1.0. Pullman: Authors.Google Scholar
  9. Burns, G. L., Moura, M. A., Beauchaine, T. P., & McBurnett, K. (2014a). Bifactor latent structure of ADHD/ODD symptoms: Predictions of dualpathway/trait-impulsivity etiological models of ADHD. Journal of Child Psychology and Psychiatry, 55, 393–401. https://doi.org/10.1111/jcpp.12165.CrossRefGoogle Scholar
  10. Burns, G. L., Servera, M., Bernard, M., Carrillo, J. M., & Geiser, C. (2014b). Ratings of ADHD symptoms and academic impairment by mothers, fathers, teachers and aides: Construct validity within and across settings as well as occasions. Psychological Assessment, 26, 1247–1258.  https://doi.org/10.1037/pas0000008.CrossRefPubMedGoogle Scholar
  11. Caspi, A., Houts, R. M., Belsky, D. W., Goldman-Mellor, S. J., Harrington, H., Israel, S., et al. (2014). The p factor: One general psychopathology factor in the structure of psychiatric disorders. Clinical Psychological Science, 2, 119–137.  https://doi.org/10.1177/2167702613497473.CrossRefPubMedPubMedCentralGoogle Scholar
  12. Diamond, A. (2005). Attention deficit disorder (ADHD without hyperactivity): A neurological and behavioral distinct disorder from ADHD (with hypeactivity). Development and Psychopathology, 17, 807-825.  https://doi.org/10.1017/S0954579405050388.
  13. Dishion, T. J. (1990). The peer context of troublesome child and adolescent behavior. In P. E. Leone (Ed.), Understanding troubled and troubling youth: Multiple perspectives (pp. 128–153). Thousand Oaks: Sage.Google Scholar
  14. DuPaul, G. J., Reid, R., Anastopoulos, A. D., Lambert, M. C., Watkins, M. W., & Power, T. J. (2015). Parent and teacher ratings of attention-deficit/hyperactivity disorder symptoms: Factor structure and normative data. Psychological Assessment, 28, 214–225.  https://doi.org/10.1037/pas0000166.CrossRefPubMedGoogle Scholar
  15. Eid, M., Geiser, C., Koch, T., & Heene, M. (2017). Anomalous results in G-factor models: Explanations and alternatives. Psychological Methods, 22, 541–562.  https://doi.org/10.1037/.met0000083.CrossRefPubMedGoogle Scholar
  16. Eid, M., Krumm, S., Koch, T., & Schulze, J. (2018). Bifactor models for predicting criteria by general and specific factors: Problems of nonidentifiability and alternative solutions. Journal of Intelligence. Advance online publication.  https://doi.org/10.3390/jintelligence6030042.CrossRefGoogle Scholar
  17. Fair, D. A., Nigg, J. T., Iyer, S., Bathula, D., Mills, K. L., Dosenbach, N. U. F., Milham, M. P. (2013). Distinct neural signatures detected for ADHD subtypes after controlling for micro-movements in resting state functional connectivity MRI data. Frontiers in Systems Neuroscience, 6, 80.  https://doi.org/10.3389/fnsys.2012.00080.
  18. Gatzke-Kopp, L. M., Beauchaine, T. P., Shannon, K. E., Chipman, J., Fleming, A. P., Crowell, S. E., & Aylward, E. (2009). Neurological correlates of reward responding in adolescents with conduct disorder and/or attention-deficit/hyperactivity disorder. Journal of Abnormal Psychology, 118, 203–213.Google Scholar
  19. Geiser, C., Bishop, J., & Lockhart, G. (2015). Collapsing factors in multitrait-multimethod models: Examining consequences of a mismatch between measurement design and model. Frontiers in Psychology, 6, 946.  https://doi.org/10.3389/fpsyg.2015.00946.CrossRefPubMedPubMedCentralGoogle Scholar
  20. Heinrich, M., Zagorscak, P., Eid, M., & Knaevelsrud, C. (2018). Giving G a meaning: An application of the bifactor-(S-1) approach to realize a more symptom-oriented modeling of the Beck Depression Inventory–II. Assessment. Advance online publication.  https://doi.org/10.1177/1073191118803738.2016.1144192.
  21. Holzinger, K., & Swineford, F. (1937). The bi-factor method. Psychometrika, 2, 41–54.  https://doi.org/10.1007/BF02287965.CrossRefGoogle Scholar
  22. Lee, S. Y., Burns, G. L., Beauchaine, T. P., & Becker, S. P. (2016). Bifactor latent structure of ADHD/ODD symptoms and the first-order latent structure of sluggish cognitive tempo symptoms. Psychological Assessment, 28, 917–928.  https://doi.org/10.1037/pas0000232.CrossRefGoogle Scholar
  23. Martel, M. M., Gremillion, M., Roberts, B., von Eye, A., & Nigg, J. T. (2010). The structure of childhood disruptive behaviors. Psychological Assessment, 22, 816–826.  https://doi.org/10.1037/a0020975.CrossRefPubMedPubMedCentralGoogle Scholar
  24. McDonough-Caplan, H. M., & Beauchaine, T. P. (2018). Conduct disorder: A neurodevelopmental perspective. In M. M. Martel (Ed.), Developmental pathways to disruptive, impulse-control, and conduct disorders (pp. 53–89). Cambridge, MA: Elsevier.Google Scholar
  25. Reise, S. P. (2012). The rediscovery of the bifactor measurement models. Multivariate Behavioral Research, 47, 667–696.  https://doi.org/10.1080/00273171.2012.715555.CrossRefPubMedPubMedCentralGoogle Scholar
  26. Rodenacker, K., Hautmann, C., Görtz-Dorten, A., & Döpfner, M. (2016). Bifactor models show a superior fit: Examination of the factorial validity of parent-reported and self-reported symptoms of attention-deficit/hyperactivity disorders in children and adolescents. Psychopathology, 49, 31–39.  https://doi.org/10.1159/000442295.CrossRefPubMedGoogle Scholar
  27. Rodenacker, K., Hautmann, C., Görtz-Dorten, A., & Döpfner, M. (2017). The factor structure of ADHD—different models, analyses, and informants in a bifactor framework. Journal of Psychopathology and Behavioral Assessment, 39, 92–102.  https://doi.org/10.1007/s10862-016-9565-7.CrossRefGoogle Scholar
  28. Rodenacker, K., Hautmann, C., Görtz-Dorten, A., & Döpfner, M. (2018). Evidence for the trait-impulsivity etiological models in a clinical sample: Bifactor structure and its relation to impairment and environmental risk. Journal of Abnormal Child Psychology, 46, 659–669.  https://doi.org/10.1007/s10802-017-0329-y.CrossRefPubMedGoogle Scholar
  29. Sáez, B., Servera, M., Becker, S. P., & Burns, G. L. (2018). Optimal items for assessing sluggish cognitive tempo in children across mother, father, and teacher ratings. Journal of Clinical Child and Adolescent Psychology, 48, 825–839.Google Scholar
  30. Servera, M., Sáez, B., Burns, G. L., & Becker, S. P. (2018). Clinical differentiation of sluggish cognitive tempo and attention-deficit/hyperactivity disorder in children. Journal of Abnormal Psychology, 127, 818–829.  https://doi.org/10.1037/abn0000375.CrossRefPubMedPubMedCentralGoogle Scholar
  31. Ullebø, A. K., Breivik, K., Gillberg, C., Lundervold, A. J., & Posserud, M. B. (2012). The factor structure of ADHD in a general population of primary school children. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 53, 927–936.  https://doi.org/10.1111/j.1469-7610.2012.02549.x.CrossRefPubMedGoogle Scholar
  32. Watts, A. L., Poore, H. E., & Waldman, I. D. (2019). Risker tests of the validity of the bifactor model of psychopathology. Clinical Psychological Science: Advance online publication.  https://doi.org/10.1177/2167702619855035.CrossRefGoogle Scholar
  33. Willcutt, E. G., Nigg, J. T., Pennington, B. F., Solanto, M. V., Rohde, L. A., Tannock, R., . . . Lahey, B. B. (2012). Validity of DSM-IV attention deficit/hyperactivity disorder symptom dimensions and subtypes. Journal of Abnormal Psychology, 121, 991–1010.  https://doi.org/10.1037/a0027347.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of PsychologyWashington State UniversityPullmanUSA
  2. 2.Utah State UniversityLoganUSA
  3. 3.University of the Balearic IslandsPalmaSpain
  4. 4.Cincinnati Children’s Hospital Medical Center and University of Cincinnati College of MedicineCincinnatiUSA
  5. 5.The Ohio State UniversityColumbusUSA

Personalised recommendations