Skip to main content
Log in

Testing Models of Psychopathology in Preschool-aged Children Using a Structured Interview-based Assessment

  • Published:
Journal of Abnormal Child Psychology Aims and scope Submit manuscript

Abstract

A number of studies have found that broadband internalizing and externalizing factors provide a parsimonious framework for understanding the structure of psychopathology across childhood, adolescence, and adulthood. However, few of these studies have examined psychopathology in young children, and several recent studies have found support for alternative models, including a bi-factor model with common and specific factors. The present study used parents’ (typically mothers’) reports on a diagnostic interview in a community sample of 3-year old children (n = 541; 53.9 % male) to compare the internalizing-externalizing latent factor model with a bi-factor model. The bi-factor model provided a better fit to the data. To test the concurrent validity of this solution, we examined associations between this model and paternal reports and laboratory observations of child temperament. The internalizing factor was associated with low levels of surgency and high levels of fear; the externalizing factor was associated with high levels of surgency and disinhibition and low levels of effortful control; and the common factor was associated with high levels of surgency and negative affect and low levels of effortful control. These results suggest that psychopathology in preschool-aged children may be explained by a single, common factor influencing nearly all disorders and unique internalizing and externalizing factors. These findings indicate that shared variance across internalizing and externalizing domains is substantial and are consistent with recent suggestions that emotion regulation difficulties may be a common vulnerability for a wide array of psychopathology.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Notes

  1. In addition to relying on the CBQ factor scores, we conducted secondary analyses using a rationally constructed positive emotionality scale. The CBQ surgency scale largely reflects impulsivity and sensation seeking and limits our understanding of how a more traditional positive emotionality construct is associated with the latent dimensions. We examined a composite of two scales -- smiling/laughter and shyness-reverse scored (r = 0.35, p < 0.001) – to index positive emotionality. Using this scale, positive emotionality was negatively associated with the internalizing factor (r = −0.19, p < 0.001) and positively associated with the externalizing factor (r = 0.11, p < 0.01), however it was not related to the common factor (r = 0.04, p = 0.45)

References

  • Achenbach, T. M., & Rescorla, L. A. (2000). Manual for the ASEBA Preschool Forms & Profiles. Burlington: University of Vermont, Research Center for Children, Youth, and Families.

    Google Scholar 

  • Achenbach, T. M., Edelbrock, C., & Howell, C. T. (1987). Empirically based assessment of the behavioral/emotional problems of 2-and 3-year-old children. Journal of Abnormal Child Psychology, 15(4), 629–650.

    Article  PubMed  Google Scholar 

  • Acock, A. C. (2005). Working with missing values. Journal of Marriage and Family, 67(4), 1012–1028.

    Article  Google Scholar 

  • Aldao, A., & Nolen-Hoeksema, S. (2010). Specificity of cognitive emotion regulation strategies: A transdiagnostic examination. Behaviour Research and Therapy, 48(10), 974–983.

    Article  PubMed  Google Scholar 

  • American Psychiatric Association. (1994). Diagnostic and Statistical Manual of Mental Disorders (4th edition, rev.). Washington, DC: Author.

  • Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238–246.

    Article  PubMed  Google Scholar 

  • Bufferd, S. J., Dougherty, L. R., Carlson, G. A., & Klein, D. N. (2011). Parent-reported mental health in preschoolers: Findings using a diagnostic interview. Comprehensive Psychiatry, 52(4), 359–369.

    Article  PubMed  PubMed Central  Google Scholar 

  • Burke, J. D., Hipwell, A. E., & Loeber, R. (2010). Dimensions of oppositional defiant disorder as predictors of depression and conduct disorder in preadolescent girls. Journal of the American Academy of Child and Adolescent Psychiatry, 49(5), 484–492.

    PubMed  PubMed Central  Google Scholar 

  • Carlson, S. M. (2005). Developmentally sensitive measures of executive function in preschool children. Developmental neuropsychology, 28(2), 595–616.

    Article  PubMed  Google Scholar 

  • Carter, A. S., Briggs-Gowan, M. J., Jones, S. M., & Little, T. D. (2003). The infant–toddler social and emotional assessment (ITSEA): Factor structure, reliability, and validity. Journal of Abnormal Child Psychology, 31(5), 495–514.

    Article  PubMed  Google Scholar 

  • Clark, L. A. (2005). Temperament as a unifying basis for personality and psychopathology. Journal of Abnormal Psychology, 114(4), 505–521. doi:10.1037/0021-843x.114.4.505.

    Article  PubMed  Google Scholar 

  • Dougherty, L. R., Bufferd, S. J., Carlson, G. A., Dyson, M., Olino, T. M., Durbin, C. E., & Klein, D. N. (2011). Preschoolers’ observed temperament and psychiatric disorders assessed with a parent diagnostic interview. Journal of Clinical Child and Adolescent Psychology, 40(2), 295–306.

    Article  PubMed  PubMed Central  Google Scholar 

  • Dunn, L. M., & Dunn, L. M. (1997). Peabody picture vocabulary Test (3rd eds.). Circle Pines: American Guidance Service.

    Google Scholar 

  • Durbin, C. E., Klein, D. N., Hayden, E. P., Buckley, M. E., & Moerk, K. C. (2005). Temperamental emotionality in preschoolers and parental mood disorders. Journal of Abnormal Psychology, 114(1), 28–37.

    Article  PubMed  Google Scholar 

  • Durbin, C. E., Hayden, E. P., Klein, D. N., & Olino, T. M. (2007). Stability of laboratory-assessed temperamental emotionality traits from ages 3 to 7. Emotion, 7(2), 388–399.

    Article  PubMed  Google Scholar 

  • Dyson, M. W., Olino, T. M., Durbin, C. E., Goldsmith, H. H., & Klein, D. N. (2012). The structure of temperament in preschoolers: A two-stage factor analytic approach. Emotion, 12(1), 44–57.

    Article  PubMed  PubMed Central  Google Scholar 

  • Eaton, N., Krueger, R., Keyes, K., Skodol, A., Markon, K., Grant, B., & Hasin, D. (2011). Borderline personality disorder co-morbidity: relationship to the internalizing–externalizing structure of common mental disorders. Psychological Medicine, 41(05), 1041–1050.

    Article  PubMed  PubMed Central  Google Scholar 

  • Egger, H. L., & Emde, R. N. (2011). Developmentally sensitive diagnostic criteria for mental health disorders in early childhood: DSM-IV, RDC-PA, and the revised DC: 0–3. American Psychologist, 66(2), 95–106.

    Article  PubMed  PubMed Central  Google Scholar 

  • Egger, H. L., Ascher, B. H., & Angold, A. (1999). The Preschool Age Psychiatric Assessment: Version 1.1. Durham, NC: Center for Developmental Epidemiology, Department of Psychiatry and Behavioral Sciences, Duke University Medical Center.

  • Egger, H. L., Fenichel, E., Guedeney, A., Wise, B. K., & Wright, H. H. (2005). Diagnostic classification of mental health and developmental disorders of infancy and early childhood: Revised edition (DC: 0-3R). Washington: Zero To Three Press.

    Google Scholar 

  • Egger, H. L., Erkanli, A., Keeler, G., Potts, E., Walter, B. K., & Angold, A. (2006). Test-retest reliability of the preschool age psychiatric assessment (PAPA). Journal of the American Academy of Child and Adolescent Psychiatry, 45(5), 538–549.

    Article  PubMed  Google Scholar 

  • Gadow, K., & Sprafkin, J. (1997). Child Symptom Inventory 4, Norms manual. Stony Brook: Checkmate Plus.

    Google Scholar 

  • Gadow, K., & Sprafkin, J. (2000). Early childhood inventory-4 screening manual. Stony Brook: Checkmate Plus.

    Google Scholar 

  • Goldsmith, H. H., Reilly, J., Lemery, K. S., Longley, S., & Prescott, A. (1995). Laboratory Temperament Assessment Battery: Preschool Version. Unpublished Manuscript.

  • Graham, J. W., Olchowski, A. E., & Gilreath, T. D. (2007). How many imputations are really needed? Some practical clarifications of multiple imputation theory. Prevention Science, 8(3), 206–213.

    Article  PubMed  Google Scholar 

  • Hink, L. K., Rhee, S. H., Corley, R. P., Cosgrove, V. E., Hewitt, J. K., Schulz-Heik, R. J., & Waldman, I. D. (2013). Personality dimensions as common and broadband-specific features for internalizing and externalizing disorders. Journal of Abnormal Child Psychology, 41, 939–957.

    Article  PubMed  PubMed Central  Google Scholar 

  • Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55.

    Article  Google Scholar 

  • Ivanova, M. Y., Achenbach, T. M., Rescorla, L. A., Harder, V. S., Ang, R. P., Bilenberg, N., & Dias, P. (2010). Preschool psychopathology reported by parents in 23 societies: testing the seven-syndrome model of the child behavior checklist for ages 1.5–5. Journal of the American Academy of Child and Adolescent Psychiatry, 49(12), 1215–1224.

    PubMed  Google Scholar 

  • Kotov, R., Gamez, W., Schmidt, F., & Watson, D. (2010). Linking “big” personality traits to anxiety, depressive, and substance use disorders: A meta-analysis. Psychological Bulletin, 136(5), 768–821.

    Article  PubMed  Google Scholar 

  • Krueger, R. F., & Markon, K. E. (2006). Reinterpreting comorbidity: A model-based Approach to Understanding and Classifying Psychopathology. Annual Review of Clinical Psychology, 2, 111–133.

    Article  PubMed  PubMed Central  Google Scholar 

  • Krueger, R. F., Caspi, A., Moffitt, T. E., & Silva, P. A. (1998). The structure and stability of common mental disorders (DSM-III-R): A longitudinal-epidemiological study. Journal of Abnormal Psychology, 107(2), 216–227.

    Article  PubMed  Google Scholar 

  • Lahey, B. B., Rathouz, P. J., Van Hulle, C., Urbano, R. C., Krueger, R. F., Applegate, B., & Waldman, I. D. (2008). Testing structural models of DSM-IV symptoms of common forms of child and adolescent psychopathology. Journal of Abnormal Child Psychology, 36(2), 187–206.

    Article  PubMed  Google Scholar 

  • Lahey, B. B., Van Hulle, C. A., Singh, A. L., Waldman, I. D., & Rathouz, P. J. (2011). Higher-order genetic and environmental structure of prevalent forms of child and adolescent psychopathology. Archives of General Psychiatry, 68(2), 181–189.

    Article  PubMed  PubMed Central  Google Scholar 

  • Lahey, B. B., Applegate, B., Hakes, J. K., Zald, D. H., Hariri, A. R., & Rathouz, P. J. (2012). Is There a General Factor of Prevalent Psychopathology During Adulthood? Journal of Abnormal Psychology, 121(4), 971–977.

    Article  PubMed  PubMed Central  Google Scholar 

  • MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130–149.

    Article  Google Scholar 

  • Marsh, H. W., Hau, K. T., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling, 11(3), 320–341.

    Article  Google Scholar 

  • Martel, M. M., Gremillion, M., Roberts, B., von Eye, A., & Nigg, J. T. (2010). The structure of childhood disruptive behaviors. Psychological Assessment, 22(4), 816–826.

    Article  PubMed  Google Scholar 

  • Muthén, L. K., & Muthén, B. O. (1998–2012). Mplus User’s Guide (7th ed.). Los Angeles: Muthén & Muthén.

    Google Scholar 

  • Navarro Pastor, J. B. (2003). Methods for the analysis of explanatory linear regression models with missing data not at random. Quality & quantity, 37(4), 363–376.

    Article  Google Scholar 

  • Nolen-Hoeksema, S., & Watkins, E. R. (2011). A Heuristic for Developing Transdiagnostic Models of Psychopathology Explaining Multifinality and Divergent Trajectories. Perspectives on Psychological Science, 6(6), 589–609.

    Article  Google Scholar 

  • Olino, T. M., Klein, D. N., Dyson, M. W., Rose, S. A., & Durbin, C. E. (2010). Temperamental emotionality in preschool-aged children and depressive disorders in parents: Associations in a large community sample. Journal of Abnormal Psychology, 119(3), 468–478.

    Article  PubMed  PubMed Central  Google Scholar 

  • Richman, N., & Graham, P. (1971). A behavioural screening questionnaire for use with 3-year-old children: Preliminary findings. Journal of Child Psychology and Psychiatry, 12, 5–33.

    Article  PubMed  Google Scholar 

  • Rothbart, M. K., Ahadi, S. A., Hershey, K. L., & Fisher, P. (2001). Investigations of temperament at three to seven years: The Children’s Behavior Questionnaire. Child Development, 72(5), 1394–1408.

    Article  PubMed  Google Scholar 

  • Simms, L., Prisciandaro, J., Krueger, R., & Goldberg, D. (2012). The structure of depression, anxiety and somatic symptoms in primary care. Psychological Medicine, 42(1), 15–28.

    Article  PubMed  Google Scholar 

  • Slade, T., & Watson, D. (2006). The structure of common DSM-IV and ICD-10 mental disorders in the Australian general population. Psychological Medicine, 36(11), 1593–1600.

    Article  PubMed  Google Scholar 

  • Sprafkin, J., Volpe, R. J., Gadow, K. D., Nolan, E. E., & Kelly, K. (2002). A DSM-IV-referenced screening instrument for preschool children: the Early Childhood Inventory-4. Journal of the American Academy of Child and Adolescent Psychiatry, 41(5), 604–612.

    Article  PubMed  Google Scholar 

  • Steiger, J. H. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25(2), 173–180.

    Article  Google Scholar 

  • Sterba, S. K., Egger, H. L., & Angold, A. (2007). Diagnostic specificity and nonspecificity in the dimensions of preschool psychopathology. Journal of Child Psychology and Psychiatry, 48(10), 1005–1013.

    Article  PubMed  PubMed Central  Google Scholar 

  • Strickland, J., Keller, J., Lavigne, J. V., Gouze, K., Hopkins, J., & LeBailly, S. (2011). The structure of psychopathology in a community sample of preschoolers. Journal of Abnormal Child Psychology, 39(4), 601–610.

    Article  PubMed  Google Scholar 

  • Stringaris, A., & Goodman, R. (2009). Three dimensions of oppositionality in youth. Journal of Child Psychology and Psychiatry, 50(3), 216–223.

    Article  PubMed  Google Scholar 

  • Thomas, M. L. (2011). Rewards of bridging the divide between measurement and clinical theory: Demonstration of a bifactor model for the brief symptom inventory. Psychological Assessment, 24(1), 101–113.

    Article  PubMed  Google Scholar 

  • Trosper, S. E., Whitton, S. W., Brown, T. A., & Pincus, D. B. (in press). Understanding the Latent Structure of the Emotional Disorders in Children and Adolescents. Journal of Abnormal Child Psychology.

  • Vollebergh, W. A. M., Iedema, J., Bijl, R. V., de Graaf, R., Smit, F., & Ormel, J. (2001). The structure and stability of common mental disorders: the NEMESIS study. Archives of General Psychiatry, 58(6), 597–603.

    Article  PubMed  Google Scholar 

Download references

Acknowledgement

This work was supported by R01 MH069942 (PI: Klein), K01 MH092603 (PI: Olino), F31 MH084444 (PI: Bufferd), and M01 RR10710 (Stony Brook University General Clinical Research Center). Dr. Carlson receives funding from Glaxo Smith Kline and Bristol Myers Squibb.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Thomas M. Olino.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Olino, T.M., Dougherty, L.R., Bufferd, S.J. et al. Testing Models of Psychopathology in Preschool-aged Children Using a Structured Interview-based Assessment. J Abnorm Child Psychol 42, 1201–1211 (2014). https://doi.org/10.1007/s10802-014-9865-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10802-014-9865-x

Keywords

Navigation