Skip to main content
SpringerLink
Log in

Factor Mixture Modeling of the Insomnia Severity Index among Psychology Clinic Outpatients

  • Published:
Journal of Psychopathology and Behavioral Assessment Aims and scope Submit manuscript

Abstract

Insomnia symptoms are common among individuals with psychiatric disorders, and associated with increased symptom severity. However, the Insomnia Severity Index (ISI) has rarely been psychometrically evaluated in a psychiatric sample. Furthermore, the latent structure of the ISI has not been evaluated using factor mixture modeling, which improves upon prior analytic techniques by integrating factor structure and including exogenous variables. Thus, the current study used factor mixture modeling to test the latent structure of the ISI among two samples of psychology clinic outpatients (Ns = 366 and 331). The ISI was best represented with a three-class structure representing “no or minimal,” “moderate,” and “severe” insomnia symptoms, with significantly escalating symptoms of depression, anxiety, and posttraumatic stress across these classes. Clinical cut-scores for the “severe” class were also derived using receiver operating curve analyses. Implications for theoretical conceptualization of insomnia among those with psychiatric disorders and clinical implications are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Allan, N. P., Korte, K. J., Capron, D. W., Raines, A. M., & Schmidt, N. B. (2014a). Factor mixture modeling of anxiety sensitivity: A three-class structure. Psychological Assessment, 26(4), 1184–1195.

    PubMed  Google Scholar 

  • Allan, N. P., Raines, A. M., Capron, D. W., Norr, A. M., Zvolensky, M. J., & Schmidt, N. B. (2014b). Identification of anxiety sensitivity classes and clinical cut-scores in a sample of adult smokers: Results from a factor mixture model. Journal of Anxiety Disorders, 28(7), 696–703.

    PubMed  PubMed Central  Google Scholar 

  • American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington: American Psychiatric Publishing.

    Book  Google Scholar 

  • Angst, J., Gamma, A., Clarke, D., Ajdacic-Gross, V., Rössler, W., & Regier, D. (2010). Subjective distress predicts treatment seeking for depression, bipolar, anxiety, panic, neurasthenia and insomnia severity spectra. Acta Psychiatrica Scandinavica, 122(6), 488–498.

    PubMed  Google Scholar 

  • Asparouhov, T., & Muthén, B. (2014). Multiple-group factor analysis alignment. Structural Equation Modeling: A Multidisciplinary Journal, 21(4), 495–508.

    Google Scholar 

  • Babson, K. A., Blonigen, D. M., Boden, M. T., Drescher, K. D., & Bonn-Miller, M. O. (2012). Sleep quality among US military veterans with PTSD: A factor analysis and structural model of symptoms. Journal of Traumatic Stress, 25(6), 665–674.

    PubMed  Google Scholar 

  • Bakk, Z., & Vermunt, J. K. (2016). Robustness of stepwise latent class modeling with continuous distal outcomes. Structural Equation Modeling: A Multidisciplinary Journal, 23(1), 20–31.

    Google Scholar 

  • Bastien, C. H., Vallières, A., & Morin, C. M. (2001). Validation of the insomnia severity index as an outcome measure for insomnia research. Sleep Medicine, 2(4), 297–307.

    PubMed  Google Scholar 

  • Bauer, D. J., & Curran, P. J. (2004). The integration of continuous and discrete latent variable models: Potential problems and promising opportunities. Psychological Methods, 9(1), 3–29.

    PubMed  Google Scholar 

  • Beck, A. T., Kovacs, M., & Weissman, A. (1979). Assessment of suicidal intention: The scale for suicide ideation. Journal of Consulting and Clinical Psychology, 47(2), 343–352.

    PubMed  Google Scholar 

  • Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988). An inventory for measuring clinical anxiety: Psychometric properties. Journal of Consulting and Clinical Psychology, 56(6), 893–897.

    PubMed  Google Scholar 

  • Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Manual for the Beck Depression Inventory-II. San Antonio, TX: Psychological Corporation.

  • Benjamins, J. S., Migliorati, F., Dekker, K., Wassing, R., Moens, S., Blanken, T. F., et al. (2017). Insomnia heterogeneity: Characteristics to consider for data-driven multivariate subtyping. Sleep Medicine Reviews, 36, 71–81.

    PubMed  Google Scholar 

  • Bolck, A., Croon, M., & Hagenaars, J. (2004). Estimating latent structure models with categorical variables: One-step versus three-step estimators. Political Analysis, 12(1), 3–27.

    Google Scholar 

  • Buysse, D. J., Reynolds III, C. F., Monk, T. H., Berman, S. R., & Kupfer, D. J. (1989). The Pittsburgh sleep quality index: A new instrument for psychiatric practice and research. Psychiatry Research, 28(2), 193–213.

    PubMed  Google Scholar 

  • Castronovo, V., Galbiati, A., Marelli, S., Brombin, C., Cugnata, F., Giarolli, L., Anelli, M. M., Rinaldi, F., & Ferini-Strambi, L. (2016). Validation study of the Italian version of the Insomnia Severity Index (ISI). Neurological Sciences, 37(9), 1517–1524.

    PubMed  Google Scholar 

  • Chen, P.-Y., Yang, C.-M., & Morin, C. M. (2015). Validating the cross-cultural factor structure and invariance property of the insomnia severity index: Evidence based on ordinal EFA and CFA. Sleep Medicine, 16(5), 598–603.

    PubMed  Google Scholar 

  • Chung, K.-F., Kan, K. K.-K., & Yeung, W.-F. (2011). Assessing insomnia in adolescents: Comparison of insomnia severity index, Athens insomnia scale and sleep quality index. Sleep Medicine, 12(5), 463–470.

    PubMed  Google Scholar 

  • Clark, S. L., Muthén, B., Kaprio, J., D'Onofrio, B. M., Viken, R., & Rose, R. J. (2013). Models and strategies for factor mixture analysis: An example concerning the structure underlying psychological disorders. Structural Equation Modeling: A Multidisciplinary Journal, 20(4), 681–703.

    Google Scholar 

  • Crawford, M. R., Chirinos, D. A., Iurcotta, T., Edinger, J. D., Wyatt, J. K., Manber, R., & Ong, J. C. (2017). Characterization of patients who present with insomnia: Is there room for a symptom cluster-based approach? Journal of Clinical Sleep Medicine, 13(07), 911–921.

    PubMed  PubMed Central  Google Scholar 

  • Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302.

    PubMed  Google Scholar 

  • Cukrowicz, K. C., Otamendi, A., Pinto, J. V., Bernert, R. A., Krakow, B., & Joiner Jr., T. E. (2006). The impact of insomnia and sleep disturbances on depression and suicidality. Dreaming, 16(1), 1–10.

    Google Scholar 

  • Dell’Osso, L., Massimetti, G., Conversano, C., Bertelloni, C. A., Carta, M. G., Ricca, V., & Carmassi, C. (2014). Alterations in circadian/seasonal rhythms and vegetative functions are related to suicidality in DSM-5 PTSD. BMC Psychiatry, 14(1), 352.

    PubMed  PubMed Central  Google Scholar 

  • Doris, S. (2010). Insomnia severity index: Psychometric properties with Chinese community-dwelling older people. Journal of Advanced Nursing, 66(10), 2350–2359.

    Google Scholar 

  • Fawcett, T. (2006). An introduction to ROC analysis. Pattern Recognition Letters, 27(8), 861–874.

    Google Scholar 

  • Fernandez-Mendoza, J., Rodriguez-Muñoz, A., Vela-Bueno, A., Olavarrieta-Bernardino, S., Calhoun, S. L., Bixler, E. O., & Vgontzas, A. N. (2012). The Spanish version of the insomnia severity index: A confirmatory factor analysis. Sleep Medicine, 13(2), 207–210.

    PubMed  Google Scholar 

  • First, M. B., & Gibbon, M. (2004). The The Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I) and the Structured Clinical Interview forDSM-IV Axis II Disorders (SCID-II). In M. J. Hilsenroth & D. L. Segal (Eds.), Comprehensive handbook of psychological assessment, Vol. 2. Personality assessment (p. 134–143). John Wiley & Sons Inc.

  • First, M., Williams, J., Karg, R., & Spitzer, R. (2015). Structured clinical interview for DMS-5, research version. Arlington: American Psychiatric Association.

    Google Scholar 

  • Foley, K. A., Sarsour, K., Kalsekar, A., & Walsh, J. K. (2010). Subtypes of sleep disturbance: Associations among symptoms, comorbidities, treatment, and medical costs. Behavioral Sleep Medicine, 8(2), 90–104.

    PubMed  Google Scholar 

  • Ford, D. E., & Kamerow, D. B. (1989). Epidemiologic study of sleep disturbances and psychiatric disorders. An opportunity for prevention? Journal of the American Medical Association, 262(11), 1479–1484.

    PubMed  Google Scholar 

  • Hallquist, M. N., & Wright, A. G. (2014). Mixture modeling methods for the assessment of normal and abnormal personality, part I: Cross-sectional models. Journal of Personality Assessment, 96(3), 256–268.

    PubMed  Google Scholar 

  • Harvey, A. G. (2008). Insomnia, psychiatric disorders, and the transdiagnostic perspective. Current Directions in Psychological Science, 17(5), 299–303.

    Google Scholar 

  • Hohagen, F., Rink, K., Käppler, C., Schramm, E., Riemann, D., Weyerer, S., & Berger, M. (1993). Prevalence and treatment of insomnia in general practice. European Archives of Psychiatry and Clinical Neuroscience, 242(6), 329–336.

    PubMed  Google Scholar 

  • Hohagen, F., Käppler, C., Schramm, E., Riemann, D., Weyerer, S., & Berger, M. (1994). Sleep onset insomnia, sleep maintaining insomnia and insomnia with early morning awakening—Temporal stability of subtypes in a longitudinal study on general practice attenders. Sleep, 17(6), 551–554.

    PubMed  Google Scholar 

  • IBM Corp. Released 2016. IBM SPSS Statistics for Windows, Version 24.0. Armonk, NY: IBM Corp.

  • Lo, Y., Mendell, N. R., & Rubin, D. B. (2001). Testing the number of components in a normal mixture. Biometrika, 88(3), 767–778.

    Google Scholar 

  • Lubke, G. H., & Muthén, B. (2005). Investigating population heterogeneity with factor mixture models. Psychological Methods, 10(1), 21–39.

    PubMed  Google Scholar 

  • Lubke, G. H., & Tueller, S. (2010). Latent class detection and class assignment: A comparison of the MAXEIG taxometric procedure and factor mixture modeling approaches. Structural Equation Modeling, 17(4), 605–628.

    PubMed  PubMed Central  Google Scholar 

  • Markon, K. E., Chmielewski, M., & Miller, C. J. (2011). The reliability and validity of discrete and continuous measures of psychopathology: A quantitative review. Psychological Bulletin, 137(5), 856–879.

    PubMed  Google Scholar 

  • McCall, W. V., Blocker, J. N., D’Agostino Jr., R., Kimball, J., Boggs, N., Lasater, B., & Rosenquist, P. B. (2010). Insomnia severity is an indicator of suicidal ideation during a depression clinical trial. Sleep Medicine, 11(9), 822–827.

    PubMed  PubMed Central  Google Scholar 

  • Meehl, P. E. (1995). Bootstraps taxometrics: Solving the classification problem in psychopathology. American Psychologist, 50(4), 266–275.

    Google Scholar 

  • Morin, C. M., Belleville, G., Bélanger, L., & Ivers, H. (2011). The insomnia severity index: Psychometric indicators to detect insomnia cases and evaluate treatment response. Sleep, 34(5), 601–608.

    PubMed  PubMed Central  Google Scholar 

  • Moscou-Jackson, G., Allen, J., Smith, M. T., & Haywood Jr., C. (2016). Psychometric validation of the insomnia severity index in adults with sickle cell disease. Journal of Health Care for the Poor and Underserved, 27(1), 209–218.

    PubMed  PubMed Central  Google Scholar 

  • Muthén, L.K., Muthén, B.O. (1998–2017). Mplus User’s Guide. Eighth Edition. Los Angeles, CA: Muthén & Muthén

  • Neckelmann, D., Mykletun, A., & Dahl, A. A. (2007). Chronic insomnia as a risk factor for developing anxiety and depression. Sleep, 30(7), 873–880.

    PubMed  PubMed Central  Google Scholar 

  • Nylund, K. L., Asparouhov, T., & Muthén, B. O. (2007). Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling, 14(4), 535–569.

    Google Scholar 

  • Oglesby, M. E., Allan, N. P., Short, N. A., Raines, A. M., & Schmidt, N. B. (2017). Factor mixture modeling of intolerance of uncertainty. Psychological Assessment, 29(4), 435–445.

    PubMed  Google Scholar 

  • Petras, H., & Masyn, K. (2010). General growth mixture analysis with antecedents and consequences of change. In Handbook of quantitative criminology (pp. 69–100). Springer, New York, NY.

  • Raftery, A. E. (1995). Bayesian model selection in social research. Sociological Methodology, 25, 111–163.

    Google Scholar 

  • Ramaswamy, V., DeSarbo, W. S., Reibstein, D. J., & Robinson, W. T. (1993). An empirical pooling approach for estimating marketing mix elasticities with PIMS data. Marketing Science, 12(1), 103–124.

    Google Scholar 

  • Rössler, W., AjdacicGross, V., Glozier, N., Rodgers, S., Haker, H., & Müller, M. (2017). Sleep disturbances in young and middle-aged adults-empirical patterns and related factors from an epidemiological survey. Comprehensive Psychiatry, 78, 83–90.

    PubMed  Google Scholar 

  • Ruscio, J., & Ruscio, A. M. (2004). A conceptual and methodological checklist for conducting a taxometric investigation. Behavior Therapy, 35(2), 403–447.

    Google Scholar 

  • Sadeghniiat-Haghighi, K., Montazeri, A., Khajeh-Mehrizi, A., Nedjat, S., & Aminian, O. (2014). The insomnia severity index: Cross-cultural adaptation and psychometric evaluation of a Persian version. Quality of Life Research, 23(2), 533–537.

    PubMed  Google Scholar 

  • Savard, M. H., Savard, J., Simard, S., & Ivers, H. (2005). Empirical validation of the insomnia severity index in cancer patients. Psycho-Oncology: Journal of the Psychological, Social and Behavioral Dimensions of Cancer, 14(6), 429–441.

    Google Scholar 

  • Schmidt, N. B., Capron, D. W., Raines, A. M., & Allan, N. P. (2014). Randomized clinical trial evaluating the efficacy of a brief intervention targeting anxiety sensitivity cognitive concerns. Journal of Consulting and Clinical Psychology, 82(6), 1023.

  • Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., & King, J. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. The Journal of Educational Research, 99(6), 323–338.

    Google Scholar 

  • Scott, B. G., Lemery-Chalfant, K., Clifford, S., Tein, J. Y., Stoll, R., & Goldsmith, H. H. (2016). A twin factor mixture modeling approach to childhood temperament: Differential heritability. Child Development, 87(6), 1940–1955.

    PubMed  PubMed Central  Google Scholar 

  • Short, N. A., Raines, A. M., Oglesby, M. E., Zvolensky, M. J., & Schmidt, N. B. (2014). Insomnia and emotion dysregulation: Independent and interactive associations with posttraumatic stress symptoms among trauma-exposed smokers. Journal of Affective Disorders, 165, 159–165. https://doi.org/10.1016/j.jad.2014.04.069.

    Article  PubMed  PubMed Central  Google Scholar 

  • Sun, Q., & Tan, L. (2019). Comparing primary insomnia to the insomnia occurring in major depression and general anxiety disorder. Psychiatry Research, 282, 112514.

    PubMed  Google Scholar 

  • Taylor, S., Zvolensky, M. J., Cox, B. J., Deacon, B., Heimberg, R. G., Ledley, D. R., et al. (2007). Robust dimensions of anxiety sensitivity: Development and initial validation of the anxiety sensitivity Index-3. Psychological Assessment, 19(2), 176–188.

    PubMed  Google Scholar 

  • Van Loo, H. M., Romeijn, J.-W., de Jonge, P., & Schoevers, R. A. (2013). Psychiatric comorbidity and causal disease models. Preventive Medicine, 57(6), 748–752.

    PubMed  Google Scholar 

  • Van Orden, K. A., Cukrowicz, K. C., Witte, T. K., & Joiner Jr., T. E. (2012). Thwarted belongingness and perceived burdensomeness: Construct validity and psychometric properties of the interpersonal needs questionnaire. Psychological Assessment, 24(1), 197–215.

    PubMed  Google Scholar 

  • Wadsworth, M. E., Hudziak, J. J., Heath, A. C., & Achenbach, T. M. (2001). Latent class analysis of child behavior checklist anxiety/depression in children and adolescents. Journal of the American Academy of Child and Adolescent Psychiatry, 40(1), 106–114.

    PubMed  Google Scholar 

  • Weathers, F. W., Huska, J. A., & Keane, T. M. (1991). PCL-C for DSM-IV. Boston: National Center for PTSD-Behavioral Science Division.

    Google Scholar 

  • Wright, K. M., Britt, T. W., Bliese, P. D., Adler, A. B., Picchioni, D., & Moore, D. (2011). Insomnia as predictor versus outcome of PTSD and depression among Iraq combat veterans. Journal of Clinical Psychiatry, 57(12), 1240–1258. https://doi.org/10.1002/jclp.20845.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Psychology, Florida State University, 1107 W. Call St., Tallahassee, FL, 32306-4301, USA

    Nicole A. Short, Thomas J. Preston, Thomas E. Joiner & Norman B. Schmidt

  2. Department of Psychology, Ohio University, Athens, OH, USA

    Nicholas P. Allan & Kevin Saulnier

Authors
  1. Nicole A. Short
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nicholas P. Allan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kevin Saulnier
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Thomas J. Preston
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Thomas E. Joiner
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Norman B. Schmidt
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Norman B. Schmidt.

Ethics declarations

Conflict of Interest

Nicole A. Short, Nicholas P. Allan, Kevin Saulnier, Thomas J. Preston, Thomas E. Joiner and Norman B. Schmidt declare that they have no conflicts of interest to disclose.

Experiment Participants

All study procedures were approved by the Florida State University Institutional Review Board, and all participants provided written informed consent.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Short, N.A., Allan, N.P., Saulnier, K. et al. Factor Mixture Modeling of the Insomnia Severity Index among Psychology Clinic Outpatients. J Psychopathol Behav Assess 43, 227–239 (2021). https://doi.org/10.1007/s10862-020-09816-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10862-020-09816-5

Keywords

Search

Navigation