Comparing the CASI-4R and the PGBI-10 M for Differentiating Bipolar Spectrum Disorders from Other Outpatient Diagnoses in Youth
- 368 Downloads
We compared 2 rating scales with different manic symptom items on diagnostic accuracy for detecting pediatric bipolar spectrum disorder (BPSDs) in outpatient mental health clinics. Participants were 681 parents/guardians of eligible children (465 male, mean age = 9.34) who completed the Parent General Behavior Inventory-10-item Mania (PGBI-10 M) and mania subscale of the Child and Adolescent Symptom Inventory-Revised (CASI-4R). Diagnoses were based on KSADS interviews with parent and youth. Receiver operating characteristic (ROC) analyses and diagnostic likelihood ratios (DLRs) determined discriminative validity and provided clinical utility, respectively. Logistic regressions tested for incremental validity in the CASI-4R mania subscale and PGBI-10 M in predicting youth BPSD status above and beyond demographic and common diagnostic comorbidities. Both CASI-4R and PGBI-10 M scales significantly distinguished BPSD (N = 160) from other disorders (CASI-4R: Area under curve (AUC) = .80, p < 0.0005; PGBI-10 M: AUC = 0.79, p < 0.0005) even though scale items differed. Both scales performed equally well in differentiating BPSDs (Venkatraman test p > 0.05). Diagnostic likelihood ratios indicated low scores on either scale (CASI: 0–5; PGBI-10 M: 0–6) cut BPSD odds to 1/5 of those with high scores (CASI DLR- = 0.17; PGBI-10 M DLR- = 0.18). High scores on either scale (CASI: 14+; PGBI-10 M: 20+) increased BPSD odds about fourfold (CASI DLR+ = 4.53; PGBI-10 M DLR+ = 3.97). Logistic regressions indicated the CASI-4R mania subscale and PGBI-10 M each provided incremental validity in predicting youth BPSD status. The CASI-4R is at least as valid as the PGBI-10 M to help identify BPSDs, and can be considered as part of an assessment battery to screen for pediatric BPSDs.
KeywordsBipolar disorder Adolescents Assessment Receiver operating characteristic, diagnostic likelihood ratio CASI PGBI-10 M
Compliance with Ethical Standards
This study was funded in part by National Institutes of Health (grant number NIH R01 MH073967; PI: R.L. Findling).
Conflict of Interest
Mian-Li Ong declares that he has no conflict of interest. Eric Youngstrom has consulted with Pearson, Western Psychological Services, Johnson & Johnson, Lundbeck and Otsuka about psychological assessment. Jesselyn Jia-Xin Chua declares that she has no conflict of interest. Tate Halverson declares that she has no conflict of interest. Sarah Horwitz declares that she has no conflict of interest. Amy Storfer-Isser declares that she has no conflict of interest. Thomas Frazier has received federal funding or research support from, acted as a consultant to, received travel support from, and/or received a speaker’s honorarium from the Cole Family Research Fund, Simons Foundation, Ingalls Foundation, Forest Laboratories, Ecoeos, IntegraGen, Kugona LLC, Shire Development, Bristol-Myers Squibb, National Institutes of Health, and the Brain and Behavior Research Foundation. Mary Fristad receives royalties from American Psychiatric Press, CFPSI and Guilford Press and honoraria from American Occupational Therapy Association and Physicians’ Post-Graduate Press. Eugene Arnold has received research funding from Curemark, Forest, Lilly, Neuropharm, Novartis, Noven, Shire, and YoungLiving (as well as NIH and Autism Speaks) and has consulted with or been on advisory boards for Arbor, Gowlings, Neuropharm, Novartis, Noven, Organon, Otsuka, Pfizer, Roche, Seaside Therapeutics, Sigma Tau, Shire, Tris Pharma, and Waypoint and received travel support from Noven. Mary Phillips is a consultant for Roche Pharmaceuticals. Robert Kowatch declares that he has no conflict of interest. Robert Findling receives or has received research support, acted as a consultant and/or served on a speaker’s bureau for Alcobra, American Academy of Child & Adolescent Psychiatry, American Physician Institute, American Psychiatric Press, AstraZeneca, Bracket, Bristol-Myers Squibb, CogCubed, Cognition Group, Coronado Biosciences, Dana Foundation, Elsevier, Forest, GlaxoSmithKline, Guilford Press, Johns Hopkins University Press, Johnson and Johnson, Jubilant Clinsys, KemPharm, Lilly, Lundbeck, Merck, NIH, Neurim, Novartis, Noven, Otsuka, Oxford University Press, Pfizer, Physicians Postgraduate Press, Purdue, Rhodes Pharmaceuticals, Roche, Sage, Shire, Sunovion, Supernus Pharmaceuticals, Transcept Pharmaceuticals, Validus, and WebMD.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants included in the study.
- Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA School-Age Forms & Profiles. Burlington, VT: University of Vermont.Google Scholar
- American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). doi: 10.1176/appi.books.9780890423349.
- Conners, C. K. (1997). Conners’ Rating Scales - Revised: Short Form. North Tonawanda, NY: Multi-Heath Systems.Google Scholar
- Depue, R. A., Slater, J. F., Wolfstetter-Kausch, H., Klein, D., Goplerud, E., & Farr, D. (1981). A behavioral paradigm for identifying persons at risk for bipolar depressive disorder: a conceptual framework and five validation studies. Journal of Abnormal Psychology, 90, 381–437. doi: 10.1037//0021-843X.90.5.381.CrossRefPubMedGoogle Scholar
- Diler, R. S., Birmaher, B., Axelson, D., Goldstein, B., Gill, M., Strober, M., et al. (2009). The child behavior checklist (CBCL) and the CBCL-bipolar phenotype are not useful in diagnosing pediatric bipolar disorder. Journal of Child and Adolescent Psychopharmacology, 19, 23–30. doi: 10.1089/cap.2008.067.CrossRefPubMedPubMedCentralGoogle Scholar
- Findling, R. L., Youngstrom, E. A., Fristad, M. A., Birmaher, B., Kowatch, R. A., Arnold, L. E., et al. (2010). Characteristics of children with elevated symptoms of mania: the longitudinal assessment of manic symptoms (LAMS) study. Journal of Clinical Psychiatry, 71(12), 1664–1672. doi: 10.4088/JCP.09m05859yel.CrossRefPubMedPubMedCentralGoogle Scholar
- Gadow, K. D., & Sprafkin, J. (2005). Child and adolescent symptom inventory-4R. Stony Brook, NY: Checkmate Plus.Google Scholar
- Gadow, K. D., & Sprafkin, J. (2008). Adolescent symptom inventory-4 screening and norms manual. Stony Brook, NY: Checkmate Plus.Google Scholar
- Geller, B., Zimerman, B., Williams, M., Bolhofner, K., Craney, J. L., DelBello, M. P., & Soutullo, C. (2001). Reliability of the Washington University in St. Louis kiddie schedule for affective disorders and schizophrenia (WASH-U-KSADS) mania and rapid cycling sections. Journal of the American Academy of Child and Adolescent Psychiatry, 40(4), 450–455. doi: 10.1097/00004583-200104000-00014.CrossRefPubMedGoogle Scholar
- Geller, B., Zimerman, B., Williams, M., Delbello, M. P., Bolhofner, K., Craney, J. L., et al. (2002). DSM-IV mania symptoms in a prepubertal and early adolescent bipolar disorder phenotype compared to attention-deficit hyperactive and normal controls. Journal of Child and Adolescent Psychopharmacology, 12, 11–25.CrossRefPubMedGoogle Scholar
- Goldstein, T. R., Ha, W., Axelson, D. A., Goldstein, B. I., Liao, F., Gill, M. K., et al. (2012). Predictors of prospectively examined suicide attempts among youth with bipolar disorder. Archives of General Psychiatry, 69(11), 1113–1122. doi: 10.1001/archgenpsychiatry.2012.650.CrossRefPubMedPubMedCentralGoogle Scholar
- Goodwin, F. K., & Jamison, K. R. (2007). Manic-depressive illness: Bipolar disorders and recurrent depression. New York, NY: Oxford University Press.Google Scholar
- Guyatt, G. H., & Rennie, D. (2002). Users’ guides to the medical literature. Chicago, IL: AMA Press.Google Scholar
- Hauser, M., Galling, B., & Correll, C. U. (2013). Suicidal ideation and suicide attempts in children and adolescents with bipolar disorder: a systematic review of prevalence and incidence rates, correlates, and targeted interventions. Bipolar Disorders, 15, 507–523. doi: 10.1111/bdi.12094.CrossRefPubMedPubMedCentralGoogle Scholar
- Horwitz, S. M., Demeter, C. A., Pagano, M. E., Youngstrom, E. A., Fristad, M. A., Arnold, L. E., et al. (2010). Longitudinal assessment of manic symptoms (LAMS) study: background, design, and initial screening results. Journal of Clinical Psychiatry, 71(11), 1511–1517. doi: 10.4088/JCP.09m05835yel.CrossRefPubMedPubMedCentralGoogle Scholar
- Jaeschke, R., Guyatt, G. H., & Sackett, D. L. (1994). Users’ guides to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients?. JAMA: The Journal of the American Medical Association, 271(9), 703–707. doi: 10.1001/jama.1994.03510290.CrossRefPubMedGoogle Scholar
- Jensen-Doss, A., Youngstrom, E. A., Youngstrom, J. K., Feeny, N. C., & Findling, R. L. (2014). Predictors and moderators of agreement between clinical and research diagnoses for children and adolescents. Journal of Consulting and Clinical Psychology, 82(6), 1151–1162. doi: 10.1037/a0036657.CrossRefPubMedPubMedCentralGoogle Scholar
- Kahana, S. Y., Youngstrom, E. A., Findling, R. L., & Calabrese, J. R. (2003). Employing parent, teacher, and youth self-report checklists in identifying pediatric bipolar spectrum disorders: an examination of diagnostic accuracy and clinical utility. Journal of Child and Adolescent Psychopharmacology, 13, 471–488. doi: 10.1089/104454603322724869.CrossRefPubMedGoogle Scholar
- Kaufman, J., Birmaher, B., Brent, D., Rao, U., Flynn, C., Moreci, P., et al. (1997). Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL): initial reliability and validity data. Journal of the American Academy of Child and Adolescent Psychiatry, 36(7), 980–988. doi: 10.1097/00004583-199707000-00021.CrossRefPubMedGoogle Scholar
- Pacchiarotti, I., Bond, D. J., Baldessarini, R. J., Nolen, W. A., Grunze, H., Licht, R. W., et al. (2013). The International Society for Bipolar Disorders (ISBD) task force report on antidepressant use in bipolar disorders. American Journal of Psychiatry, 170(11), 1249–1262. doi: 10.1176/appi.ajp.2013.13020185.CrossRefPubMedPubMedCentralGoogle Scholar
- R Development Core Team. (2014). A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org .
- Sprafkin, J., Steinberg, E., Gadow, K. D., & Drabick, D. A. (2013). Agreement among categorical, dimensional, and impairment criteria for ADHD and common comorbidities. Journal of Attention Disorders, 1–13. doi: 10.1177/1087054712475083.
- Stewart, A. J., Theodore-Oklota, C., Hadley, W., Brown, L. K., Donenberg, G., DiClemente, R., & Project, S. S. G (2012). Mania symptoms and HIV-risk behavior among adolescents in mental health treatment. Journal of Clinical Child and Adolescent Psychology, 41(6), 803–810. doi: 10.1080/15374416.2012.675569.CrossRefPubMedPubMedCentralGoogle Scholar
- Straus, S. E., Glasziou, P., Richardson, W. S., & Haynes, R. B. (2011). Evidence-based medicine: How to practice and teach evidence-based medicine. Edinburgh: Elsevier.Google Scholar
- Van Meter, A., You, D.S., Halverson, T., Youngstrom, E.A., Birmaher, B., Fristad, M.A., Kowatch, R.A., Horwitz, S.M., Frazier, T.W., Arnold, L.E., Findling, R.L., the LAMS Group (2016). Diagnostic efficiency of caregiver report on the SCARED for identifying youth anxiety disorders in outpatient settings. Journal of Clinical Child and Adolescent Psychology (in press).Google Scholar
- Weintraub, M., Youngstrom, E. A., Marvin, S. E., Podell, J. L., Walshaw, P. D., Kim, E. Y., et al. (2014). Diagnostic profiles and clinical characteristics of youth referred to a pediatric mood disorders clinic. Journal of Psychiatric Practice, 20(2), 154–162. doi: 10.1097/01.pra.0000445251.20875.47.CrossRefPubMedPubMedCentralGoogle Scholar
- Youngstrom, E. A., Findling, R. L., Danielson, C. K., & Calabrese, J. R. (2001). Discriminative validity of parent report of hypomanic and depressive symptoms on the General Behavior Inventory. Psychological Assessment, 13(2), 267–276. doi: 10.1037/1040-35188.8.131.527 .http://psycnet.apa.org/ CrossRefPubMedGoogle Scholar
- Youngstrom, E. A., Findling, R. L., Calabrese, J. R., Gracious, B. L., Demeter, C., Bedoya, D. D., & Price, M. (2004). Comparing the diagnostic accuracy of six potential screening instruments for bipolar disorder in youths aged 5 to 17 years. Journal of the American Academy of Child and Adolescent Psychiatry, 43(7), 847–858. doi: 10.1097/01.chi.0000125091.35109.1e.CrossRefPubMedGoogle Scholar
- Youngstrom, E. A., Meyers, O., Demeter, C., Youngstrom, J. K., Morello, L., Piiparinen, R., et al. (2005). Comparing diagnostic checklists for pediatric bipolar disorder in academic and community mental health settings. Bipolar Disorders, 7, 507–517. doi: 10.1111/j.1399-5618.2005.00269.x.CrossRefPubMedGoogle Scholar
- Youngstrom, E. A., Meyers, O., Youngstrom, J. K., Calabrese, J. R., & Findling, R. L. (2006). Comparing the effects of sampling designs on the diagnostic accuracy of eight promising screening algorithms for pediatric bipolar disorder. Biological Psychiatry, 60(9), 1013–1019. doi: 10.1016/j.biopsych.2006.06.023.CrossRefPubMedGoogle Scholar
- Youngstrom, E. A., Frazier, T. W., Demeter, C., Calabrese, J. R., & Findling, R. L. (2008a). Developing a 10-item mania scale from the parent general behavior inventory for children and adolescents. Journal of Clinical Psychiatry, 69(5), 831–839. doi: 10.4088/JCP.v69n0517.CrossRefPubMedPubMedCentralGoogle Scholar
- Youngstrom, E. A., Jenkins, M. M., Jensen-Doss, A., & Youngstrom, J. K. (2012). Evidence-based assessment strategies for pediatric bipolar disorder. Israel Journal of Psychiatry & Related Sciences, 49, 15–27.Google Scholar
- Youngstrom, E. A., Genzlinger, J., Egerton, G., & Van Meter, A. R. (2015). Multivariate meta-analysis of the discriminative validity of caregiver, youth and teacher rating scales for pediatric bipolar disorder: mother knows best about mania. Archives of Scientific Psychology, 3(1), 112–137. doi: 10.1037/arc0000024.CrossRefGoogle Scholar