Journal of Abnormal Child Psychology

, Volume 42, Issue 4, pp 649–658

Youth-caregiver Agreement on Clinical High-risk Symptoms of Psychosis

  • Shana Golembo-Smith
  • Peter Bachman
  • Damla Senturk
  • Tyrone D. Cannon
  • Carrie E. Bearden


Early identification of individuals who will go on to develop schizophrenia is a difficult endeavor. The variety of symptoms experienced by clinical high-risk youth make it difficult to identify who will eventually develop schizophrenia in the future. Efforts are being made, therefore, to more accurately identify at-risk individuals and factors that predict conversion to psychosis. As in most assessments of children and adolescents, however, both youth and parental report of symptomatology and resulting dysfunction are important to assess. The goals of the current study were to assess the extent of cross-informant agreement on the Structured Interview for Prodromal Symptoms (SIPS), a widely-used tool employed to determine clinical high-risk status. A total of 84 youth-caregiver pairs participated. Youth and caregiver raters displayed moderate overall agreement on SIPS-rated symptoms. Both youth and caregiver ratings of youth symptomatology contributed significantly to predicting conversion to psychosis. In addition, youth age and quality of youth-caregiver relationships appear to be related to cross-informant symptom ratings. Despite differences on individual SIPS domains, the majority of dyads agreed on youth clinical high-risk status. Results highlight the potential clinical utility of using caregiver informants to determine youth psychosis risk.


CHR Clinical high risk Assessment Psychosis Adolescents Cross-informant agreement 


  1. Achenbach, T. M. (2005). Advancing assessment of children and adolescents: Commentary on evidence-based assessment of child and adolescent disorders. Journal of Clinical Child and Adolescent Psychology, 34, 541–547.CrossRefPubMedGoogle Scholar
  2. Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213–232.CrossRefPubMedGoogle Scholar
  3. Addington, J., Cadenhead, K. S., Cannon, T. D., Cornblatt, B., McGlashan, T. H., Perkins, D. O., & Heinssen, R. (2007). North American prodrome longitudinal study: a Collaborative multisite approach to prodromal schizophrenia research. Schizophrenia Bulletin, 33, 665–672.CrossRefPubMedCentralPubMedGoogle Scholar
  4. Berg–Nielsen, T. S., Vika, A., & Dahl, A. A. (2003). When adolescents disagree with their mothers: CBCL–YSR discrepancies related to maternal depression and adolescent self–esteem. Child: Care, Health and Development, 29(3), 207–213.Google Scholar
  5. Bird, H., Gould, M., & Staghezza, B. (1992). Aggregating data from multiple informants in child psychiatry epidemiological research. Journal of the American Academy of Child and Adolescent Psychiatry, 31, 78–85.CrossRefPubMedGoogle Scholar
  6. Cannon, T. D., Cadenhead, K., Cornblatt, B., Woods, S. W., Addington, J., Walker, E., & Seidman, L. J. (2008). Prediction of psychosis in youth at high clinical risk: a Multisite longitudinal study in North America. Archives of General Psychiatry, 65, 28–37.CrossRefPubMedCentralPubMedGoogle Scholar
  7. Carpenter, W. T., Sacks, M. H., Strauss, J. S., Bartko, J. J., & Rayner, J. (1976). Evaluating signs and symptoms: Comparison of structured interview and clinical approaches. The British Journal of Psychiatry, 128, 397–403.CrossRefPubMedGoogle Scholar
  8. Chambless, D. L., & Blake, K. D. (2009). Construct validity of the perceived criticism measure. Behavior Therapy, 40, 155–163.CrossRefPubMedGoogle Scholar
  9. Chambless, D. L., & Steketee, G. (1999). Expressed emotion and behavior therapy outcome: a Prospective study with obsessive–compulsive and agoraphobic outpatients. Journal of Consulting and Clinical Psychology, 67, 658.CrossRefPubMedGoogle Scholar
  10. Choudhury, M. S., Pimentel, S. S., & Kendall, P. C. (2003). Childhood anxiety disorders: Parent–Child (dis) agreement using a structured interview for the DSM-IV. Journal of the American Academy of Child & Adolescent Psychiatry, 42, 957–964.CrossRefGoogle Scholar
  11. Christensen, A., & Margolin, G. (1988). Conflict and alliance in distressed and nondistressed families. In R. A. Hinde & J. Stevenson-Hinde (Eds.), Relationships within families: Mutual influences (pp. 263–282). Oxford: Clarendon.Google Scholar
  12. Christensen, A., Margolin, G., & Sullaway, M. (1992). Interparental agreement on child behavior problems. Psychological Assessment, 4, 419–425.CrossRefGoogle Scholar
  13. Compton, M. T. (2004). Considering schizophrenia from a prevention perspective. American Journal of Preventive Medicine, 26, 178–185.CrossRefPubMedGoogle Scholar
  14. De Los Reyes, A., & Kazdin, A. (2005). Informant discrepancies in the assessment of childhood psychopathology: a Critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131, 483–509.CrossRefPubMedGoogle Scholar
  15. Edelbrock, C., Costello, A. J., Dulcan, M. K., Kalas, R., & Conover, N. C. (1985). Age differences in the reliability of the psychiatric interview of the child. Child Development, 56, 265–275.CrossRefPubMedGoogle Scholar
  16. Falloon, I. R. H. (2000). General practice recruitment for people at risk for schizophrenia: the Buckingham experience. Australian and New Zealand Journal of Psychiatry, 34, S131–S136.CrossRefPubMedGoogle Scholar
  17. First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (2002). Structured Clinical Interview for DSM-IV-TR Axis I Disorders, Research Version, Patient Edition. (SCID-I/P). New York: Biometrics Research, New York State Psychiatric Institute.Google Scholar
  18. Fusar-Poli, P., Bonoldi, I., Yung, A. R., Borgwardt, S., Kempton, M. J., Valmaggia, L., et al. (2012). Predicting psychosis: Meta-analysis of transition outcomes in individuals at high clinical risk. Archives of General Psychiatry, 69, 220–229.CrossRefPubMedGoogle Scholar
  19. Grills, A. E., & Ollendick, T. H. (2003). Multiple informant agreement and the anxiety disorders interview schedule for parents and children. Journal of the American Academy of Child and Adolescent Psychiatry, 42, 30–40.CrossRefPubMedGoogle Scholar
  20. Handwerk, M., Larzelere, R., Soper, S., & Friman, P. (1999). Parent and child discrepancies in reporting severity of problem behaviors in three out-of-home settings. Psychological Assessment, 11, 14–23.CrossRefGoogle Scholar
  21. Ho, B. C., Flaum, M., Hubbard, W., Arndt, S., & Andreasen, C. N. (2004). Validity of symptom assessment in psychotic disorders: Information variance across different sources of history. Schizophrenia Research, 68, 299–307.CrossRefPubMedGoogle Scholar
  22. Hooley, J. M., & Teasdale, J. D. (1989). Predictors of relapse in unipolar depressives: Expressed emotion, marital distress, and perceived criticism. Journal of Abnormal Psychology, 98, 229–235.CrossRefPubMedGoogle Scholar
  23. Jackson, H. J., McGorry, P. D., & McKenzie, D. (1994). The reliability of DSM–III prodromal symptoms in first–episode psychotic patients. Acta Psychiatrica Scandinavica, 90, 375–378.CrossRefPubMedGoogle Scholar
  24. Jensen, P. S., Xenakis, S. N., Davis, H., & DeGroot, J. (1988). Child psychopathology rating scales and interrater agreement: II. Child and family characteristics. Journal of the American Academy of Child & Adolescent Psychiatry, 27, 451–461.CrossRefGoogle Scholar
  25. Joa, I., Johannessen, J. O., Auestad, B., Friis, S., McGlashan, T., Melle, I., et al. (2008). The key to reducing duration of untreated first psychosis: Information campaigns. Schizophrenia Bulletin, 34, 466–472.CrossRefPubMedCentralPubMedGoogle Scholar
  26. Kazdin, A. E., French, N. H., & Unis, A. S. (1983). Child, mother, and father evaluations of depression in psychiatric inpatient children. Journal of Abnormal Child Psychology, 11, 167–179.CrossRefPubMedGoogle Scholar
  27. Keshavan, M. S., Eack, S. M., Montrose, D. M., Abela, M. M., Bangalore, S. S., Diwadkar, V. A., & Prasad, K. M. (2009). Do premorbid impairments predict emergent ‘prodromal’ symptoms in young relatives at risk for schizophrenia? Early Intervention in Psychiatry, 3, 213–220.CrossRefPubMedGoogle Scholar
  28. Kolko, D. J., & Kazdin, A. E. (1993). Emotional/behavioral problems in clinic and nonclinic children: Correspondence among child, parent and teacher reports. Journal of Child Psychology and Psychiatry, 34, 991–1006.CrossRefPubMedGoogle Scholar
  29. Lee, H., & Schepp, K. G. (2011). Multiple informants in assessing stress and symptoms in adolescents with schizophrenia. Archives of Psychiatric Nursing, 25, 120–128.CrossRefPubMedCentralPubMedGoogle Scholar
  30. Martin Bland, J., & Altman, D. (1986). Statistical methods for assessing agreement between two methods of clinical measurement. Lancet, 327, 307–310.CrossRefGoogle Scholar
  31. Martin, J. L., Ford, C. B., Dyer-Friedman, J., Tang, J., & Huffman, L. C. (2004). Patterns of agreement between parent and child ratings of emotional and behavioral problems in an outpatient clinical setting: When children endorse more problems. Journal of Developmental & Behavioral Pediatrics, 25, 150–155.CrossRefGoogle Scholar
  32. McGlashan, T. H., Miller, T. J., Woods, S. W., Rosen, J. L., Hoffman, R. E., & Davidson, L. (2003). Structured Interview for Prodromal Syndromes (SIPS). Version 4.0. New Haven: Yale University.Google Scholar
  33. McGlashan, T., Walsh, B., & Woods, S. (2010). The psychosis-risk syndrome. Handbook for diagnosis and follow-up. New York: Oxford University Press.Google Scholar
  34. McGorry, P. D., & Edwards, J. (1998). The feasibility and effectiveness of early intervention in psychotic disorders: the Australian experience. International Clinical Psychopharmacology, 13, S47–S52.CrossRefGoogle Scholar
  35. McGorry, P. D., Nelson, B., Phillips, L. J., Yuen, H. P., Francey, S. M., Thampi, A., et al. (2012). Randomized controlled trial of interventions for young people at ultra-high risk of psychosis: Twelve-month outcome. The Journal of Clinical Psychiatry, 74, 349–356.CrossRefPubMedGoogle Scholar
  36. Meyer, S. E., Bearden, C. E., Lux, S. R., Gordon, J. L., Johnson, J. K., O’Brien, M. P., Niendham, T. A., Loewy, R. L., Ventura, J., & Cannon, T. D. (2005). The psychosis CHR in adolescent patients viewed through the lens of DSM-IV. Journal of Child and Adolescent Psychopharmacology, 15, 434–451.CrossRefPubMedGoogle Scholar
  37. Myers, R. H. (1990). Classical and modern regression with applications (Vol. 2). Belmont: Duxbury Press.Google Scholar
  38. Neumann, C. S., Grimes, K., Walker, E. F., & Baum, K. (1995). Developmental pathways to schizophrenia: Behavioral subtypes. Journal of Abnormal Psychology, 104, 558–566.CrossRefPubMedGoogle Scholar
  39. Niendam, T. A., Bearden, C. E., Zinberg, J., Johnson, J. K., O'Brien, M., & Cannon, T. D. (2007). The course of neurocognition and social functioning in individuals at ultra high risk for psychosis. Schizophrenia Bulletin, 33, 772–781.CrossRefPubMedCentralPubMedGoogle Scholar
  40. Nugent, K. L., Kline, E., Thompson, E., Reeves, G., & Schiffman, J. (2013). Assessing psychotic–like symptoms using the BASC–2: Adolescent, parent and teacher agreement. Early intervention in psychiatry.Google Scholar
  41. O'Brien, M. P., Gordon, J. L., Bearden, C. E., Lopez, S. R., Kopelowicz, A., & Cannon, T. D. (2006). Positive family environment predicts improvement in symptoms and social functioning among adolescents at imminent risk for onset of psychosis. Schizophrenia Research, 81, 269–275.CrossRefPubMedGoogle Scholar
  42. O'Brien, M. P., Zinberg, J. L., Ho, L., Rudd, A., Kopelowicz, A., Daley, M., et al. (2009). Family problem solving interactions and 6-month symptomatic and functional outcomes in youth at ultra-high risk for psychosis and with recent onset psychotic symptoms: a Longitudinal study. Schizophrenia Research, 107, 198–205.CrossRefPubMedCentralPubMedGoogle Scholar
  43. Penney, S. R., & Skilling, T. A. (2012). Moderators of informant agreement in the assessment of adolescent psychopathology: Extension to a forensic sample. Psychological Assessment, 24, 386–401.CrossRefPubMedGoogle Scholar
  44. Perkins, D. O., Hongbin, G., Boteva, K., & Lieberman, J. A. (2005). Relationship Between Duration of untreated psychosis and outcome in first-episode schizophrenia: a Critical review and meta-analysis. American Journal of Psychiatry, 162, 1785–1804.CrossRefPubMedGoogle Scholar
  45. Rapee, R. M., Barrett, P. M., Dadds, M. R., & Evans, L. (1994). Reliability of the DSM-III-R childhood anxiety disorders using structured interview: Interrater and parent–child agreement. Journal of the American Academy of Child & Adolescent Psychiatry, 33, 984–992.CrossRefGoogle Scholar
  46. Rey, J. M., Schrader, E., & Morris-Yates, A. (1992). Parent–child agreement on children's behaviours reported by the Child Behaviour Checklist (CBCL). Journal of Adolescence, 15, 219–230.CrossRefPubMedGoogle Scholar
  47. Ruhrmann, S., Schultze-Lutter, F., & Klosterkötter, J. (2003). Early detection and intervention in the initial prodromal phase of schizophrenia. Pharmacopsychiatry, 36, S162–S167.CrossRefPubMedGoogle Scholar
  48. Ruhrmann, S., Schultze-Lutter, F., Salokangas, R. K., Heinimaa, M., Linszen, D., Dingemans, P., Birchwood, M., Patterson, P., Juckel, G., Heinz, A., Morrison, A., Lewis, S., von Reventlow, H. G., & Klosterkӧtter, J. (2010). Prediction of psychosis in adolescents and young adults at high risk: Results from the prospective European Prediction of Psychosis study. Archives of General Psychiatry, 67, 241–251.CrossRefPubMedGoogle Scholar
  49. Safford, S. M., Kendall, P. C., Flannery-Schroeder, E., Webb, A., & Sommer, H. (2005). A Longitudinal look at parent–child diagnostic agreement in youth treated for anxiety disorders. Journal of Clinical Child & Adolescent Psychology, 34, 747–757.CrossRefGoogle Scholar
  50. Salbach-Andrae, H., Lenz, K., & Lehmkuhl, U. (2009). Patterns of agreement among parent, teacher and youth ratings in a referred sample. European Psychiatry, 24, 345–351.CrossRefPubMedGoogle Scholar
  51. Schlosser, D. A., Zinberg, J. L., Loewy, R. L., Casey-Cannon, S., O’Brien, M. P., Bearden, C. E., et al. (2010). Predicting the longitudinal effects of the family environment on prodromal symptoms and functioning in patients at-risk for psychosis. Schizophrenia Research, 118, 69–75.CrossRefPubMedCentralPubMedGoogle Scholar
  52. Smith, S. R. (2007). Making sense of multiple informants in child and adolescent psychopathology: a Guide for clinicians. Journal of Psychoeducational Assessment, 25, 139–149.CrossRefGoogle Scholar
  53. Sourander, A., Helstelӓ, L., & Helenius, H. (1999). Parent-adolescent agreement on emotional and behavioral problems. Social Psychiatry and Psychiatric Epidemiology, 34, 657–663.CrossRefPubMedGoogle Scholar
  54. Tsuang, M. T., Stone, W. S., & Faraone, S. V. (1999). Schizophrenia: a Review of genetic studies. Harvard Review of Psychiatry, 7, 185–207.CrossRefPubMedGoogle Scholar
  55. Wyatt, R. J., & Henter, I. (2001). Rationale for the study of early intervention. Schizophrenia Research, 51, 69–76.CrossRefPubMedGoogle Scholar
  56. Youngstrom, E., Izard, C., & Ackerman, B. (1999). Dysphoria-related bias in maternal ratings of children. Journal of Consulting and Clinical Psychology, 67, 905–916.CrossRefPubMedGoogle Scholar
  57. Youngstrom, E. A., Findling, R. L., & Calabrese, J. R. (2004). Effects of adolescent manic symptoms on agreement between youth, parent, and teacher ratings of behavior problems. Journal of Affective Disorders, 82, S5–S16.CrossRefPubMedGoogle Scholar
  58. Yung, A. R., McGorry, P. D., McFarlane, C. A., Jackson, H. J., Patton, G. C., & Rakkar, A. (1996). Monitoring and care of young people at incipient risk of psychosis. Schizophrenia Bulletin, 22, 283–303.CrossRefPubMedGoogle Scholar
  59. Yung, A. R., Nelson, B., Stanford, C., Simmons, M. B., Cosgrave, E. M., Killackey, E., et al. (2008). Validation of “prodromal” criteria to detect individuals at ultra high risk of psychosis: 2 year follow-up. Schizophrenia Research, 105, 10–17.CrossRefPubMedGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • Shana Golembo-Smith
    • 1
  • Peter Bachman
    • 2
  • Damla Senturk
    • 3
  • Tyrone D. Cannon
    • 1
    • 2
    • 4
  • Carrie E. Bearden
    • 1
    • 2
  1. 1.Department of PsychologyUniversity of California – Los AngelesLos AngelesUSA
  2. 2.Department of Psychiatry and Biobehavioral SciencesUniversity of California – Los AngelesLos AngelesUSA
  3. 3.Department of BiostatisticsUniversity of California – Los AngelesLos AngelesUSA
  4. 4.Department of PsychologyYale UniversityNew HavenUSA

Personalised recommendations