Skip to main content

Advertisement

SpringerLink
Log in

The Symptoms and Functioning Severity Scale (SFSS): Psychometric Evaluation and Discrepancies Among Youth, Caregiver, and Clinician Ratings Over Time

  • Original Paper
  • Published:
Administration and Policy in Mental Health and Mental Health Services Research Aims and scope Submit manuscript

Abstract

This paper describes the development and psychometric evaluation of the symptoms and functioning severity scale (SFSS), which includes three parallel forms to systematically capture clinician, youth, and caregiver perspectives of youth symptoms on a frequent basis. While there is widespread consensus that different raters of youth psychopathology vary significantly in their assessment, this is the first paper that specifically investigated the discrepancies among clinician, youth, and caregiver ratings throughout the treatment process within a community mental health setting. Results for all three respondent versions indicated the SFSS is a psychometrically sound instrument for use in this population. Significant discrepancies in scores existed at baseline among the three respondents. Longitudinal analyses reveal the youth-clinician and caregiver-clinician score discrepancies decreased significantly over time. Differences by youth gender existed for caregiver-clinician discrepancies. The average youth-caregiver score discrepancy remained consistent throughout treatment. Implications for future research and clinical practice are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Achenbach, T. M. (1991). Integrative guide for the 1991 CBCL/4-18, YSR, and TRF profiles. Burlington: Department of Psychiatry, University of Vermont.

    Google Scholar 

  • Achenbach, T. M. (2006). As others see us: Clinical and research implications of cross-informant correlations for psychopathology. Current Directions in Psychological Science, 15, 94–98.

    Article  Google Scholar 

  • Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101(2), 213–232.

    Article  PubMed  CAS  Google Scholar 

  • Althoff, R. R., Rettew, D. C., Ayer, L. A., & Hudziak, J. J. (2010). Cross-informant agreement of the dysregulation profile of the Child Behavior Checklist. Psychiatry Research, 178, 550–555.

    Article  PubMed  Google Scholar 

  • Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561–573.

    Article  Google Scholar 

  • Barker, E. T., Bornstein, M. H., Putnick, D. L., Hendricks, C., & Suwalsky, J. T. D. (2007). Adolescent-mother agreement about adolescent problem behaviors: Direction and predictors of disagreement. Journal of Youth and Adolescence, 36, 950–962.

    Article  Google Scholar 

  • Berg-Nielsen, T. S., Vika, A., & Dahl, A. A. (2003). When adolescents disagree with their mothers: CBCL-YSR discrepancies related to maternal depression and adolescent self-esteem. Child Care, Health and Development, 29(3), 207–213.

    Article  PubMed  CAS  Google Scholar 

  • Bickman, L., Athay, M. M., Riemer, M., Lambert, E. W., Kelley, S. D., Breda, C., Tempesti, T., Dew-Reeves, S. E., Brannan, A. M., Vides de Andrade, A. R. (eds). (2010). Manual of the Peabody Treatment Progress Battery (Electronic version, 2nd ed.). Nashville: Vanderbilt University. http://peabody.vanderbilt.edu/ptpb.

  • Bickman, L., Kelley, S., Breda, C., Vides de Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on youth mental health outcomes: A randomized cluster design. Psychiatric Services, 62, 1423–1429.

    Article  PubMed  Google Scholar 

  • Bickman, L., Riemer, M., Breda, C., & Kelley, S. D. (2006). CFIT: A system to provide a continuous quality improvement infrastructure through organizational responsiveness, measurement, training, and feedback. Report on Emotional and Behavioral Disorders in Youth, 6(86–87), 93–94.

    Google Scholar 

  • Bickman, L., Riemer, M., Lambert, E. W., Kelley, S. D., Breda, C., Dew, S., et al. (2007). Manual of the Peabody Treatment and Progress Battery (Electronic version). Nashville: Vanderbilt University. http://peabody.vanderbilt.edu/ptpb/.

  • Breda, C. S., & Riemer, M. (2012). Motivation for Youth’s Treatment Scale (MYTS): A new tool for measuring motivation among youths and their caregivers. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0408-x.

  • De Los Reyes, A. (2011). Introduction to the special section: More than measurement error: Discovering the meaning behind informant discrepancies in clinical assessments of children and adolescents. Journal of Clinical Child and Adolescent Psychology, 40, 1–9.

    Article  PubMed  Google Scholar 

  • De Los Reyes, A., Alfano, C. A., & Beidel, D. (2010). The relations among measurements of informant discrepancies within a multisite trial of treatments for childhood social phobia. Journal of Abnormal Child Psychology, 38, 395–404.

    Article  PubMed  Google Scholar 

  • De Los Reyes, A., Alfano, C. A., & Beidel, D. C. (2011a). Are clinicians’ assessments of improvements in children’s functioning global? Journal of Clinical Child and Adolescent Psychology, 40, 281–294.

    Article  PubMed  Google Scholar 

  • De Los Reyes, A., & Kazdin, A. E. (2004). Measuring informant discrepancies in clinical child research. Psychological Assessment, 16, 330–334.

    Article  PubMed  Google Scholar 

  • De Los Reyes, A., Youngstrom, E. A., Pabón, S. C., Youngstrom, J. K., Feeny, N. C., & Findling, R. L. (2011b). Internal consistency and associated characteristics of informant discrepancies in clinic referred youths age 11 to 17 years. Journal of Clinical Child and Adolescent Psychology, 40, 36–53.

    Article  PubMed  Google Scholar 

  • Doucette, A., & Bickman, L. (2001). Child Adolescent Measurement System (CAMS). Nashville: Author.

    Google Scholar 

  • Dowell, K. A., & Ogles, B. M. (2010). The effects of parent participation on child psychotherapy outcome: A meta-analytic review. Journal of Child and Adolescent Psychology, 39(2), 151–162.

    Article  Google Scholar 

  • Ferdinand, R. F., van der Ende, J., & Verhulst, F. C. (2004). Parent-adolescent disagreement regarding psychopathology in adolescents from the general population as a risk factor for adverse outcome. Journal of Abnormal Psychology, 113(2), 198–206.

    Article  PubMed  Google Scholar 

  • Ferdinand, R. F., van der Ende, J., & Verhulst, F. C. (2006a). Prognostic value of parent-adolescent disagreement in a referred sample. European Child and Adolescent Psychiatry, 15, 156–162.

    Article  PubMed  Google Scholar 

  • Ferdinand, R. F., van der Ende, J., & Verhulst, F. C. (2006b). Parent-teacher disagreement regarding psychopathology in children: a risk factor for adverse outcome? Acta Psychiatrica Scandinavica, 115, 48–55.

    Article  Google Scholar 

  • Goodman, R. (1999). The extended version of the strengths and difficulties questionnaire as a guide to child psychiatric caseness and consequent burden. The Journal of Child Psychology and Psychiatry and Allied Disciplines, 40(5), 791–799.

    Article  CAS  Google Scholar 

  • Gross, D., Fogg, L., Garvey, C., & Julion, W. (2004). Behavior problems in young children: An analysis of cross-informant agreements and disagreements. Research in Nursing and Health, 27, 413–425.

    Article  PubMed  Google Scholar 

  • Guion, K., Mrug, S., & Windle, M. (2009). Predictive value of informant discrepancies in reports of parenting: Relations to early adolescents’ adjustment. Journal of Abnormal Child Psychology, 37, 17–30.

    Article  PubMed  Google Scholar 

  • Handwerk, M. L., Larzelere, R. E., Soper, S. H., & Friman, P. C. (1999). Parent and child discrepancies in reporting severity of problem behaviors in three out-of-home settings. Psychological Assessment, 11, 14–23.

    Article  Google Scholar 

  • Israel, P., Thomsen, P. H., Langeveld, J. H., & Stormark, K. M. (2007). Parent-youth discrepancy in the assessment and treatment of youth in usual clinical care setting: Consequences to parent involvement. European Child and Adolescent Psychiatry, 16, 138–148.

    Article  PubMed  Google Scholar 

  • Linacre, J. M. (2007). WINSTEPS® 3.63.0 (Computer software). Retrieved Jan 8, 2007, from http://www.winsteps.com/index.htm.

  • Riemer, M., Athay, M. M., Bickman, L., Breda, C., Kelley, S. D., & Vides de Andrade, A. R. (2012). The Peabody Treatment Progress Battery: History and methods for developing a comprehensive measurement battery for youth mental health. Administration and Policy in Mental Health and Mental Health Services. doi:10.1007/s10488-012-0404-1.

  • Riemer, M., & Kearns, M. A. (2010). Description and psychometric evaluation of the youth counseling impact scale. Psychological Assessment, 22(10), 259–268.

    Article  PubMed  Google Scholar 

  • Safford, S. M., Kendall, P. C., Flannery-Schroeder, E., Webb, A., & Sommer, H. (2005). A longitudinal look at parent-child diagnostic agreement in youth treated for anxiety disorders. Journal of Clinical Child and Adolescent Psychology, 34, 747–757.

    Article  PubMed  Google Scholar 

  • Sapyta, J., Riemer, M., & Bickman, L. (2005). Feedback to clinicians: Theory, research, and practice. Journal of Clinical Psychology, 61(2), 145–153.

    Article  PubMed  Google Scholar 

  • Schmitt, J. S., & Di Fabio, R. P. (2004). Reliable change and minimum important difference (MID) proportions facilitated group responsiveness comparisons using individual threshold criteria. Journal of Clinical Epidemiology, 57, 1008–1018.

    Article  PubMed  Google Scholar 

  • Schroeder, J. F., Hood, M. M., & Hughes, H. M. (2010). Inter-parent agreement on the syndrome scales of the Child Behavior Checklist (CBCL): Correspondence and discrepancies. Journal of Child and Family Studies, 19, 646–653.

    Article  Google Scholar 

  • Van Roy, B., Groholt, B., Heyerdahl, S., & Clench-Aas, J. (2010). Understanding discrepancies in parent-child reporting of emotional and behavioral problems: Effects of relational and socio-demographic factors. BMC Psychiatry, 10, 56–67.

    Article  PubMed  Google Scholar 

  • Wells, M. G., Burlingame, G. M., & Lambert, M. J. (1999). Youth outcome questionnaire. In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcome assessment (2nd ed.). Mahwah: Lawrence Erlbaum.

    Google Scholar 

  • Willis, G. B., Royston, P., & Bercini, D. (1991). The use of verbal report methods in the development and testing of survey questionnaires. Applied Cognitive Psychology, 5, 251–267.

    Article  Google Scholar 

  • Wright, B. D., & Linacre, J. M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8, 370. Retrieved March 10, 2011 from www.rasch.org/rmt/rmt83b.htm.

  • Youngstrom, E., Loeber, R., & Southamer-Loeber, M. (2000). Patterns and correlates of agreement between parent, teacher and male adolescent ratings of externalizing and internalizing problems. Journal of Consulting and Clinical Psychology, 68(6), 1038–1050.

    Article  PubMed  CAS  Google Scholar 

Download references

Acknowledgment

This research was supported by NIMH Grants R01-MH068589 and 4264600201 awarded to Leonard Bickman.

Author information

Authors and Affiliations

  1. Center for Evaluation and Program Improvement, Vanderbilt University, Peabody #151, 230 Appleton Place, Nashville, TN, 37203, USA

    M. Michele Athay & Leonard Bickman

  2. Wilfrid Laurier University, Waterloo, Canada

    Manuel Riemer

Authors
  1. M. Michele Athay
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Manuel Riemer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Leonard Bickman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. Michele Athay.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Athay, M.M., Riemer, M. & Bickman, L. The Symptoms and Functioning Severity Scale (SFSS): Psychometric Evaluation and Discrepancies Among Youth, Caregiver, and Clinician Ratings Over Time. Adm Policy Ment Health 39, 13–29 (2012). https://doi.org/10.1007/s10488-012-0403-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-012-0403-2

Keywords

Search

Navigation