Abstract
The longitudinal comparison study of the national evaluation of the Comprehensive Community Mental Health Services for Children and Their Families Program assesses factors in service delivery systems that may shape the impact of systems of care. We evaluated the extent to which services embodying the principles of a system of care, as measured by the System-of-Care Practice Review (SOCPR), affect clinical outcomes for children being served in federally-funded systems of care and matched comparison communities. The participants included 75 children and families selected for participation in the SOCPR. Results indicated that experience of services embodying system-of-care principles at a high level was associated with lower symptom and impairment scores one year after entry into services. Children in systems of care were rated to have experienced high levels of system-of-care principles implemented within their services, and their symptom severity and functional impairment did not vary as a function of their experiences. Children in matched comparison communities had more variable rated experiences of system-of-care principles within their services, and their symptom severity and functional impairment decreased as their experiences of the principles increased.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
REFRENCES
Achenbach, T. M. (1991). Manual for the Child Behavior Checklist/4-18 and 1991 Profile. Burlington: University of Vermont, Department of Psychiatry.
American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
Bickman, L., Guthrie, P. R., Foster, E. M., Lambert, W., Summerfelt, W. T., Breda, C. S., et al. (1995). Evaluating managed mental health services: The Fort Bragg experiment. New York: Plenum Press.
Bickman, L., Summerfelt, W., & Noser, K. (1997). Comparative outcomes of emotionally disturbed children and adolescents in a system of services and usual care. Psychiatric Services, 48, 1543-1548.
Brannan, A. M., Baughman, L. N., Reed, E. D., & Katz-Leavy, J. (2002). System-of-care assessment: Cross-site comparison of findings. Children's Services: Social Policy, Research, and Practice, 5, 37-56.
Burns, B. J., & Hoagwood, K. (2002). Community treatment for youth: Evidence-based interventions for severe emotional and behavioral disorders. New York: Oxford University Press.
Canino, G., Costello, J., & Angold, A. (1999). Assessing functional impairment and social adaptation for child mental health services research: A review of measures.Mental Health Services Research, 1, 93-108.
Center for Mental Health Services. (1998). Annual report to Congress on the evaluation of the Comprehensive Community Mental Health Services for Children and Their Families Program, 1998. Atlanta, GA: Macro International Inc.
Center for Mental Health Services. (1999). Annual report to Congress on the evaluation of the Comprehensive Community Mental Health Services for Children and Their Families Program, 1999. Atlanta, GA: ORC Macro.
Center for Mental Health Services. (under review-a). Annual report to Congress on the evaluation of the Comprehensive Community Mental Health Services for Children and Their Families Program, 2000. Atlanta, GA: ORC Macro.
Center for Mental Health Services. (under review-b). Annual report to Congress on the evaluation of the Comprehensive Community Mental Health Services for Children and Their Families Program, 2001. Atlanta, GA: ORC Macro.
Cross, T. P., & McDonald, E. (1995). Evaluating the outcome of children's mental health services: A guide for the use of available child and family outcome measures. Boston: Judge Baker Children's Center.
Farmer, E. M. Z. (2000). Issues confronting effective services in systems of care. Children and Youth Services Review, 22, 627-650.
Greenbaum, P. E., Brown, L., Lipien, E. C., & Trinidad, V. (2002). Psychometric analyses of the system-of-care practice review (SOCPR) instrument. Unpublished manuscript, Louis de la Parte Florida Mental Health Institute, University of South Florida, Tampa.
Groves, I. D., & Foster, R. E. (1995, March). Service testing: Assessing the quality and outcomes of systems of care performance through interaction with individual children served. Paper presented at the eighth Annual System of Care for Children's Mental Health: Expanding the Research Base Conference, Tampa, FL.
Gutierrez-Mayka, M., & Hernandez, M. (1997). Family experience study: Baseline findings for Richmond. Florida Mental Health Institute, Department of Child and Family Studies, University of South Florida, Tampa
Hernandez, M., Gomez, A., Lipien, L., Greenbaum, P. E., Armstrong, K. H., & Gonzalez, P. (2001). Use of the system-of-care practice review in the national evaluation: Evaluating the fidelity of practice to system-of-care principles. Journal of Emotional and Behavioral Disorders, 9, 43-52.
Hodges, K. (1990a).Child and Adolescent Functional Assessment Scale (CAFAS) Ypsilanti: Eastern Michigan University, Department of Psychology.
Hodges, K. (1990b).CAFAS self-training manual and blank scoring forms.Ypsilanti: Eastern Michigan University, Department of Psychology.
Hodges, K., Lambert, W., & Summerfelt, W. T. (1994, February-March). Validity of a measure to assess impairment: The Child and Adolescent Functional Assessment Scale (CAFAS) Paper presented at the seventh Annual Research Conference, A System of Care for Children's Mental Health: Expanding the Research Base. Tampa, FL.
Hodges, K., & Wong, M. W. (1996). Psychometric characteristics of a multidimensional measure to assess impairment: The Child and Adolescent Functional Assessment Scale. Journal of Child and Family Studies 5, 445-467.
Holden, E. W., Santiago, R. L., Manteuffel, B. A., Stephens, R. L., Soler, R., Liao, Q., et al. (2003). Systems of care demonstration projects: Innovation, evaluation and sustainability. In A. Pumariega and N. Winters (Eds.), Handbook of community systems of care: The new child and adolescent community psychiatry San Francisco: Jossey-Bass.
Lambert, E. W., Brannan. M., Breda, C. S., Heflinger, C. A.,&Bickman, L. (1998). Common patterns of service use in children's mental health. Evaluation and Program Planning 21, 47-57.
Manteuffel, B., Grossman, L. S., & Askew, R. (2003). Assessment of caregiver service experience at the practice level in system-of-care and comparison communities. In C. Newman, C. Liberton, K. Kutash, and R. M. Friedman (Eds.), The 15th Annual Research Conference Proceedings, A System of Care for Children's Mental Health: Expanding the Research Base(pp. 153-156). Tampa: University of South Florida, The Louis de la Parte Florida Mental Health Institute, Research and Training Center for Children's Mental Health.
McConaughy, S. H. (1993). Advances in empirically based assessment of children's behavioral and emotional problems. School Psychology Review 22, 285-307.
Neter, J., Wasserman, W., & Kutner, M. H. (1985). Applied linear statistical models: Regression, analysis of variance, and experimental designs (2nd ed.) Homewood, IL: Richard D. Irwin, Inc.
Quist, R. M., & Matshazi, D. G. M. (2000). The Child and Adolescent Functional Assessment Scale (CAFAS): A dynamic predictor of juvenile recidivism. Adolescence 35, 181-192.
Rosenblatt, A., & Rosenblatt, J. (2000). Demographic, clinical, and functional characteristics of youth enrolled in six California systems of care. Journal of Child and Family Studies 9, 51-66
Schoenwald, S. K., & Hoagwood, K. (2001). Effectiveness, transportability, and dissemination of interventions: What matters when. Psychiatric Services, 52, 1190-1197.
Stroul, B. A., & Friedman, R. M. (1986). A system of care for children and youth with severe emotional disturbances (Rev. ed.) Washington, DC: Georgetown University Child Development Center, CASSP Technical Assistance Center.
U.S.Department of Health and Human Services. (1999). Mental health:A report of the surgeon general Washington,DC:U.S.Government Printing Office.
Vinson, N., Brannan, A. M., Baughman, L., Wilce, M., & Gawron, T. (2001). The system-of-care model: Implementation in twenty-seven communities. Journal of Emotional and Behavioral Disorders 9, 30-42.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Stephens, R.L., Holden, E.W. & Hernandez, M. System-of-Care Practice Review Scores as Predictors of Behavioral Symptomatology and Functional Impairment. Journal of Child and Family Studies 13, 179–191 (2004). https://doi.org/10.1023/B:JCFS.0000015706.77407.cb
Issue Date:
DOI: https://doi.org/10.1023/B:JCFS.0000015706.77407.cb