Abstract
In this paper, we present the process of developing and evaluating an instrument designed to measure the extent to which a complex community system has changed as a result of a community initiative, and for purposes of this research, doing this within the content area of developing local trauma-informed child welfare systems in specific communities in Michigan. The instrument was designed for the Southwest Michigan Children’s Trauma Assessment Center’s (CTAC) Substance Abuse and Mental Health Services Administration (SAMHSA)-funded initiative to bring a trauma-informed perspective to professionals working with children in child welfare. The Trauma Informed System Change Instrument was developed with the input of experts in trauma-informed system change. Two parts of the instrument were analyzed separately using confirmatory factor analysis. A two factor model was fit for Community Characteristics and a three factor model for Individual Characteristics. Although adequate factorial validity was obtained for the instrument, specific items on the instrument that were problematic in fitting the model were identified, and suggestions for revising the instrument for improved functionality are offered, as are other potential uses of the instrument.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
The Divergence Scale had initially been adapted and piloted as a “Tradition” subscale, but due to problems with utility and psychometrics, this adapted subscale was removed from the instrument.
References
Aarons, G. A. (2005). Measuring provider attitudes toward evidence-based practice: Organizational context and individual differences. Child and Adolescent Psychiatric Clinics of North America, 14, 255–271.
American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders: Text revision DSM-IV-TR (4th ed.). Washington, DC: American Psychiatric Association.
Beauducel, A., & Herzberg, P. Y. (2006). On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Structural Equation Modeling, 13, 186–203.
Bollen, K., & Long, J. (Eds.). (1993). Testing structural equation models. Newbury Park, CA: Sage.
Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York, NY: Guildford.
Coffman, J. (2007). A framework for evaluating systems initiatives. Retrieved Dec 21, 2010, from http://www.buildinitiative.org.
Cook, A., Blaustein, M., Spinazzola, J., & van der Kolk, B. (Eds.). (2003). Complex trauma in children and adolescents. Retrieved Jan 17, 2005, from http://www.NCTSNet.org.
Cook, A., Spinazzola, J., Ford, J., Lanktree, C., Blaustein, M., Cloitre, M., et al. (2005). Complex trauma in children and adolescents. Psychiatric Annals, 35, 390–398.
Ford, J., Chapman, J., Hawke, J., & Albert, D. (2007). Trauma among youth in the juvenile justice system: Critical issues and new directions (National Center for Mental Health and Juvenile Justice Research Brief). Retrieved June 6, 2009, from http://www.cwla.org/programs/juvenilejustice/ncmhjjtraumayouth.pdf.
Gugiu, P. C., Coryn, C. L. S., & Applegate, E. B. (2010). Structure and measurement properties of the Patient Assessment of Chronic Illness Care instrument. Journal of Evaluation in Clinical Practice, 16, 509–516.
Gugiu, P. C., Coryn, C. L. S., Clark, R., & Kuehn, A. (2009). Development and evaluation of the short-version of the Patient Assessment of Chronic Illness Care (PACIC) instrument. Chronic Illness, 5, 268–276.
Harris, W., Lieberman, A., & Marans, S. (2007). In the best interests of society. Journal of Child Psychology and Psychiatry, 48, 392–411.
Heide, K. M., & Solomon, E. P. (2006). Biology, childhood trauma, and homicide: Rethinking justice. International Journal of Law and Psychiatry, 29, 220–233.
Henry, J., Sloane, M., & Black-Pond, C. (2007). Neurobiology and neurodevelopmental impact of childhood traumatic stress and prenatal alcohol exposure. Language, Speech, and Hearing Services in Schools, 38, 99–108.
Kline, R. B. (2010). Principles and practice of structural equation modeling (3rd ed.). New York: Guilford.
Muthén, L. K., & Muthén, B. O. (2007). Mplus user’s guide (5th ed.). Los Angeles: Muthén & Muthén.
National Child Traumatic Stress Network (NCTSN). (2007). The essential elements of trauma-informed child welfare practice. Retrieved Dec 21, 2010, from http://www.nctsnet.org/nctsn_assets/pdfs/cwt3_SHO_EEs.pdf.
Perry, B. D. (1999). Helping traumatized children: A brief overview for caregivers. Child Trauma Academy Parent and Caregiver Education Series, 1, 1–18.
Perry, B. D. (2001). The neurodevelopmental impact of violence in childhood. In D. Schetky & E. Benedek (Eds.), Textbook of child and adolescent forensic psychiatry (pp. 221–238). Washington, DC: American Psychiatric Press.
Richardson, M. (2010). Development of the trauma-informed system change instrument: Evaluation of factorial validity and implications for use (Doctoral dissertation Western Michigan University, 2010), Proquest Dissertations and Theses, UMI 3440815.
Schore, A. (2003). Affect regulation and the repair of the self. New York, NY: W. W. Norton and Company.
Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., & King, J. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. The Journal of Educational Research, 99, 323–338.
Stambaugh, L., Burns, B. J., Landsverk, J., & Rolls-Reutz, J. (2007). Evidence-Based Treatment for Children in Child Welfare. Focal Point: Research, Policy, and Practice in Children’s Mental Health: Traumatic Stress/Child Welfare, 21(1), 12–15.
Taylor, N., & Siegfried, C. (2005). Helping children in the child welfare system heal from trauma: A systems integration approach. Systems Integration Working Group, National Child Traumatic Stress Network.
Teicher, M. (2003). Scars that won’t heal: The neurobiology of child abuse. Scientific American, 286, 68–76.
van der Kolk, B. A. (2005). Developmental trauma disorder: Toward a rational diagnosis for children with complex trauma histories. Psychiatric Annals, 35, 401–409.
Williams, B., & Imam, I. (2007). Systems concepts in evaluation: An expert anthology. Point Reyes, CA: EdgePress.
Zumbo, B. D., Gadermann, A. M., & Zeisser, C. (2007). Ordinal versions of coefficient alpha and theta for Likert rating scales. Journal of Modern Applied Statistical Methods, 6, 21–29.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Richardson, M.M., Coryn, C.L.S., Henry, J. et al. Development and Evaluation of the Trauma-Informed System Change Instrument: Factorial Validity and Implications for Use. Child Adolesc Soc Work J 29, 167–184 (2012). https://doi.org/10.1007/s10560-012-0259-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10560-012-0259-z