Mental Health Services Research

, Volume 5, Issue 4, pp 223–239 | Cite as

Transportability of Multisystemic Therapy: Evidence for Multilevel Influences

  • Sonja K. Schoenwald
  • Ashli J. Sheidow
  • Elizabeth J. Letourneau
  • Jason G. Liao


This study examines factors associated with the implementation and short-term outcomes in dissemination sites of Multisystemic Therapy (MST), an intensive, short-term, family- and community-based treatment for serious antisocial behavior in youth. Participants were 666 children and families served by 217 therapists in 39 sites. Pre- (T1) to immediate posttreatment (T2) differences in child problems and functioning were similar in magnitude to those found in randomized trials of MST. Results of random effects regression supported direct effects of therapist adherence, organizational climate, and structure at baseline on immediate posttreatment child outcomes. However, organizational factors were unrelated to adherence; thus, a hypothesized mediation model in which organizational climate and structure affect outcomes through therapist adherence to MST was not supported. Furthermore, the direction of associations between some organizational climate variables and outcomes countered expectations. Post hoc moderation analyses clarify these findings, with organizational effects differing by level of therapist adherence during treatment. Implications for the transfer of evidence-based psychosocial treatments for youth to usual care practice settings are discussed.

children's mental health services community implementation of evidence-based treatments organizational climate and structure in mental health 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Achenbach T. M. (1991). Integrative guide for the 1991 CBCL/4-18, YSR, and TRF profiles. Burlington: University of Vermont, Department of Psychiatry.Google Scholar
  2. American College of Mental Health Administration. (1997). Final Report, The Santa Fe Summit on behavioral health: Preserving quality and value in the managed care equation. Pittsburgh, PA: Author.Google Scholar
  3. Baron, R. M., & Kenny, D. A. (1986). The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51, 1173-1182.Google Scholar
  4. Bickman, L. (1999). Practice makes perfect and other myths about mental health services. American Psychologist, 54, 965-987.Google Scholar
  5. Bickman, L., Lambert, E. W., Karver, M., & Andrade, A. R. (1998). Two low-cost measures of child and adolescent functioning for services research. Evaluation and Programming Planning, 21, 263-275.Google Scholar
  6. Bronfenbrenner, U. (1979). The ecology of human development: Experiments by nature and design. Cambridge, MA: Harvard University Press.Google Scholar
  7. Brown, B. S. (1995). Reducing impediments to technology transfer in drug abuse programming. In T. E. Backer, S. L. David, & G. Soucy (Eds.), Reviewing the behavioral science knowledge base on technology transfer (NIDA Research Monograph 155, NIH Publication No. 95–4035) (pp. 169-185). Rockville, MD: National Institute on Drug Abuse.Google Scholar
  8. Brown, B. S. (2000). From research to practice: The bridge is out and the water's rising. In J. A. Levy, R. C. Stephens, & D. C. McBride (Eds.), Emerging issues in the field of drug abuse. Advances in Medical Sociology (Vol. 7, pp. 345-365). Stamford, CT: JAI Press.Google Scholar
  9. Burns, B. J. (1999). A call for a mental health services research agenda for youth with serious emotional disturbance. Mental Health Services Research, 1, 5-20.Google Scholar
  10. Burns, B. J., Hoagwood, K., & Mrazek, P. J. (1999). Effective treatment for mental disorders in children and adolescents. Clinical Child and Family Psychology Review, 2, 199-254.Google Scholar
  11. Gibbons, R. D., & Bock, R. D. (1987). Trend in correlated proportions. Psychometrika, 52, 113-124.Google Scholar
  12. Glisson, C. (1992). Structure and technology in human service organizations. In Y. Hasenfeld (Ed.), Human services as complex organizations (pp. 184-202). Newbury Park, CA: Sage.Google Scholar
  13. Glisson, C. (2000). Organizational culture and climate. In R. Patti (Ed.), The handbook of social welfare management (pp. 195-217). Thousand Oaks, CA: Sage Publications.Google Scholar
  14. Glisson, C., & Hemmelgarn, A. L. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children's service systems. Child Abuse and Neglect, 22(5, 401-421.Google Scholar
  15. Goldstein, H. (1995). Multilevel statistical models (2nd ed.). New York: Halstead Press.Google Scholar
  16. Hage, J., & Aiken, M. (1967). Relationship of centralization to other structural properties. Administrative Science Quarterly, 12, 73-92.Google Scholar
  17. Hall, R. H. (1963). The concept of bureaucracy: An empirical assessment. American Journal of Sociology, 69, 32-40.Google Scholar
  18. Halliday-Boykins, C. A., & Henggeler, S. W. (2001). Multisystemic therapy: Theory, research and practice. In E. Walton, P. A. Sandau-Beckler, & M. Mannes (Eds.), Balancing family-centered services and child well-being (pp. 320-335). New York: Columbia University Press.Google Scholar
  19. Hemmelgarn, A. L., Glisson, C., & Dukes, D. (2001). Emergency room culture and the emotional support component of Family-Centered Care. Children's Health Care, 30, 93-110.Google Scholar
  20. Henggeler, S. W., & Borduin, C. M. (1992). Multisystemic Therapy Adherence Scales. Unpublished instrument, Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina.Google Scholar
  21. Henggeler, S. W., Melton, G. B., Brondino, M. J., Scherer, D. G., & Hanley, J. H. (1997). Multisystemic therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination. Journal of Consulting and Clinical Psychology, 65, 821-833.Google Scholar
  22. Henggeler, S. W., Melton, G. B., & Smith, L. A. (1992). Family preservation using multisystemic therapy: An effective alternative to incarcerating serious juvenile offenders. Journal of Consulting and Clinical Psychology, 60, 953-961.Google Scholar
  23. Henggeler, S. W., Pickrel, S. G., & Brondino, M. J. (1999). Multisystemic treatment of substance abusing and dependent delinquents: Outcomes, treatment fidelity, and transportability. Mental Health Services Research, 1, 171-184.Google Scholar
  24. Henggeler, S. W., Rowland, M. R., Randall, J., Ward, D., Pickrel, S. G., Cunningham, P. B., et al. (1999). Home-based multisystemic therapy as an alternative to the hospitalization of youth in psychiatric crisis: Clinical outcomes. Journal of the American Academy of Child and Adolescent Psychiatry, 38, 1331-1339.Google Scholar
  25. Henggeler, S. W., & Schoenwald, S. K. (1998). The MST supervisory manual: Promoting quality assurance at the clinical level. Charleston, SC: MST Services, Inc.Google Scholar
  26. Henggeler, S. W., & Schoenwald, S. K. (1999). The role of quality assurance in achieving outcomes in MST programs. Journal of Juvenile Justice and Detention Services, 14, 1-17.Google Scholar
  27. Henggeler, S. W., Schoenwald, S. K., Borduin, C. M., Rowland, M. D., & Cunningham, P. B. (1998), Multisystemic treatment of antisocial behavior in children and adolescents. New York and London: Guilford Press.Google Scholar
  28. Henggeler, S. W., Schoenwald, S. K., Liao, J. G., Letourneau, E. J., & Edwards, D. L. (2002). Transporting efficacious treatments to field settings: The link between supervisory practices and therapist fidelity in MST programs. Journal of Clinical Child Psychology, 31, 155-167.Google Scholar
  29. Henggeler, S. W., Schoenwald, S. K., & Munger, R. L. (1996). Families and therapists achieve clinical outcomes, systems of care mediate the process. Journal of Child and Family Studies, 5, 177-183.Google Scholar
  30. Henggeler, S. W., Schoenwald, S. K., Rowland, M. D., & Cunningham, P. B. (2002). Serious emotional disturbance in children and adolescents: Multisystemic therapy. New York: Guilford Press.Google Scholar
  31. Hoagwood, K., Burns, B. J., Kiser, L., Ringeisen, H., & Schoenwald, S. (2001). Evidence-based practice in child and adolescent mental health services. Psychiatric Services, 52, 1179-1189.Google Scholar
  32. Hoagwood, K., Burns, B. J., & Weisz, J. (2002). A profitable conjunction: From science to service in children's mental health. In B. J. Burns & K. Hoagwood (Eds.), Community-based interventions for youth with severe emotional disturbances (pp. 327-338). New York: Oxford University Press.Google Scholar
  33. Hoagwood, K., Hibbs, E., Brent, D., & Jensen, P. (1995). Introduction to the special section: Efficacy and effectiveness studies of child and adolescent psychotherapy. Journal of Consulting and Clinical Psychology, 63, 683-687.Google Scholar
  34. Hofmann, D. A., & Gavin, M. B. (1998). Centering decisions in hierarchical linear models: Implications for research in organizations. Journal of Management, 24, 623-641.Google Scholar
  35. Hohmann, A. A., & Shear, M. K. (2002). Community-based intervention research: Coping with the noise in real life in study design. American Journal of Psychiatry, 159, 201-207.Google Scholar
  36. Holmbeck, G. N. (1997). Toward terminological, conceptual, and statistical clarity in the study of mediators: Examples from the child-clinical and pediatric psychology literatures. Journal of Consulting and Clinical Psychology, 65, 599-610.Google Scholar
  37. Huey, S. J., Henggeler, S. W., Brondino, M. J., & Pickrel, S. G. (2000). Mechanisms of change in multisystemic therapy: Reducing delinquent behavior through therapist adherence and improved family and peer functioning. Journal of Consulting and Clinical Psychology, 68, 451-467.Google Scholar
  38. James, L.R., & Sells, S.B. (1981). Psychological climate: Theoretical perspectives and empirical research. In D. Magnussen (Ed.), The situation: An interactional perspective (pp. 275-295). Hillsdale, NJ: Erlbaum.Google Scholar
  39. Laird, N. M., & Ware, J. H. (1982). Random-effects models for longitudinal data. Biometrics, 38, 963-974.Google Scholar
  40. Letourneau, E. J., Sheidow, A. J., & Schoenwald, S. K. (2002). Structure and reliability of the MST therapist adherence scale in a large community sample. Charleston: Family Services Research Center, Medical University of South Carolina.Google Scholar
  41. Loeber, R., & Farrington, D. P. (1998). Serious and violent juvenile offenders: Risk factors and successful interventions. Thousand Oaks, CA: Sage.Google Scholar
  42. Raudenbush, S. W., & Bryk A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.Google Scholar
  43. Rogers, E. M. (1995). Diffusion of Innovations (4th ed.). New York: The Free Press.Google Scholar
  44. Rosenheck, R. A. (2001). Organizational process: A missing link between research and practice. Psychiatric Services, 52, 1607-1612.Google Scholar
  45. SAS Institute (2000). SAS/STAT User's Guide, Version 8. Cary, NC: SAS Institute Inc.Google Scholar
  46. Schoenwald, S. K. (1998). Multisystemic therapy consultation guidelines. Charleston, SC: MST Institute.Google Scholar
  47. Schoenwald, S. K., Halliday-Boykins, C., & Henggeler, S. W. (2003). Client-level predictors of adherence to MST in community service settings. Family Process, 42, 345-359.Google Scholar
  48. Schoenwald, S. K., & Henggeler, S. W. (2002). Services research and family based treatment. In H. A. Liddle, D. A. Santisteban, R. F. Levant, & J. H. Bray (Eds.), Family psychology: Science-based interventions (pp. 259-282). Washington, DC: American Psychological Association.Google Scholar
  49. Schoenwald, S. K., Henggeler, S. W., Brondino, M. J., & Rowland, M. D. (2000). Multisystemic therapy: Monitoring treatment fidelity. Family Process, 39, 83-103.Google Scholar
  50. Schoenwald, S. K., & Hoagwood, K. (2001). Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services, 52, 1190-1197.Google Scholar
  51. Schoenwald, S. K., Letourneau, E. J., & Halliday-Boykins, C. A. (2003). Therapist and client predictors of adherence to MST in community service settings. Manuscript in preparation.Google Scholar
  52. Scott, W. R. (1990). Technology and structure: An organizational level perspective. In P. S. Goodman & L. S. Sproull (Eds.), Technology and organizations. San Francisco: Jossey-Bass.Google Scholar
  53. Shaw, B. F., Olmsted, M., Dobson, K. S., Sotsky, S. M., Elkin, I., Yamaguchi, J., et al. (1999). Therapist competence ratings in relation to clinical outcome in cognitive therapy of depression. Journal of Consulting and Clinical Psychology, 67, 837-846.Google Scholar
  54. Sheidow, A. J., Schoenwald, S. K., & Liao, J. G. (2002). Adaptation of organizational climate and structure scales for use with child and family therapy providers. Charleston: Family Services Research Center, Medical University of South Carolina.Google Scholar
  55. Simpson, D. D. (2002). A conceptual framework for transferring research to practice. Journal of Substance Abuse Treatment, 4, 171-182.Google Scholar
  56. Snijders, T. A. B., & Bosker, R. J. (1994). Modeled variance in two-level models. Sociological Methods and Research, 22, 342-344.Google Scholar
  57. Stiratelli, R., Laird, N. M., & Ware, J. H. (1984). Random-effects models for serial observations with binary response. Biometrics, 40, 961-971.Google Scholar
  58. U.S. Public Health Service. (2000). Report of the Surgeon General's Conference on Children's Mental Health: A national action agenda. Washington, DC: Author.Google Scholar
  59. Weisz, J. R. (2000). Agenda for child and adolescent psychotherapy research: On the need to put science into practice. Archives of General Psychiatry, 57, 837-838.Google Scholar
  60. Weisz, J. R., Donenberg, G. R., Han, S. S., & Weiss, B. (1995). Bridging the gap between laboratory and clinic in child and adolescent psychotherapy. Journal of Consulting and Clinical Psychology, 63, 688-701.Google Scholar

Copyright information

© Plenum Publishing Corporation 2003

Authors and Affiliations

  • Sonja K. Schoenwald
    • 1
  • Ashli J. Sheidow
    • 1
  • Elizabeth J. Letourneau
    • 1
  • Jason G. Liao
    • 2
  1. 1.Department of Psychiatry & Behavioral SciencesMedical University of South CarolinaCharleston
  2. 2.Division of BiometricsUniversity of Medicine and Dentistry of New JerseyNew Brunswick

Personalised recommendations