Advertisement

Traveling Without a Map: An Incomplete History of the Road to Implementation Science and Where We May Go from Here

  • David S. MandellEmail author
Commentary

Abstract

This editorial provides a brief history of mental health services research over the last 30 years and how findings from large-scale studies shocked the field and led to the lines of inquiry culminating in current implementation science research. I review the manuscripts published in this special issue of Administration and Policy in Mental Health in light of that history and usethese studies as a way to assess the state of the field. Finally, I present five takeaways extracted from these articles that may be useful in considering future directions for implementation research.

Keywords

Implementation science Mental health services Training 

Notes

Acknowledgements

This work was supported by years of soul searching and wandering in the desert, getting to be a fly on the wall in rooms with many people wiser and more experienced than I, and the Penn ALACRITY center (P50 MH113840).

Compliance with Ethical Standards

Conflict of interest

The author has no potential conflicts of interest to disclose.

Informed Consent

This commentary did not comprise research involving human or animal participants, therefore no informed consent was required.

References

  1. Aarons, G. A., Wells, R. S., Zagursky, K., Fettes, D. L., & Palinkas, L. A. (2009). Implementing evidence-based practice in community mental health agencies: A multiple stakeholder analysis. American Journal of Public Health,99(11), 2087–2095.  https://doi.org/10.2105/AJPH.2009.161711.CrossRefPubMedPubMedCentralGoogle Scholar
  2. Baumann, A. A., Carothers, B. J., Landsverk, J., Kryzer, E., Aarons, G. A., Brownson, R. C., et al. (2019). Evaluation of the implementation research institute: Trainees' publications and grant productivity. Administration and Policy in Mental Health.  https://doi.org/10.1007/s10488-019-00977-4.CrossRefPubMedGoogle Scholar
  3. Behar, L. (1990). Financing mental health services for children and adolescents. Bulletin of the Menninger Clinic,54(1), 127–139. (discussion 140-128).PubMedGoogle Scholar
  4. Beidas, R. S., Williams, N. J., Becker-Haimes, E. M., Aarons, G. A., Barg, F. K., Evans, A. C., et al. (2019). A repeated cross-sectional study of clinicians' use of psychotherapy techniques during 5 years of a system-wide effort to implement evidence-based practices in Philadelphia. Implementation Science,14(1), 67.  https://doi.org/10.1186/s13012-019-0912-4.CrossRefPubMedGoogle Scholar
  5. Bickman, L. (1996a). The evaluation of a children's mental health managed care demonstration. Journal of Mental Health Administration,23(1), 7–15.  https://doi.org/10.1007/bf02518639.CrossRefPubMedGoogle Scholar
  6. Bickman, L. (1996b). Implications of a children's mental health managed care demonstration evaluation. Journal of Mental Health Administration,23(1), 107–117.  https://doi.org/10.1007/bf02518647.CrossRefPubMedGoogle Scholar
  7. Bickman, L. (2000). The most dangerous and difficult question in mental health services research. Mental Health Services Research,2(2), 71–72.  https://doi.org/10.1023/A:1010100119789.CrossRefGoogle Scholar
  8. Bickman, L., Lambert, E. W., Andrade, A. R., & Penaloza, R. V. (2000). The Fort Bragg continuum of care for children and adolescents: Mental health outcomes over 5 years. Journal of Consultative and Clinical Psychology,68(4), 710–716.CrossRefGoogle Scholar
  9. Bickman, L., Salzer, M. S., Lambert, E. W., Saunders, R., Summerfelt, W. T., Heflinger, C. A., et al. (1998). Rejoinder to Mordock's critique of the Fort Bragg Evaluation Project: The sample is generalizable and the outcomes are clear. Child Psychiatry and Human Development,29(1), 77–91.  https://doi.org/10.1023/a:1022687331435.CrossRefPubMedGoogle Scholar
  10. Bickman, L., Summerfelt, W. M. T., Firth, J. M., & Douglas, S. M. (1997a). The Stark County Evaluation Project: Baseline results of a randomized experiment Evaluating mental health services: How do programs for children “work” in the real world? (pp. 231–258). Thousand Oaks, CA: Sage Publications Inc.Google Scholar
  11. Bickman, L., Summerfelt, W. T., & Noser, K. (1997b). Comparative outcomes of emotionally disturbed children and adolescents in a system of services and usual care. Psychiatric Services,48(12), 1543–1548.  https://doi.org/10.1176/ps.48.12.1543.CrossRefPubMedGoogle Scholar
  12. Birken, S. A., Powell, B. J., Presseau, J., Kirk, M. A., Lorencatto, F., Gould, N. J., et al. (2017). Combined use of the consolidated framework for implementation research (CFIR) and the theoretical domains framework (TDF): A systematic review. Implementation Science,12, 2.  https://doi.org/10.1186/s13012-016-0534-z.CrossRefPubMedGoogle Scholar
  13. Brownson, R. C., Proctor, E. K., Luke, D. A., Baumann, A. A., Staub, M., Brown, M. T., et al. (2017). Building capacity for dissemination and implementation research: One university's experience. Implementation Science,12(1), 104.  https://doi.org/10.1186/s13012-017-0634-4.CrossRefPubMedGoogle Scholar
  14. Cheron, D. M., Chiu, A. A. W., Stanick, C. F., Stern, H. G., Donaldson, A. R., Daleiden, E. L., et al. (2019). Implementing evidence based practices for children's mental health: A case study in implementing modular treatments in community mental health. Administration and Policy in Mental Health,46(3), 391–410.  https://doi.org/10.1007/s10488-019-00922-5.CrossRefPubMedGoogle Scholar
  15. Collins, L. M., Murphy, S. A., & Strecher, V. (2007). The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): New methods for more potent eHealth interventions. American Journal of Preventative Medicine,32(5), S112–S118.  https://doi.org/10.1016/j.amepre.2007.01.022.CrossRefGoogle Scholar
  16. Farchione, T. J., Fairholme, C. P., Ellard, K. K., Boisseau, C. L., Thompson-Hollands, J., Carl, J. R., et al. (2012). Unified protocol for transdiagnostic treatment of emotional disorders: A randomized controlled trial. Behavior Therapy,43(3), 666–678.  https://doi.org/10.1016/j.beth.2012.01.001.CrossRefPubMedPubMedCentralGoogle Scholar
  17. Fischer, E. P., Shumway, M., & Owen, R. R. (2002). Priorities of consumers, providers, and family members in the treatment of schizophrenia. Psychiatric Services,53(6), 724–729.  https://doi.org/10.1176/appi.ps.53.6.724.CrossRefPubMedGoogle Scholar
  18. Friedman, R. M., & Burns, B. J. (1996). The evaluation of the Fort Bragg Demonstration Project: An alternative interpretation of the findings. Journal of Mental Health Administration,23(1), 128–136.  https://doi.org/10.1007/bf02518651.CrossRefPubMedGoogle Scholar
  19. Garland, A. F., Hurlburt, M. S., Brookman-Frazee, L., Taylor, R. M., & Accurso, E. C. (2010). Methodological challenges of characterizing usual care psychotherapeutic practice. Administration and Policy in Mental Health,37(3), 208–220.  https://doi.org/10.1007/s10488-009-0237-8.CrossRefPubMedGoogle Scholar
  20. Garland, A. F., Lewczyk-Boxmeyer, C. M., Gabayan, E. N., & Hawley, K. M. (2004). Multiple stakeholder agreement on desired outcomes for adolescents' mental health services. Psychiatric Services,55(6), 671–676.  https://doi.org/10.1176/appi.ps.55.6.671.CrossRefPubMedGoogle Scholar
  21. Glisson, C. (1994). The effect of services coordination teams on outcomes for children in state custody. Administration in Social Work,18(4), 1–23.  https://doi.org/10.1300/J147v18n04_01.CrossRefPubMedGoogle Scholar
  22. Glisson, C. (2002). The organizational context of children's mental health services. Clinical Child and Family Psychology Review,5(4), 233–253.  https://doi.org/10.1023/a:1020972906177.CrossRefPubMedGoogle Scholar
  23. Glisson, C., & Hemmelgarn, A. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children's service systems. Child Abuse and Neglect,22(5), 401–421.  https://doi.org/10.1016/s0145-2134(98)00005-2.CrossRefPubMedGoogle Scholar
  24. Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., et al. (2010). Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. Journal of Consultative and Clinical Psychology,78(4), 537–550.  https://doi.org/10.1037/a0019160.CrossRefGoogle Scholar
  25. Hoagwood, K. (1997). Interpreting nullity. The Fort Bragg experiment—A comparative success or failure? American Psychologist,52(5), 546–550.  https://doi.org/10.1037//0003-066x.52.5.546.CrossRefPubMedGoogle Scholar
  26. Hohmann, A. A. (1999). A contextual model for clinical mental health effectiveness research. Mental Health Services Research,1(2), 83–91.  https://doi.org/10.1023/a:1022382219660.CrossRefGoogle Scholar
  27. Ingersoll, B., & Wainer, A. (2013). Initial efficacy of project ImPACT: A parent-mediated social communication intervention for young children with ASD. Journal of Autism and Developmental Disorders,43(12), 2943–2952.  https://doi.org/10.1007/s10803-013-1840-9.CrossRefPubMedGoogle Scholar
  28. Israel, B. A., Schulz, A. J., Parker, E. A., & Becker, A. B. (1998). Review of community-based research: Assessing partnership approaches to improve public health. Annual Review of Public Health,19, 173–202.  https://doi.org/10.1146/annurev.publhealth.19.1.173.CrossRefPubMedGoogle Scholar
  29. Kennedy, S. M., Bilek, E. L., & Ehrenreich-May, J. (2019). A Randomized controlled pilot trial of the unified protocol for transdiagnostic treatment of emotional disorders in children. Behavior Modification,43(3), 330–360.  https://doi.org/10.1177/0145445517753940.CrossRefPubMedGoogle Scholar
  30. Knitzer, J., & Olson, L. (1982). Unclaimed children: The failure of public responsibility to children and adolescents in need of mental health services. Washington, D.C. (1520 New Hampshire Ave. N.W., Washington 20036): Children's Defense Fund.Google Scholar
  31. Lewczyk, C. M., Garland, A. F., Hurlburt, M. S., Gearity, J., & Hough, R. L. (2003). Comparing DISC-IV and clinician diagnoses among youths receiving public mental health services. Journal of the American Academy of Child and Adolescent Psychiatry,42(3), 349–356.  https://doi.org/10.1097/00004583-200303000-00016.CrossRefPubMedGoogle Scholar
  32. Mordock, J. B. (1997). The Fort Bragg continuum of care Demonstration Project: The population served was unique and the outcomes are questionable. Child Psychiatry and Human Development,27(4), 241–254.  https://doi.org/10.1007/bf02353353.CrossRefPubMedGoogle Scholar
  33. Novins, D. K., Green, A. E., Legha, R. K., & Aarons, G. A. (2013). Dissemination and implementation of evidence-based practices for child and adolescent mental health: A systematic review. Journal of the American Academy of Child and Adolescent Psychiatry,52(10), 1009–1025.  https://doi.org/10.1016/j.jaac.2013.07.012.CrossRefPubMedPubMedCentralGoogle Scholar
  34. Palinkas, L. A. (2014). Qualitative and mixed methods in mental health services and implementation research. Journal of Clinical Child and Adolescent Psychology,43(6), 851–861.  https://doi.org/10.1080/15374416.2014.910791.CrossRefPubMedPubMedCentralGoogle Scholar
  35. Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., et al. (2012). A compilation of strategies for implementing clinical innovations in health and mental health. Medical Care Research Review,69(2), 123–157.  https://doi.org/10.1177/1077558711430690.CrossRefPubMedGoogle Scholar
  36. Proctor, E. K., & Chambers, D. A. (2017). Training in dissemination and implementation research: A field-wide perspective. Translational Behavioral Medicine,7(3), 624–635.  https://doi.org/10.1007/s13142-016-0406-8.CrossRefPubMedGoogle Scholar
  37. Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013). Implementation strategies: Recommendations for specifying and reporting. Implementation Science,8, 139.  https://doi.org/10.1186/1748-5908-8-139.CrossRefGoogle Scholar
  38. Saxe, L., & Cross, T. P. (1997). Interpreting the Fort Bragg children's mental health demonstration project. The cup is half full. American Psychologist,52(5), 553–556.  https://doi.org/10.1037//0003-066x.52.5.553.CrossRefPubMedGoogle Scholar
  39. Schlenger, W. E., Etheridge, R. M., Hansen, D. J., Fairbank, D. W., & Onken, J. (1992). Evaluation of state efforts to improve systems of care for children and adolescents with severe emotional disturbances: The CASSP (Child and Adolescent Service System Program) initial cohort study. Journal of Mental Health Administration,19(2), 131–142.  https://doi.org/10.1007/bf02521314.CrossRefPubMedGoogle Scholar
  40. Schoenwald, S. K., & Hoagwood, K. (2001). Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services,52(9), 1190–1197.  https://doi.org/10.1176/appi.ps.52.9.1190.CrossRefPubMedPubMedCentralGoogle Scholar
  41. Stroul, B. A., & Friedman, R. M. (1988). Caring for severely emotionally disturbed children and youth. Principles for a system of care. Children Today,17(4), 11–15.PubMedGoogle Scholar
  42. Tabak, R. G., Padek, M. M., Kerner, J. F., Stange, K. C., Proctor, E. K., Dobbins, M. J., et al. (2017). Dissemination and implementation science training needs: Insights from practitioners and researchers. American Journal of Preventative Medicine,52(3), S322–S329.  https://doi.org/10.1016/j.amepre.2016.10.005.CrossRefGoogle Scholar
  43. Tuma, J. M. (1989). Mental health services for children. The state of the art. American Psychologist,44(2), 188–199.  https://doi.org/10.1037//0003-066x.44.2.188.CrossRefPubMedGoogle Scholar
  44. Ware, N. C., Tugenberg, T., Dickey, B., & McHorney, C. A. (1999). An ethnographic study of the meaning of continuity of care in mental health services. Psychiatric Services,50(3), 395–400.  https://doi.org/10.1176/ps.50.3.395.CrossRefPubMedGoogle Scholar
  45. Weisz, J. R., Chorpita, B. F., Palinkas, L. A., Schoenwald, S. K., Miranda, J., Bearman, S. K., et al. (2012). Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: A randomized effectiveness trial. Archives of General Psychiatry,69(3), 274–282.  https://doi.org/10.1001/archgenpsychiatry.2011.147.CrossRefPubMedGoogle Scholar
  46. Weisz, J. R., Han, S. S., & Valeri, S. M. (1997). More of what? Issues raised by the Fort Bragg study. American Psychologist,52(5), 541–545.  https://doi.org/10.1037//0003-066x.52.5.541.CrossRefPubMedGoogle Scholar
  47. Williams, N. J., & Beidas, R. S. (2019). Annual Research Review: The state of implementation science in child psychology and psychiatry: A review and suggestions to advance the field. Journal of Child Psychology and Psychiatry,60(4), 430–450.  https://doi.org/10.1111/jcpp.12960.CrossRefPubMedGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2020

Authors and Affiliations

  1. 1.Department of Psychiatry, Penn Center for Mental HealthUniversity of Pennsylvania Perelman School of MedicinePhiladelphiaUSA

Personalised recommendations