Advertisement

The Role of Implementation Science in Behavioral Health

  • Oliver T. MasseyEmail author
  • Enya B. Vroom
Chapter

Abstract

This chapter reviews and discusses research and practice in the fields of behavioral health and public health from the perspective of implementation science, with an emphasis on critical questions researchers and practice professionals must address as they attempt to improve services in the community. This chapter will also focus on the latter stages concerned with moving programs that have been conceptualized and tested under controlled conditions into clinical practices, paying particular attention to the process of implementation, issues in program fidelity, fit, and adaptation and conclude with a discussion of integration and sustainability.

Keywords

Implementation science (IS) Behavioral health Evidence-based programs 

References

  1. Aarons, G. A. (2004). Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research, 6(2), 61–74.  https://doi.org/10.1023/B:MHSR.0000024351.12294.65CrossRefPubMedPubMedCentralGoogle Scholar
  2. Aarons, G. A. (2006). Transformational and transactional leadership: Association with attitudes toward evidence-based practice. Psychiatric Services, 57(8), 1162–1169.  https://doi.org/10.1176/ps.2006.57.8.1162CrossRefGoogle Scholar
  3. Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health, 38(1), 4–23.  https://doi.org/10.1007/s10488-010-0327-7CrossRefPubMedGoogle Scholar
  4. Aarons, G. A., & Sommerfeld, D. H. (2012). Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. Journal of the American Academy of Child and Adolescent Psychiatry, 51(4), 423–431.  https://doi.org/10.1016/j.jaac.2012.01.018CrossRefPubMedGoogle Scholar
  5. Aarons, G. A., Sommerfeld, D. H., & Walrath-Greene, C. M. (2009). Evidence-based practice implementation: The impact of public versus private sector organization type on organizational support, provider attitudes, and adoption of evidence-based practice. Implementation Science, 4, 83.  https://doi.org/10.1186/1748-5908-4-83CrossRefPubMedGoogle Scholar
  6. Abdinnour-Helm, S., Lengnick-Hall, M. L., & Lengnick-Hall, C. A. (2003). Pre-implementation attitudes and organizational readiness for implementing an Enterprise Resource Planning system. European Journal of Operational Research, 146(2), 258–273.  https://doi.org/10.1016/S0377-2217(02)00548-9CrossRefGoogle Scholar
  7. Adelman, H. S., & Taylor, L. (2003). On sustainability of project innovations as systemic change. Journal of Educational and Psychological Consultation, 14(1), 1–25.  https://doi.org/10.1207/S1532768XJEPC1401_01CrossRefGoogle Scholar
  8. Allen, J. D., Shelton, R. C., Emmons, K. M., & Linnan, L. A. (2018). Fidelity and its relationship to implementation, effectiveness, adaptation, and dissemination. In R. C. Brownson, G. A. Colditz, & E. K. Proctor (Eds.), Dissemination and implementation research in health: Translating science to practice (2nd ed., pp. 267–284). New York, NY: Oxford University Press.Google Scholar
  9. APA Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61(4), 271–285.  https://doi.org/10.1037/0003-066x.61.4.271CrossRefGoogle Scholar
  10. Baldwin, J. A., Johnson, J. L., & Benally, C. C. (2009). Building partnerships between indigenous communities and universities: Lessons learned in HIV/AIDS and substance abuse prevention research. American Journal of Public Health, 99(Suppl 1), S77–S82.  https://doi.org/10.2105/ajph.2008.134585CrossRefPubMedPubMedCentralGoogle Scholar
  11. Baumann, A. A., Cabassa, L. J., & Stirman, S. W. (2018). Adaptation in dissemination and implementation science. In R. C. Brownson, G. A. Colditz, & E. K. Proctor (Eds.), Dissemination and implementation research in health: Translating science to practice (2nd ed., pp. 285–300). New York, NY: Oxford University Press.Google Scholar
  12. Baumbusch, J. L., Kirkham, S. R., Khan, K. B., McDonald, H., Semeniuk, P., Tan, E., & Anderson, J. M. (2008). Pursuing common agendas: A collaborative model for knowledge translation between research and practice in clinical settings. Research in Nursing and Health, 31(2), 130–140.  https://doi.org/10.1002/nur.20242CrossRefPubMedGoogle Scholar
  13. Blase, K., Kiser, L., & Van Dyke, M. (2013). The Hexagon Tool: Exploring context. Chapel Hill, NC: National Implementation Research Network, FPG Child Development Institute, University of North Carolina at Chapel Hill. https://www.pbis.org/Common/Cms/files/pbisresources/NIRN-Education-TheHexagonTool.pdfGoogle Scholar
  14. Bond, G. R., Evans, L., Salyers, M. P., Williams, J., & Kim, H. W. (2000). Measurement of fidelity in psychiatric rehabilitation. Mental Health Services Research, 2(2), 75–87.  https://doi.org/10.1023/A:1010153020697CrossRefPubMedGoogle Scholar
  15. Bruns, E. (2008). Measuring wraparound fidelity. The resource guide to wraparound. Portland, OR: Portland State University, National Wraparound Initiative, Research and Training Center on Family Support and Children’s Mental Health. http://depts.washington.edu/wrapeval/sites/default/files/Bruns-5e.1-%28measuring-fidelity%29.pdfGoogle Scholar
  16. Burton, D. L., Levin, B. L., Massey, T., Baldwin, J., & Williamson, H. (2016). Innovative graduate research education for advancement of implementation science in adolescent behavioral health. Journal of Behavioral Health Services and Research, 43(2), 172–186.  https://doi.org/10.1007/s11414-015-9494-3CrossRefPubMedGoogle Scholar
  17. Cabassa, L. J., & Baumann, A. A. (2013). A two-way street: Bridging implementation science and cultural adaptations of mental health treatments. Implementation Science, 8, 90.  https://doi.org/10.1186/1748-5908-8-90CrossRefPubMedGoogle Scholar
  18. Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2, 40.  https://doi.org/10.1186/1748-5908-2-40CrossRefPubMedGoogle Scholar
  19. Carvalho, M. L., Honeycutt, S., Escoffery, C., Glanz, K., Sabbs, D., & Kegler, M. C. (2013). Balancing fidelity and adaptation: Implementing evidence-based chronic disease prevention programs. Journal of Public Health Management and Practice, 19(4), 348–356.  https://doi.org/10.1097/PHH.0b013e31826d80ebCrossRefPubMedGoogle Scholar
  20. Castro, F. G., Barrera, M., Jr., & Martinez, C. R., Jr. (2004). The cultural adaptation of prevention interventions: Resolving tensions between fidelity and fit. Prevention Science, 5(1), 41–45.  https://doi.org/10.1023/B:PREV.0000013980.12412.cdCrossRefPubMedGoogle Scholar
  21. Center for Substance Abuse Treatment. (2007). Understanding evidence-based practices for co-occurring disorders: Overview paper 5 (DHHS Publication No. (SMA) 07–4278). Rockville, MD: Substance Abuse and Mental Health Services Administration, Center for Mental Health Services, Center for Substance Abuse Treatment. http://purl.access.gpo.gov/GPO/LPS84453
  22. Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8, 117.  https://doi.org/10.1186/1748-5908-8-117CrossRefPubMedGoogle Scholar
  23. Chambers, D. A., & Norton, W. E. (2016). The adaptome: Advancing the science of intervention adaptation. American Journal of Preventive Medicine, 51(4 Suppl 2), S124–S131.  https://doi.org/10.1016/j.amepre.2016.05.011CrossRefPubMedPubMedCentralGoogle Scholar
  24. Chaudoir, S. R., Dugan, A. G., & Barr, C. H. (2013). Measuring factors affecting implementation of health innovations: A systematic review of structural, organizational, provider, patient, and innovation level measures. Implementation Science, 8, 22.  https://doi.org/10.1186/1748-5908-8-22CrossRefPubMedGoogle Scholar
  25. Chorpita, B. F., Daleiden, E. L., & Weisz, J. R. (2005). Identifying and selecting the common elements of evidence based interventions: A distillation and matching model. Mental Health Services Research, 7(1), 5–20.  https://doi.org/10.1007/s11020-005-1962-6CrossRefPubMedGoogle Scholar
  26. Cooper, B. R., Bumbarger, B. K., & Moore, J. E. (2015). Sustaining evidence-based prevention programs: Correlates in a large-scale dissemination initiative. Prevention Science, 16(1), 145–157.  https://doi.org/10.1007/s11121-013-0427-1CrossRefPubMedGoogle Scholar
  27. Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50.  https://doi.org/10.1186/1748-5908-4-50CrossRefGoogle Scholar
  28. Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18(1), 23–45.  https://doi.org/10.1016/S0272-7358(97)00043-3CrossRefPubMedGoogle Scholar
  29. Deschênes, N., Clark, H. B., & Herrygers, J. (2008). The development of fidelity measures for youth transition programs. In C. Newman, C. Liberton, K. Kutash, & R. M. Friedman (Eds.), The 20th annual research conference proceedings: A system of care for children’s mental health: Expanding the research base (pp. 333–338). Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, Research and Training Center for Children’s Mental Health. http://rtckids.fmhi.usf.edu/rtcconference/proceedings/20thproceedings/20thChapter10.pdfGoogle Scholar
  30. Dovidio, J. F., Penner, L. A., Albrecht, T. L., Norton, W. E., Gaertner, S. L., & Shelton, J. N. (2008). Disparities and distrust: The implications of psychological processes for understanding racial disparities in health and health care. Social Science and Medicine, 67(3), 478–486.  https://doi.org/10.1016/j.socscimed.2008.03.019CrossRefPubMedGoogle Scholar
  31. Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3–4), 327–350.  https://doi.org/10.1007/s10464-008-9165-0CrossRefPubMedGoogle Scholar
  32. Feldstein, A. C., & Glasgow, R. E. (2008). A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Joint Commission Journal on Quality and Patient Safety, 34(4), 228–243.  https://doi.org/10.1016/S1553-7250(08)34030-6CrossRefPubMedGoogle Scholar
  33. Fixsen, D. L., Blase, K. A., Naoom, S. F., & Wallace, F. (2009). Core implementation components. Research on Social Work Practice, 19(5), 531–540.  https://doi.org/10.1177/1049731509335549CrossRefGoogle Scholar
  34. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature (FMHI Publication No. 231). Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, National Implementation Research Network. https://nirn.fpg.unc.edu/sites/nirn.fpg.unc.edu/files/resources/NIRN-MonographFull-01-2005.pdf
  35. Gonzales, J. J., Ringeisen, H. L., & Chambers, D. A. (2002). The tangled and thorny path of science to practice: Tensions in interpreting and applying “evidence”. Clinical Psychology: Science and Practice, 9(2), 204–209.  https://doi.org/10.1093/clipsy/9.2.204CrossRefGoogle Scholar
  36. Green, L. W. (2008). Making research relevant: If it is an evidence-based practice, where’s the practice-based evidence? Family Practice, 25(Suppl 1), i20–i24.  https://doi.org/10.1093/fampra/cmn055CrossRefPubMedGoogle Scholar
  37. Green, L. W., & Glasgow, R. E. (2006). Evaluating the relevance, generalization, and applicability of research: Issues in external validation and translation methodology. Evaluation and the Health Professions, 29(1), 126–153.  https://doi.org/10.1177/0163278705284445CrossRefPubMedGoogle Scholar
  38. Green, L. W., Ottoson, J. M., Garcia, C., & Hiatt, R. A. (2009). Diffusion theory and knowledge dissemination, utilization, and integration in public health. Annual Review of Public Health, 30, 151–174.  https://doi.org/10.1146/annurev.publhealth.031308.100049CrossRefPubMedGoogle Scholar
  39. Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Quarterly, 82(4), 581–629.  https://doi.org/10.1111/j.0887-378X.2004.00325.xCrossRefPubMedGoogle Scholar
  40. Guevara, M., & Solomon, E. (2009). Implementing evidence-based policy and practice in community corrections. Washington, DC: U.S. Department of Justice, National Corrections Institute. https://s3.amazonaws.com/static.nicic.gov/Library/024107.pdfGoogle Scholar
  41. Harn, B., Parisi, D., & Stoolmiller, M. (2013). Balancing fidelity with flexibility and fit: What do we really know about fidelity of implementation in schools? Exceptional Children, 79(3), 181–193.  https://doi.org/10.1177/001440291307900204CrossRefGoogle Scholar
  42. Hernandez, M., Worthington, J., & Davis, C. S. (2005). Measuring the fidelity of service planning and delivery to system of care principles: The system of care practice review (SOCPR) (Making children’s mental health services successful series; FMHI Publication #223-1). Tampa, FL. http://rtckids.fmhi.usf.edu/rtcpubs/SOCPR/SOCPR-Monograph.pdf
  43. Hoagwood, K., Burns, B. J., Kiser, L., Ringeisen, H., & Schoenwald, S. K. (2001). Evidence-based practice in child and adolescent mental health services. Psychiatric Services, 52(9), 1179–1189.  https://doi.org/10.1176/appi.ps.52.9.1179CrossRefPubMedGoogle Scholar
  44. Hoagwood, K., & Johnson, J. (2003). School psychology: A public health framework I. From evidence-based practices to evidence-based policies. Journal of School Psychology, 41(1), 3–21.  https://doi.org/10.1016/s0022-4405(02)00141-3CrossRefGoogle Scholar
  45. Hunter, S. B., Han, B., Slaughter, M. E., Godley, S. H., & Garner, B. R. (2017). Predicting evidence-based treatment sustainment: Results from a longitudinal study of the Adolescent-Community Reinforcement Approach. Implementation Science, 12(1), 75.  https://doi.org/10.1186/s13012-017-0606-8CrossRefPubMedGoogle Scholar
  46. Isett, K. R., Burnam, M. A., Coleman-Beattie, B., Hyde, P. S., Morrissey, J. P., Magnabosco, J., … Goldman, H. H. (2007). The state policy context of implementation issues for evidence-based practices in mental health. Psychiatric Services, 58(7), 914–921.  https://doi.org/10.1176/ps.2007.58.7.914CrossRefPubMedGoogle Scholar
  47. Iwelunmor, J., Blackstone, S., Veira, D., Nwaozuru, U., Airhihenbuwa, C., Munodawafa, D., … Ogedegebe, G. (2016). Toward the sustainability of health interventions implemented in sub-Saharan Africa: A systematic review and conceptual framework. Implementation Science, 11, 43.  https://doi.org/10.1186/s13012-016-0392-8CrossRefPubMedGoogle Scholar
  48. Kazdin, A. E. (2000). Psychotherapy for children and adolescents: Directions for research and practice. New York, NY: Oxford University Press.CrossRefGoogle Scholar
  49. Kazdin, A. E. (2008). Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. American Psychologist, 63(3), 146–159.  https://doi.org/10.1037/0003-066x.63.3.146CrossRefGoogle Scholar
  50. Lee, S. J., Altschul, I., & Mowbray, C. T. (2008). Using planned adaptation to implement evidence-based programs with new populations. American Journal of Community Psychology, 41(3–4), 290–303.  https://doi.org/10.1007/s10464-008-9160-5CrossRefPubMedGoogle Scholar
  51. Lehman, W. E., Greener, J. M., & Simpson, D. D. (2002). Assessing organizational readiness for change. Journal of Substance Abuse Treatment, 22(4), 197–209.  https://doi.org/10.1016/S0740-5472(02)00233-7CrossRefPubMedGoogle Scholar
  52. Lendrum, A., Humphrey, N., & Greenberg, M. (2016). Implementing for success in school-based mental health promotion: The role of quality in resolving the tension between fidelity and adaptation. In R. H. Shute & P. T. Slee (Eds.), Mental health and wellbeing through schools: The way forward (pp. 53–63). London: Routledge.Google Scholar
  53. Lieberman, R., Zubritsky, C., Martínez, K., Massey, O. T., Fisher, S., Kramer, T., … Obrochta, C. (2011, February). Issue brief: Using practice-based evidence to complement evidence-based practice in children’s behavioral health. Atlanta, GA: ICF Macro, Outcomes Roundtable for Children and Families. http://cfs.cbcs.usf.edu/_docs/publications/OutcomesRoundtableBrief.pdf
  54. Massey, O. T., Armstrong, K., Boroughs, M., Henson, K., & McCash, L. (2005). Mental health services in schools: A qualitative analysis of challenges to implementation, operation, and sustainability. Psychology in the Schools, 42(4), 361–372.  https://doi.org/10.1002/pits.20063CrossRefGoogle Scholar
  55. McDonald, P. W., & Viehbeck, S. (2007). From evidence-based practice making to practice-based evidence making: Creating communities of (research) and practice. Health Promotion Practice, 8(2), 140–144.  https://doi.org/10.1177/1524839906298494CrossRefPubMedGoogle Scholar
  56. Minkler, M., & Wallerstein, N. (2013). Introduction to community-based participatory research: New issues and emphases. In M. Minkler & N. Wallerstein (Eds.), Community-based participatory research for health: From process to outcomes (5th ed., pp. 5–24). San Francisco, CA: Jossey-Bass. http://rbdigital.oneclickdigital.comGoogle Scholar
  57. Moore, J. E., Mascarenhas, A., Bain, J., & Straus, S. E. (2017). Developing a comprehensive definition of sustainability. Implementation Science, 12(1), 110.  https://doi.org/10.1186/s13012-017-0637-1CrossRefPubMedGoogle Scholar
  58. Morrison, D. M., Hoppe, M. J., Gillmore, M. R., Kluver, C., Higa, D., & Wells, E. A. (2009). Replicating an intervention: The tension between fidelity and adaptation. AIDS Education and Prevention, 21(2), 128–140.  https://doi.org/10.1521/aeap.2009.21.2.128CrossRefPubMedPubMedCentralGoogle Scholar
  59. Murray, L. K., Dorsey, S., Skavenski, S., Kasoma, M., Imasiku, M., Bolton, P., … Cohen, J. A. (2013). Identification, modification, and implementation of an evidence-based psychotherapy for children in a low-income country: The use of TF-CBT in Zambia. International Journal of Mental Health Systems, 7(1), 24.  https://doi.org/10.1186/1752-4458-7-24CrossRefPubMedPubMedCentralGoogle Scholar
  60. National Implementation Research Network. (2015). Implementation stages. [Web page]. Chapel Hill, NC: University of North Carolina, Chapel Hill, FPG Child Development Institute, The National Implementation Research Network. https://nirn.fpg.unc.edu/learn-implementation/implementation-stages
  61. Nilsen, P. (2015). Making sense of implementation theories, models and frameworks. Implementation Science, 10, 53.  https://doi.org/10.1186/s13012-015-0242-0CrossRefPubMedGoogle Scholar
  62. Office of the Surgeon General. (1999). Mental health: A report of the Surgeon General. Rockville, MD: U. S. Department of Health and Human Services, U.S. Public Health Service. https://profiles.nlm.nih.gov/ps/retrieve/ResourceMetadata/NNBBHSGoogle Scholar
  63. President’s New Freedom Commission on Mental Health. (2003). Achieving the promise: Transforming mental health care in America: Final report (DHHS publication no.). Rockville, MD: U. S. Department of Health and Human Services. http://www.eric.ed.gov/PDFS/ED479836.pdf
  64. Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health, 36(1), 24–34.  https://doi.org/10.1007/s10488-008-0197-4CrossRefPubMedGoogle Scholar
  65. Pullmann, M. D., Bruns, E. J., & Sather, A. K. (2013). Evaluating fidelity to the wraparound service model for youth: Application of item response theory to the Wraparound Fidelity Index. Psychological Assessment, 25(2), 583–598.  https://doi.org/10.1037/a0031864CrossRefPubMedPubMedCentralGoogle Scholar
  66. Rabin, B. A., & Brownson, R. C. (2018). Terminology for dissemination and implementation research. In R. C. Brownson, G. A. Colditz, & E. K. Proctor (Eds.), Dissemination and implementation research in health: Translating science to practice (2nd ed., pp. 19–45). New York, NY: Oxford University Press.Google Scholar
  67. Rogers, E. M. (2003). Diffusion of innovations. New York, NY: Free Press.Google Scholar
  68. Sackett, D. L., Rosenberg, W. M., Gray, J. A., Haynes, R. B., & Richardson, W. S. (1996). Evidence based medicine: What it is and what it isn’t. BMJ, 312(7023), 71–72.  https://doi.org/10.1136/bmj.312.7023.71CrossRefPubMedPubMedCentralGoogle Scholar
  69. Saldana, L. (2014). The stages of implementation completion for evidence-based practice: Protocol for a mixed methods study. Implementation Science, 9(1), 43.  https://doi.org/10.1186/1748-5908-9-43CrossRefPubMedGoogle Scholar
  70. Saldana, L., Chamberlain, P., Wang, W., & Hendricks Brown, C. (2012). Predicting program start-up using the stages of implementation measure. Administration and Policy in Mental Health, 39(6), 419–425.  https://doi.org/10.1007/s10488-011-0363-yCrossRefPubMedPubMedCentralGoogle Scholar
  71. Scheirer, M. A. (2005). Is sustainability possible? A review and commentary on empirical studies of program sustainability. American Journal of Evaluation, 26(3), 320–347.  https://doi.org/10.1177/1098214005278752CrossRefGoogle Scholar
  72. Shelton, R. C., Cooper, B. R., & Stirman, S. W. (2018). The sustainability of evidence-based interventions and practices in public health and health care. Annual Review of Public Health, 39, 55–76.  https://doi.org/10.1146/annurev-publhealth-040617-014731CrossRefPubMedGoogle Scholar
  73. Stichter, J. P., Herzog, M. J., Owens, S. A., & Malugen, E. (2016). Manualization, feasibility, and effectiveness of the School-Based Social Competence Intervention for Adolescents (SCI-A). Psychology in the Schools, 53(6), 583–600.  https://doi.org/10.1002/pits.21928CrossRefGoogle Scholar
  74. Stirman, S. W., Miller, C. J., Toder, K., & Calloway, A. (2013). Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implementation Science, 8, 65.  https://doi.org/10.1186/1748-5908-8-65CrossRefPubMedGoogle Scholar
  75. Tabrizi, B. (2014, October). The key to change is middle management. Harvard Business Review. [Web page]. https://hbr.org/2014/10/the-key-to-change-is-middle-management
  76. Titler, M. G., Everett, L. Q., & Adams, S. (2007). Implications for implementation science. Nursing Research, 56(4 Suppl), S53–S59.  https://doi.org/10.1097/01.NNR.0000280636.78901.7fCrossRefPubMedGoogle Scholar
  77. Urban, J. B., & Trochim, W. (2009). The role of evaluation in research – Practice integration working toward the “golden spike”. American Journal of Evaluation, 30(4), 538–553.  https://doi.org/10.1177/1098214009348327CrossRefGoogle Scholar
  78. Walker, J. S., Koroloff, N. M., Schutte, K., & Portland State University. Research and Training Center on Family Support and Children’s Mental Health. (2003). Implementing high-quality collaborative individualized service/support planning: Necessary conditions. Portland, OR: Research and Training Center on Family Support and Children’s Mental Health, Portland State University. https://nwi.pdx.edu/NWI-book/Chapters/App-6f-Individualized-Service-And-Support%20Planning.pdfGoogle Scholar
  79. Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., … Saul, J. (2008). Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. American Journal of Community Psychology, 41(3–4), 171–181.  https://doi.org/10.1007/s10464-008-9174-zCrossRefPubMedGoogle Scholar
  80. Westfall, J. M., Mold, J., & Fagnan, L. (2007). Practice-based research – “Blue Highways” on the NIH roadmap. JAMA, 297(4), 403–406.  https://doi.org/10.1001/jama.297.4.403CrossRefPubMedGoogle Scholar
  81. Yampolskaya, S., Massey, O. T., & Greenbaum, P. E. (2006). At-risk high school students in the “Gaining Early Awareness and Readiness” Program (GEAR UP): Academic and behavioral outcomes. Journal of Primary Prevention, 27(5), 457–475.  https://doi.org/10.1007/s10935-006-0050-zCrossRefPubMedGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Department of Child and Family Studies, College of Behavioral and Community SciencesUniversity of South FloridaTampaUSA

Personalised recommendations