Abstract
Purpose
Peer providers represent a growing sector of the U.S. workforce, yet guidance is needed on best practices for adapting behavioral health interventions for peer delivery.
Methods
We utilized the Framework for Reporting Adaptations and Modifications to Evidence-based interventions (FRAME; Wiltsey Stirman et al. 2013, 2019) to describe how we systematically adapted Skills Training in Affective and Interpersonal Regulation (STAIR) for posttraumatic stress disorder (PTSD) for peer delivery. Our process was iterative and relied on engagement of multiple stakeholders, including a work group of organizational leaders (N = 5), peer interventionists (N = 4), intervention experts (N = 2), and trial participants (N = 18). The FRAME was used to guide rapid coding across multiple data sources, including researcher field notes, meeting minutes, and intervention manual documents, and content analysis of semi-structured interviews with peer interventionists and trial participants.
Results
Phase 1 (pre-trial) focused on modifications for fit with the local context and peer model. Key modifications focused on improving intervention design and packaging, removing clinical and stigmatizing language, and addressing peer interventionist training gaps. We used a hybrid approach to delivery, whereby we integrated peer model principles (self-disclosure, mutuality) into a directive approach. Phase 2 (trial) included reactive fidelity-consistent adaptations, such as additional educational resources. Phase 3 (post-trial) focused on adaptations to support roll-out of the intervention at the peer organization (e.g., group format).
Conclusion
Our stakeholder-engaged process may serve as a helpful exemplar to others tailoring interventions for peer delivery. Future research is needed to understand the role of stakeholder engagement and adaptation in implementation success.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data/Materials availability
Sarah Valentine will provide access to data and materials upon request.
References
Ahmad, I., Suleman, N., Waqas, A., Atif, N., Malik, A. A., Bibi, A., Zulfiqar, S., Nisar, A., Javed, H., Zaidi, A., Khan, Z. S., & Sikander, S. (2020). Measuring the implementation strength of a perinatal mental health intervention delivered by peer volunteers in rural Pakistan. Behaviour Research and Therapy, 130, 103559. https://doi.org/10.1016/j.brat.2020.103559.
Baumann, A. A., Domenech Rodríguez, M. M., Amador, N. G., Forgatch, M. S., & Parra-Cardona, J. R. (2014). Parent Management Training-Oregon Model (PMTOTM) in Mexico City: Integrating cultural adaptation activities in an implementation model. Clinical Psychology, 21(1), 32–47. https://doi.org/10.1111/cpsp.12059.
Barnett, M. L., Gonzalez, A., Miranda, J., Chavira, D. A., & Lau, A. S. (2018). Mobilizing community health workers to address mental health disparities for underserved populations: A systematic review. Administration and Policy in Mental Health and Mental Health Services Research, 45(2), 195–211. https://doi.org/10.1007/s10488-017-0815-0.
Beck, A. J., Page, C., Buche, J., Wayment, C., & Schoebel, V. (2019). Behavioral Health Service Provision by Primary Care Physicians (p. 4, Rep.). Ann Arbor, MI: School of Public Health Behavioral Health Workforce Resource Center, University of Michigan.
Boaz, A., Hanney, S., Borst, R., O’Shea, A., & Kok, M. (2018). How to engage stakeholders in research: Design principles to support improvement. Health Research Policy and Systems, 16(1), 60. https://doi.org/10.1186/s12961-018-0337-6.
Bowen, D. J., Hyams, T., Goodman, M., West, K. M., Harris-Wai, J., & Yu, J. H. (2017). Systematic review of quantitative measures of stakeholder engagement. Clinical and Translational Science, 10(5), 314–336. https://doi.org/10.1111/cts.12474.
Byrne, M. (2019). Increasing the impact of behavior change intervention research: Is there a role for stakeholder engagement? Health Psychology, 38(4), 290–296. https://doi.org/10.1037/hea0000723.
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8, 117. https://doi.org/10.1186/1748-5908-8-117.
Chambers, D. A., & Norton, W. E. (2016). The adaptome: Advancing the science of intervention adaptation. American Journal of Preventive Medicine, 51(4 Suppl 2), S124–S131. https://doi.org/10.1016/j.amepre.2016.05.011.
Chapin, R. K., Sergeant, J. F., Landry, S., Leedahl, S. N., Rachlin, R., Koenig, T., & Graham, A. (2013). Reclaiming joy: Pilot evaluation of a mental health peer support program for older adults who receive Medicaid. The Gerontologist, 53(2), 345–352. https://doi.org/10.1093/geront/gns120.
Chinman, M., Lucksted, A., Gresen, R., Davis, M., Losonczy, M., Sussner, B., & Martone, L. (2008). Early experiences of employing consumer-providers in the VA. Psychiatric Services, 59(11), 1315–1321. https://doi.org/10.1176/ps.2008.59.11.1315.
Cloitre, M., Koenen, K. C., Cohen, L. R., & Han, H. (2002). Skills training in affective and interpersonal regulation followed by exposure: A phase-based treatment for PTSD related to childhood abuse. Journal of Consulting and Clinical Psychology, 70(5), 1067–1074. https://doi.org/10.1037/0022-006X.70.5.1067.
Cloitre, M., Ortigo, K., & Gupta, C. (2016). Skills Training and Interpersonal Regulation for Primary Care (STAIR-PC). [Unpublished manual].
Cloitre, M., Stovall-McClough, K. C., Nooner, K., Zorbas, P., Cherry, S., Jackson, C. L., Gan, W., & Petkova, E. (2010). Treatment for PTSD related to childhood abuse: A randomized controlled trial. The American Journal of Psychiatry, 167(8), 915–924. https://doi.org/10.1176/appi.ajp.2010.09081247.
Concannon, T. W., Fuster, M., Saunders, T., Patel, K., Wong, J. B., Leslie, L. K., & Lau, J. (2014). A systematic review of stakeholder engagement in comparative effectiveness and patient-centered outcomes research. Journal of General Internal Medicine, 29(12), 1692–1701. https://doi.org/10.1007/s11606-014-2878-x.
Cook, J., Copeland, M., Floyd, C., Jonikas, J., Hamilton, M., Razzano, L., Carter, T. M., Hudson, W. B., Grey, D. D., & Boyd, S. (2012). A randomized controlled trial of effects of Wellness Recovery Action Planning on depression, anxiety, and recovery. Psychiatric Services, 63(6), 541–547. https://doi.org/10.1176/appi.ps.201100125.
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(1), 1–15. https://doi.org/10.1186/1748-5908-4-50.
Eddie, D., Hoffman, L., Vilsaint, C., Abry, A., Bergman, B., Hoeppner, B., Weinstein, C., & Kelly, J. F. (2019). Lived experience in new models of care for substance use disorder: A systematic review of peer recovery support services and recovery coaching. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2019.01052.
Escoffery, C., Lebow-Skelley, E., Haardoerfer, R., Boing, E., Udelson, H., Wood, R., Hartman, M., Fernandez, M. E., & Mullen, P. D. (2018). A systematic review of adaptations of evidence-based public health interventions globally. Implementation Science, 13(1), 125. https://doi.org/10.1186/s13012-018-0815-9.
Forehand, R., Dorsey, S., Jones, D. J., Long, N., & McMahon, R. J. (2010). Adherence and flexibility: They can (and do) coexist! Clinical Psychology: Science and Practice, 17(3), 258–264. https://doi.org/10.1111/j.1468-2850.2010.01217.x.
Glasgow, R. E., Battaglia, C., McCreight, M., Ayele, R. A., & Rabin, B. A. (2020). Making implementation science more rapid: Use of the RE-AIM Framework for mid-course adaptations across five health services research projects in the Veterans Health Administration. Frontiers in Public Health, 8, 194. https://doi.org/10.3389/fpubh.2020.00194.
Glasgow, R. E., & Chambers, D. (2012). Developing robust, sustainable, implementation systems using rigorous, rapid and relevant science. Clinical and Translational Science, 5(1), 48–55. https://doi.org/10.1111/j.1752-8062.2011.00383.x.
Hahm, H. C., Cook, B. L., Ault-Brutus, A., & Alegría, M. (2015). Intersection of race-ethnicity and gender in depression care: Screening, access, and minimally adequate treatment. Psychiatric Services, 66(3), 258–264. https://doi.org/10.1176/appi.ps.201400116.
Hall, G. C. N., Ibaraki, A. Y., Huang, E. R., Marti, C. N., & Stice, E. (2016). A meta-analysis of cultural adaptations of psychological interventions. Behavior Therapy, 47(6), 993–1014. https://doi.org/10.1016/j.beth.2016.09.005.
Harvey, G., Fitzgerald, L., Fielden, S., McBride, A., Waterman, H., Bamford, D., Kislov, R., & Boaden, R. (2011). The NIHR Collaborations for Leadership in Applied Health Research and Care (CLAHRC) for Greater Manchester: Combining empirical, theoretical and experiential evidence to design and evaluate a large-scale implementation strategy. Implementation Science, 6, 96. https://doi.org/10.1186/1748-5908-6-96.
Hofmann, S. G., Asnaani, A., Vonk, I. J., Sawyer, A. T., & Fang, A. (2012). The efficacy of cognitive behavioral therapy: A review of meta-analyses. Cognitive Therapy and Research, 36(5), 427–440. https://doi.org/10.1007/s10608-012-9476-1.
Hsieh, H., & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277–1288. https://doi.org/10.1177/1049732305276687.
Huey, S. J., Jr., Tilley, J. L., Jones, E. O., & Smith, C. A. (2014). The contribution of cultural competence to evidence-based care for ethnically diverse populations. Annual Review of Clinical Psychology, 10, 305–338. https://doi.org/10.1146/annurev-clinpsy-032813-153729.
Jain, S., Ortigo, K., Gimeno, J., Baldor, D. A., Weiss, B. J., & Cloitre, M. (2020). A randomized controlled trial of brief Skills Training in Affective and Interpersonal Regulation (STAIR) for Veterans in primary care. Journal of Traumatic Stress, 33(4), 401–409. https://doi.org/10.1002/jts.22523.
Jolibert, C., & Wesselink, A. (2012). Research impacts and impact on research in biodiversity conservation: The influence of stakeholder engagement. Environmental Science & Policy, 22, 100–111. https://doi.org/10.1016/j.envsci.2012.06.012.
Kaltman, S., Mendoza, A. H., Gonzales, F. A., & Serrano, A. (2014). Preferences for trauma-related mental health services among Latina immigrants from Central America, South America, and Mexico. Psychological Trauma: Theory, Research, Practice, and Policy, 6(1), 83–91. https://doi.org/10.1037/a0031539.
Karlin, B. E., & Cross, G. (2014). From the laboratory to the therapy room: National dissemination and implementation of evidence-based psychotherapies in the US Department of Veterans Affairs health care system. American Psychologist, 69(1), 19–33. https://doi.org/10.1037/a0033888.
Kazantzis, N., Whittington, C., Zelencich, L., Kyrios, M., Norton, P. J., & Hofmann, S. G. (2016). Quantity and quality of homework compliance: a meta-analysis of relations with outcome in cognitive behavior therapy. Behavior Therapy, 47(5), 755–772. https://doi.org/10.1016/j.beth.2016.05.002.
Kelly, P. J., Baker, A. L., Fagan, N. L., Turner, A., Deane, F., Mcketin, R., Callister, R., Collins, C., Ingram, I., Wolstencroft, K., Townsend, C., Osborne, B. A., & Zimmermann, A. (2020). Better health choices: Feasibility and preliminary effectiveness of a peer delivered healthy lifestyle intervention in a community mental health setting. Addictive Behaviors, 103, 106249. https://doi.org/10.1016/j.addbeh.2019.106249.
Kendall, P. C., & Frank, H. E. (2018). Implementing evidence-based treatment protocols: Flexibility within fidelity. Clinical Psychology, 25(4), e12271. https://doi.org/10.1111/cpsp.12271.
La Bash, H., Galovski, T., & Stirman, S. W. (2019). Adapting evidence-based psychotherapies while maintaining fidelity. Current Treatment Options in Psychiatry, 6(3), 198–209. https://doi.org/10.1007/s40501-019-00177-9.
MacArthur, G. J., Harrison, S., Caldwell, D. M., Hickman, M., & Campbell, R. (2016). Peer-led interventions to prevent tobacco, alcohol and/or drug use among young people aged 11–21 years: A systematic review and meta-analysis. Addiction, 111(3), 391–407. https://doi.org/10.1111/add.13224.
Magidson, J. F., Joska, J. A., Regenauer, K. S., Satinsky, E., Andersen, L. S., Seitz-Brown, C., Borba, C. P. C., Safren, S. A., & Myers, B. (2019). “Someone who is in this thing that I am suffering from”: The role of peers and other facilitators for task sharing substance use treatment in South African HIV care. International Journal of Drug Policy, 70, 61–69. https://doi.org/10.1016/j.drugpo.2018.11.004.
Marques, L., Valentine, S. E., Kaysen, D., Mackintosh, M. A., Dixon De Silva, L. E., Ahles, E. M., Youn, S. J., Shtasel, D. L., Simon, N. M., & Wiltsey-Stirman, S. (2019). Provider fidelity and modifications to cognitive processing therapy in a diverse community health clinic: Associations with clinical change. Journal of Consulting and Clinical Psychology, 87(4), 357–369. https://doi.org/10.1037/ccp0000384.
Miller, C. J., Wiltsey Stirman, S., & Baumann, A. A. (2020). Iterative Decision-making for Evaluation of Adaptations (IDEA): A decision tree for balancing adaptation, fidelity, and intervention impact. Journal of Community Psychology, 48(4), 1163–1177. https://doi.org/10.1002/jcop.22279.
Nathan, P. E., & Gorman, J. M. (Eds.). (2015). A guide to treatments that work. [eBook edition]. New York, NY: Oxford University Press. https://doi.org/https://doi.org/10.1093/med:psych/9780195304145.001.0001
National Council Medical Director Institute. (2017). The psychiatric shortage: Causes and solutions. Washington, D.C.: National Council for Behavioral Health. https://www.thenationalcouncil.org/wp-content/uploads/2017/03/Psychiatric-Shortage_National-Council-.pdf?daf=375ateTbd56
Neal, J. W., Neal, Z. P., VanDyke, E., & Kornbluh, M. (2015). Expediting the analysis of qualitative data in evaluation: A procedure for the Rapid Identification of Themes from Audio Recordings (RITA). American Journal of Evaluation, 36(1), 118–132. https://doi.org/10.1177/1098214014536601.
Nilsen, P. (2015). Making sense of implementation theories, models and frameworks. Implementation Science, 10, 53. https://doi.org/10.1186/s13012-015-0242-0.
O’Connell, M., Flanagan, E., Delphin-Rittmon, M., & Davidson, L. (2017). Enhancing outcomes for persons with co-occurring disorders through skills training and peer recovery support. Journal of Mental Health, 29(1), 6–11. https://doi.org/10.1080/09638237.2017.1294733.
Patton, M. Q. (2014). Qualitative research methods and evaluation methods: Integrating theory and practice (4th edition). SAGE Publications, Inc. [eBook edition]. https://us.sagepub.com/en-us/nam/qualitative-research-evaluation-methods/book232962.
Pitt, V., Lowe, D., Hill, S., Prictor, M., Hetrick, S. E., Ryan, R., & Berends, L. (2013). Consumer-providers of care for adult clients of statutory mental health services. Cochrane Database of Systematic Reviews. https://doi.org/10.1002/14651858.CD004807.pub2.
Puschner, B., Repper, J., Mahlke, C., Nixdorf, R., Basangwa, D., Nakku, J., Ryan, G., Baillie, D., Shamba, D., Ramesh, M., Moran, G., Lachmann, M., Kalha, J., Pathare, S., Müller-Stierlin, A., & Slade, M. (2019). Using Peer Support in Developing Empowering Mental Health Services (UPSIDES): Background, rationale and methodology. Annals of Global Health, 85(1). https://doi.org/https://doi.org/10.5334/aogh.2435
QSR International. (2018). NVivo 12 Pro (Version 12.5). https://www.qsrinternational.com/nvivo/nvivo-products/nvivo-12-pro
Raviola, G., Naslund, J. A., Smith, S. L., & Patel, V. (2019). Innovative models in mental health delivery systems: Task sharing care with non-specialist providers to close the mental health treatment gap. Current Psychiatry Reports, 21(6), 44. https://doi.org/10.1007/s11920-019-1028-x.
Russell, L. (2010). Mental health care services in primary care: Tackling the issues in the context of health care reform. Washington, D.C.: Center for American Progress. https://www.americanprogress.org/wp-content/uploads/issues/2010/10/pdf/mentalhealth.pdf
Santiago, C. D., Kaltman, S., & Miranda, J. (2013). Poverty and mental health: How do low income adults and children fare in psychotherapy? Journal of Clinical Psychology, 69(2), 115–126. https://doi.org/10.1002/jclp.21951.
Satinsky, E. N., Doran, K., Felton, J. W., Kleinman, M., Dean, D., & Magidson, J. F. (2020). Adapting a peer recovery coach-delivered behavioral activation intervention for problematic substance use in a medically underserved community in Baltimore City. PLoS ONE, 15(1), e0228084. https://doi.org/10.1371/journal.pone.0228084.
Shelton, R. C., Cooper, B. R., & Stirman, W. (2018). The sustainability of evidence-based interventions and practices in public health and health care. Annual Review of Public Health, 39, 55–76. https://doi.org/10.1146/annurev-publhealth-040617-014731.
Sikander, S., Lazarus, A., Bangash, O., Fuhr, D. C., Weobong, B., Krishna, R. N., Ahmad, I., Weiss, H. A., Price, L., Rahman, A., & Patel, V. (2015). The effectiveness and cost-effectiveness of the peer-delivered Thinking Healthy Programme for perinatal depression in Pakistan and India: The SHARE study protocol for randomised controlled trials. Trials, 16, 534. https://doi.org/10.1186/s13063-015-1063-9.
Sledge, W. H., Lawless, M., Sells, D., Wieland, M., O’Connell, M. J., & Davidson, L. (2011). Effectiveness of peer support in reducing readmissions of persons with multiple psychiatric hospitalizations. Psychiatric Services, 62(5), 541–544. https://doi.org/10.1176/ps.62.5.pss6205_0541.
Smith, A. M., Stewart, K., Baul, T., & Valentine, S. E. (2020). Peer delivery of a brief cognitive-behavioral treatment for posttraumatic stress disorder: A hybrid effectiveness-implementation pilot study. Journal of Clinical Psychology, 76(12), 2133–2154.
Sorsdahl, K., Myers, B., Ward, C. L., Matzopoulos, R., Mtukushe, B., Nicol, A., Cuijpers, P., & Stein, D. J. (2015). Adapting a blended motivational interviewing and problem-solving intervention to address risky substance use amongst South Africans. Psychotherapy Research, 25(4), 435–444. https://doi.org/10.1080/10503307.2014.897770.
STAIR Coach App. (2017). Veteran’s Administration Center for PTSD (Version 1.3) [Mobile application software]. http://itunes.apple.com
Substance Abuse and Mental Health Services Administration. (2019). Key substance use and mental health indicators in the United States: Results from the 2018 National Survey on Drug Use and Health (HHS Publication No. PEP19-5068, NSDUH Series H-54). Rockville, MD: Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration. https://www.samhsa.gov/data/sites/default/files/cbhsq-reports/NSDUHNationalFindingsReport2018/NSDUHNationalFindingsReport2018.pdf
Trachtenberg, M., Parsonage, M., Shepherd, G. & Boardman, J. (2013). Peer support in mental health: Is it good value for money? London, UK: Centre for Mental Health. https://www.researchgate.net/publication/308387803_Peer_support_in_mental_health_is_it_good_value_for_money
Valentine, S. E., Dixon, L., Borba, C. P., Shtasel, D. L., & Marques, L. (2016). Mental illness stigma and engagement in an implementation trial for Cognitive Processing Therapy at a diverse community health center: A qualitative investigation. International Journal of Culture and Mental Health, 9(2), 139–150. https://doi.org/10.1080/17542863.2015.1123742.
Vayachuta, P., Ratana-Ubol, A., & Soopunyo, W. (2019). Participatory action research for developing a lifelong education providing model for ‘out-of-school’ children and youth by community organizations. International Journal of Education and Psychology in the Community, 9, 56–70. https://search.proquest.com/openview/8329a48aada158ccaae9d95eb0c2a248/1?pq-origsite=gscholar&cbl=1606375
Wallerstein, N., & Duran, B. (2010). Community-based participatory research contributions to intervention research: The intersection of science and practice to improve health equity. American Journal of Public Health, 100 Suppl 1(Suppl 1), S40–S46. https://doi.org/https://doi.org/10.2105/AJPH.2009.184036
Wiltsey Stirman, S., Baumann, A. A., & Miller, C. J. (2019). The FRAME: An expanded framework for reporting adaptations and modifications to evidence-based interventions. Implementation Science, 14(1), 58. https://doi.org/10.1186/s13012-019-0898-y.
Wiltsey Stirman, S., Gutner, C., Edmunds, J., Evans, A. C., & Beidas, R. (2015). Relationships between clinician-level attributes and fidelity-consistent and fidelity-inconsistent modifications to an evidence-based psychotherapy. Implementation Science. https://doi.org/10.1186/s13012-015-0308-z.
Wiltsey Stirman, S., Miller, C. J., Toder, K., & Calloway, A. (2013). Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implementation Science, 8, 65. https://doi.org/10.1186/1748-5908-8-65.
Funding
This pilot study, awarded to Dr. Valentine, was funded by Boston University Clinical and Translational Science Institute (BUCTSI) Integrated Pilot Grant Program and the National Institute of Health [NIH: 1UL1TR001430]. Dr. Valentine’s time was supported by the National Institute of Mental Health [NIMH: K23MH117221], and Dr. Ametaj’s time was supported by NIMH [T32MH17119-33]. We would like to thank the Metro Boston Recovery Learning Community, intervention experts, and trial participants for their feedback and support in tailoring the intervention for peer delivery.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by Sarah Valentine, Amantia Ametaj, and Ash Smith. The first draft of the manuscript was written by Amantia Ametaj and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflicts of interest
The authors have no relevant financial or non-financial interests to disclose.
Ethics approval
All procedures involving human participants performed in the current study were in accordance with the ethical standards of the institutional research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. The study was approved by the Boston University Medical Campus and Boston Medical Center Institutional Review Board.
Consent to participate
Informed consent was obtained from all individual participants included in the study.
Consent to publish
Informed consent obtained from all participants included permission to publish their data.
Standards of reporting
COnsolidated criteria for REporting Qualitative research (COREQ).
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ametaj, A.A., Smith, A.M. & Valentine, S.E. A Stakeholder-Engaged Process for Adapting an Evidence-Based Intervention for Posttraumatic Stress Disorder for Peer Delivery. Adm Policy Ment Health 48, 793–809 (2021). https://doi.org/10.1007/s10488-021-01129-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-021-01129-3