Abstract
To design PARTNER-MH, a peer-led, patient navigation program for implementation in Veterans Health Administration (VHA) mental health care settings, we conducted a pre-implementation evaluation during intervention development to assess stakeholders’ views of the intervention and to explore implementation factors critical to its future adoption. This is a convergent mixed-methods study that involved qualitative semi-structured interviews and survey data. Data collection was guided by the Consolidated Framework for Implementation Research (CFIR). We interviewed and administered the surveys to 23 peers and 10 supervisors from 12 midwestern VHA facilities. We used deductive and inductive approaches to analyze the qualitative data. We also conducted descriptive analysis and Fisher Exact Test to compare peers and supervisors’ survey responses. We triangulated findings to refine the intervention. Overall, participants viewed PARTNER-MH favorably. However, they saw the intervention’s focus on minority Veterans and social determinants of health framework as potential barriers, believing this could negatively affect the packaging of the intervention, complicate its delivery process, and impact its adoption. They also viewed clinic structures, available resources, and learning climate as potential barriers. Peers and supervisors’ selections and discussions of CFIR items were similar. Our findings informed PARTNER-MH development and helped identify factors that could impact its implementation. This project is responsive to the increasing recognition of the need to incorporate implementation science in healthcare disparities research. Understanding the resistance to the intervention’s focus on minority Veterans and the potential barriers presented by contextual factors positions us to adjust the intervention prior to testing, in an effort to maximize implementation success.
Similar content being viewed by others
Data Availability
The datasets during and/or analyzed during the current study available from the corresponding author on reasonable request.
References
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23.
Ali-Faisal, S. F., Colella, T. J., Medina-Jaudes, N., & Benz, S. L. (2017). The effectiveness of patient navigation to improve healthcare utilization outcomes: A meta-analysis of randomized controlled trials. Patient Education and Counseling, 100(3), 436–448.
Armstrong, K., Hughes-Halbert, C., & Asch, D. A. (2006). Patient preferences can be misleading as explanations for racial disparities in health care. Archives of Internal Medicine, 166(9), 950–954.
Ayanian, J. Z., Zaslavsky, A. M., Arora, N. K., Kahn, K. L., Malin, J. L., Ganz, P. A., et al. (2010). Patients' experiences with care for lung cancer and colorectal cancer: Findings from the cancer care outcomes research and surveillance consortium. Journal of Clinical Oncology., 28(27), 4154.
Bandura, A. (1989). Human agency in social cognitive theory. American Psychologist, 44(9), 1175.
Beach, M. C., Saha, S., Korthuis, P. T., Sharp, V., Cohn, J., Wilson, I. B., et al. (2011). Patient–provider communication differs for black compared to white HIV-infected patients. AIDS and Behavior, 15(4), 805–811.
Bieling, P. J., Madsen, V., & Zipursky, R. B. (2013). A 'navigator' model in emerging mental illness? Early Intervention in Psychiatry, 7(4), 451–457.
Boren, S. A., & Balas, A. E. (1999). Evidence-based quality measurement. The Journal of Ambulatory Care Management, 22(3), 17–23.
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3, 77–101.
Cabassa, L. J., & Stefancic, A. (2019). Context before implementation: A qualitative study of decision makers' views of a peer-led healthy lifestyle intervention for people with serious mental illness in supportive housing. Translational Behavioral Medicine, 9(2), 217–226.
Carpenter-Song, E., Whitley, R., Lawson, W., Quimby, E., & Drake, R. E. (2011). Reducing disparities in mental health care: Suggestions from the Dartmouth-Howard collaboration. Community Mental Health Journal, 47(1), 1–13.
Charlson, F. J., Baxter, A. J., Dua, T., Degenhardt, L., Whiteford, H. A., & Vos, T. (2015). Excess mortality from mental, neurological and substance use disorders in the Global Burden of Disease Study 2010. Epidemiology and Psychiatric Sciences, 24(2), 121–140.
Chinman, M., George, P., Dougherty, R. H., Daniels, A. S., Ghose, S. S., Swift, A., et al. (2014). Peer support services for individuals with serious mental illnesses: Assessing the evidence. Psychiatric Services (Washington, DC)., 65(4), 429–441.
Chinman, M., McCarthy, S., Mitchell-Miland, C., Bachrach, R. L., Schutt, R. K., & Ellison, M. (2019). Predicting Engagement With Mental Health Peer Specialist Services. Psychiatric Services (Washington, DC)., 70(4), 333–336.
Clark, C. R., Baril, N., Kunicki, M., Johnson, N., Soukup, J., Ferguson, K., et al. (2009). Addressing social determinants of health to improve access to early breast cancer detection: Results of the Boston REACH 2010 Breast and Cervical Cancer Coalition Women's Health Demonstration Project. Journal of Women’s Health (Larchmt), 18(5), 677–690.
Cook, B. L., McGuire, T., & Miranda, J. (2007). Measuring trends in mental health care disparities, 2000–2004. Psychiatric Services, 58(12), 1533–1540.
Cook, B. L., Trinh, N. H., Li, Z., Hou, S. S., & Progovac, A. M. (2017). Trends in racial-ethnic disparities in access to mental health care, 2004–2012. Psychiatric Services (Washington, DC), 68(1), 9–16.
Corp, I. (2016). IBM SPSS Statistics for Windows, Version 24.0. Armonk, NY: IBM Corp.
Creswell, J. W., & Clark, V. L. P. (2017). Designing and conducting mixed methods research. Los Angeles: Sage Publications.
Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012). Effectiveness-implementation hybrid designs: Combining elements of clinical effectiveness and implementation research to enhance public health impact. Medical Care, 50(3), 217.
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50.
Diette, G. B., & Rand, C. (2007). The contributing role of health-care communication to health disparities for minority patients with asthma. Chest, 132(5 Suppl), 802S–S809.
Dobalian, A., & Rivers, P. A. (2008). Racial and ethnic disparities in the use of mental health services. The Journal of Behavioral Health Services & Research, 35(2), 128–141.
Eggly, S., Barton, E., Winckles, A., Penner, L. A., & Albrecht, T. L. (2015). A disparity of words: Racial differences in oncologist–patient communication about clinical trials. Health Expectations, 18(5), 1316–1326.
Eldredge, L. K. B., Markham, C. M., Ruiter, R. A., Fernández, M. E., Kok, G., & Parcel, G. S. (2016). Planning health promotion programs: An intervention mapping approach. New York: Wiley.
Eliacin, J., Coffing, J. M., Matthias, M. S., Burgess, D. J., Bair, M. J., & Rollins, A. L. (2018). The Relationship between race, patient activation, and working alliance: Implications for patient engagement in mental health care. Administration and Policy In Mental Health, 45(1), 186–192.
Eliacin, J., Rollins, A. L., Burgess, D. J., Salyers, M. P., & Matthias, M. S. (2016a). Engaging African-American veterans in mental health care: Patients’ perspectives. The Journal of Nervous and Mental Disease, 204(4), 254–260.
Eliacin, J., Rollins, A. L., Burgess, D. J., Salyers, M. P., & Matthias, M. S. (2016b). Patient activation and visit preparation in African American veterans receiving mental health care. Cultural Diversity and Ethnic Minority Psychology, 22, 580.
Eneanya, N. D., Winter, M., Cabral, H., Waite, K., Henault, L., Bickmore, T., et al. (2016). Health literacy and education as mediators of racial disparities in patient activation within an elderly patient cohort. Journal of Health Care for the Poor and Underserved, 27(3), 1427–1440.
Fisher, R. A. (1934). Statistical Methods for Research Workers (5th ed.). New York: Springer.
Freeman, H. P. (2006). Patient navigation: A community centered approach to reducing cancer mortality. Journal of Cancer Education, 21(1 Suppl), S11–S14.
Freeman, H. P., & Rodriguez, R. L. (2011). History and principles of patient navigation. Cancer, 117(15 Suppl), 3539–3542.
Freimuth, V. S., & Quinn, S. C. (2004). The contributions of health communication to eliminating health disparities. American Journal of Public Health, 94(12), 2053–2055.
Gaglio, B., Shoup, J. A., & Glasgow, R. E. (2013). The RE-AIM framework: A systematic review of use over time. American Journal of Public Health, 103(6), e38–e46.
Ghods, B. K., Roter, D. L., Ford, D. E., Larson, S., Arbelaez, J. J., & Cooper, L. A. (2008). Patient–physician communication in the primary care visits of African Americans and Whites with depression. Journal of General Internal Medicine, 23(5), 600–606.
Gordon, H. S., Street, R. L., Jr., Kelly, P. A., Souchek, J., & Wray, N. P. (2005). Physician–patient communication following invasive procedures: An analysis of post-angiogram consultations. Social Science & Medicine, 61(5), 1015–1025.
Gordon, H. S., Street, R. L., Jr., Sharf, B. F., & Souchek, J. (2006). Racial differences in doctors' information-giving and patients' participation. Cancer, 107(6), 1313–1320.
Green, L. W., Ottoson, J. M., Garcia, C., & Hiatt, R. A. (2009). Diffusion theory and knowledge dissemination, utilization, and integration in public health. Annual Review of Public Health, 30, 151.
Harris, P. A., Taylor, R., Thielke, R., Payne, J., Gonzalez, N., & Conde, J. G. (2009). Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. Journal of Biomedical Informatics, 42(2), 377–381.
Hibbard, J. H., Greene, J., Becker, E. R., Roblin, D., Painter, M. W., Perez, D. J., et al. (2008). Racial/ethnic disparities and consumer activation in health. Health Affairs, 27(5), 1442–1453.
Izquierdo, A., Ong, M., Jones, F., Jones, L., Ganz, D., & Rubenstein, L. (2018). Engaging African American veterans with health care access challenges in a community partnered care coordination initiative: a qualitative needs assessment. Ethnicity & Disease, 28(Suppl 2), 475.
Jones, P. S., & Meleis, A. I. (1993). Health is empowerment. Advances in nursing science, 15, 1–14.
Joosten, Y. A., Israel, T. L., & Williams, N. A., et al. (2015). Community engagement studios: A structured approach to obtaining meaningful input from stakeholders to inform research. Academic Medicine, 90(12), 1646–1650.
Kessler, R. C., Nelson, C. B., McGonagle, K. A., Liu, J., Swartz, M., & Blazer, D. G. (1996). Comorbidity of DSM–III–R major depressive disorder in the general population: results from the US National Comorbidity Survey. The British Journal of Psychiatry., 168(S30), 17–30.
Kilbourne, A. M., Neumann, M. S., Pincus, H. A., Bauer, M. S., & Stall, R. (2007). Implementing evidence-based interventions in health care: Application of the replicating effective programs framework. Implementation Science, 2, 42.
Lagisetty, P. A., Ross, R., Bohnert, A., Clay, M., & Maust, D. T. (2019). Buprenorphine treatment divide by race/ethnicity and payment. JAMA Psychiatry, 76(9), 979–981.
Lasser, K. E., Himmelstein, D. U., Woolhandler, S. J., McCormick, D., & Bor, D. H. (2002). Do minorities in the United States receive fewer mental health services than whites? International Journal of Health Services, 32(3), 567–578.
LaVeist, T. A., & Nuru-Jeter, A. (2002). Is doctor-patient race concordance associated with greater satisfaction with care? Journal of Health and Social Behavior, 43, 296–306.
Leyva, B., Persoskie, A., Ottenbacher, A., Hamilton, J. G., Allen, J. D., Kobrin, S. C., et al. (2016). Do men receive information required for shared decision making about PSA testing? Results from a national survey. Journal of Cancer Education, 31(4), 693–701.
Lincoln, Y. E. G. (1985). Naturalistic inquiry (pp. 334–341). Beverly Hills, CA: Sage Publications Inc.
Ltd. QIP (2018) NVivo qualitative data analysis software version 12
Lyon, A. R., Cook, C. R., Duong, M. T., Nicodimos, S., Pullmann, M. D., Brewer, S. K., et al. (2019). The influence of a blended, theoretically-informed pre-implementation strategy on school-based clinician implementation of an evidence-based trauma intervention. Implementation Science, 14(1), 54.
Maura, J., & Weisman de Mamani, A. (2017). Mental health disparities treatment engagementand attrition among racial/ethnic minorities with severe mental illness: A review. Journal of Clinical Psychology in Medical Settings, 24(3–4), 187–210.
McCarthy, S., Chinman, M., Mitchell-Miland, C., Schutt, R. K., Zickmund, S., & Ellison, M. L. (2019). Peer specialists: Exploring the influence of program structure on their emerging role. Psychological services, 16(3), 445–455.
McLaughlin, C. G. (2004). Delays in treatment for mental disorders and health insurance coverage. Health Services Research, 39(2), 221–224.
Morris, Z. S., Wooding, S., & Grant, J. (2011). The answer is 17 years, what is the question: Understanding time lags in translational research. Journal of the Royal Society of Medicine., 104(12), 510–520.
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Rabin, B., & Aarons, G. A. (2019). Systematic review of the exploration, preparation, implementation, sustainment (EPIS) framework. Implementation Science, 14(1), 1.
Nowell, L. S., Norris, J. M., White, D. E., & Moules, N. J. (2017). Thematic analysis: Striving to meet the trustworthiness criteria. International Journal of Qualitative Methods, 16(1), 1609406917733847.
Olfson, M., Cherry, D. K., & Lewis-Fernández, R. (2009). Racial differences in visit duration of outpatient psychiatric visits. Archives of General Psychiatry, 66(2), 214–221.
Onken, L., Carroll, K., Shoham, V., Cuthbert, B., & Riddle, M. (2014). Reenvisioning clinical science: Unifying the discipline to improve the public health. Clinical Psychological Science, 2, 22–34.
Paddison, C. A., Elliott, M. N., Haviland, A. M., Farley, D. O., Lyratzopoulos, G., Hambarsoomian, K., et al. (2013). Experiences of care among Medicare beneficiaries with ESRD: Medicare Consumer assessment of healthcare providers and systems (CAHPS) survey results. American Journal of Kidney Diseases, 61(3), 440–449.
Pratt-Chapman, M., Willis, L. A., & Masselink, L. (2014). Core competencies for non-clinically licensed patient navigators. Washington D. C.: The George Washington University Cancer Institute Center for the Advancement of Cancer Survivorship, Navigation and Policy.
Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research., 36(1), 24–34.
Retkin, R., Antoniadis, D., Pepitone, D. F., & Duval, D. (2013). Legal services: A necessary component of patient navigation. Seminars in Oncology Nursing, 29(2), 149–155.
Rosario, E. R., Espinoza, L., Kaplan, S., Khonsari, S., Thurndyke, E., Bustos, M., et al. (2017). Patient navigation for traumatic brain injury promotes community re-integration and reduces re-hospitalizations. Brain Injury, 31(10), 1340–1347.
Rosenstock, I. M., Strecher, V. J., & Becker, M. H. (1988). Social learning theory and the Health Belief Model. Health Education Quarterly, 15(2), 175–183. https://doi.org/10.1177/109019818801500203.
Savelberg, W., Moser, A., Smidt, M., Boersma, L., Haekens, C., & van der Weijden, T. (2015). Protocol for a pre-implementation and post-implementation study on shared decision-making in the surgical treatment of women with early-stage breast cancer. British Medical Journal Open, 5(3), e007698.
Shen, M. J., Peterson, E. B., Costas-Muñiz, R., Hernandez, M. H., Jewell, S. T., Matsoukas, K., et al. (2018). The effects of race and racial concordance on patient-physician communication: A systematic review of the literature. Journal of Racial and Ethnic Health Disparities, 5(1), 117–140.
Smedley, B. D., Stith, A. Y., & Nelson, A. R. (2003). Racial and ethnic disparities in diagnosis and treatment: a review of the evidence and a consideration of causes. Unequal treatment: Confronting racial and ethnic disparities in health care. Washington: National Academies Press.
Solar, O., & Irwin, A. (2010). A conceptual framework for action on the social determinants of health. Social Determinants of Health Discussion Paper 2 (Policy and Practice). Geneva, World Health Organization. Retrieved February 1, 2020 from https://www.who.int/sdhconference/resources/ConceptualframeworkforactiononSDH_eng.pdf.
Spoont, M. R., Nelson, D. B., Murdoch, M., Sayer, N. A., Nugent, S., Rector, T., et al. (2015). Are there racial/ethnic disparities in VA PTSD treatment retention? Depression and Anxiety, 32(6), 415–425.
Street, R. L., Jr. (2003). Communication in medical encounters: An ecological perspective. In T. L. Thompson, P. Roxanne, D. Alicia, & M. Katherine (Eds.), The Routledge handbook of health communication (pp. 77–104). Abingdon: Routledge.
Street, R. L., Jr., Gordon, H., & Haidet, P. (2007). Physicians’ communication and perceptions of patients: Is it how they look, how they talk, or is it just the doctor? Social Science & Medicine, 65(3), 586–598.
Street, R. L., Jr., Makoul, G., Arora, N. K., & Epstein, R. M. (2009). How does communication heal? Pathways linking clinician-patient communication to health outcomes. Patient Education and Counseling, 74(3), 295–301.
Street, R. L., Jr., Marengo, M. F., Barbo, A., Lin, H., Gonzalez, A. G., Richardson, M. N., et al. (2015). Affective tone in medical encounters and its relationship with treatment adherence in a multiethnic cohort of patients with rheumatoid arthritis. JCR Journal of Clinical Rheumatology, 21(4), 181–188.
Sue, S., Zane, N., & Young, K. (1994). Research on psychotherapy with culturally diverse populations. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of psychotherapy and behavior change (pp. 783–817). John Wiley & Sons.
Sullivan, K. A., Schultz, K., Ramaiya, M., Berger, M., Parnell, H., & Quinlivan, E. B. (2015). Experiences of women of color with a nurse patient navigation program for linkage and engagement in HIV care. AIDS Patient Care and STDs, 29(Suppl 1), S49–54.
Sussman, L. K., Robins, L. N., & Earls, F. (1987). Treatment-seeking for depression by black and white Americans. Social Science & Medicine, 24(3), 187–196.
Tobin, G. A., & Begley, C. M. (2004). Methodological rigour within a qualitative framework. Journal of Advanced Nursing, 48, 388–396.
U.S. Department of Health and Human Services. (2001). Mental health: Culture, race, and ethnicity—A supplement to mental health: A report of the surgeon general. Rockville, MD: U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration, Center for Mental Health Services.
Vargas, R. B., Ryan, G. W., Jackson, C. A., Rodriguez, R., & Freeman, H. P. (2008). Characteristics of the original patient navigation programs to reduce disparities in the diagnosis and treatment of breast cancer. Cancer, 113(2), 426–433.
Vaux, A. (1988). Social support: Theory, research, and intervention. Westport: Praeger publishers.
Walker, E. R., McGee, R. E., & Druss, B. G. (2015). Mortality in mental disorders and global disease burden implications: A systematic review and meta-analysis. JAMA Psychiatry, 72(4), 334–341.
Walker, E. M., Mwaria, M., Coppola, N., & Chen, C. (2014). Improving the replication success of evidence-based interventions: Why a preimplementation phase matters. Journal of Adolescent Health, 54(3 Suppl), S24–S28.
Wang, P. S., Berglund, P., & Kessler, R. C. (2000). Recent care of common mental disorders in the United States: Prevalence and conformance with evidence-based recommendations. Journal of General Internal Medicine, 15(5), 284–292.
Wells, K., Klap, R., Koike, A., & Sherbourne, C. (2001). Ethnic disparities in unmet need for alcoholism, drug abuse, and mental health care. American Journal of Psychiatry., 158(12), 2027–2032.
Westfall, J. M., Mold, J., & Fagnan, L. (2007). Practice-based research—“Blue Highways” on the NIH roadmap. JAMA, 297(4), 403–406.
WHO Commission on Social Determinants of Health, & World Health Organization (2008). Closing the gap in a generation: Health equity through action on the social determinants of health: Commission on Social Determinants of Health final report. Geneva: World Health Organization
Winhusen, T. (2014). Not getting lost in translational science: A tool for navigating the pre-implementation phase of multi-site pharmacological clinical trials. Applied Clinical Trials, 23(8–9), 36.
Wright-Berryman, J. L., McGuire, A. B., & Salyers, M. P. (2011). A review of consumer-provided services on assertive community treatment and intensive case management teams: Implications for future research and practice. Journal of the American Psychiatric Nurses Association, 17(1), 37–44.
Young, A. S., Klap, R., Sherbourne, C. D., & Wells, K. B. (2001). The quality of care for depressive and anxiety disorders in the United States. Archives of General Psychiatry, 58(1), 55–61.
Zhang, A. Y., Snowden, L. R., & Sue, S. (1998). Differences between Asian and White Americans' help seeking and utilization patterns in the Los Angeles area. Journal of Community Psychology., 26(4), 317–326.
Zickmund, S. L., Burkitt, K. H., Gao, S., Stone, R. A., Rodriguez, K. L., Switzer, G. E., et al. (2015). Racial differences in satisfaction with VA health care: A mixed methods pilot study. Journal of Racial and Ethnic Health Disparities, 2(3), 317–329.
Acknowledgements
We would like to thank the study participants for making this work possible.
Funding
This work was supported by a VA HSR&D Career Development Award CDA 16-153 to Dr. Eliacin. Drs. Eliacin, Matthias, Damush, and Rollins were also supported in part by the VA HSR&D Center for Health Information and Communication, CIN 13-416. Views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs or the United States government.
Author information
Authors and Affiliations
Contributions
JE, MM, DB, SP, AR, TP, and TT made substantial contributions to the conception or design of the work. JE, SP, CO, and TT collected the data. JE, CO, and TT analyzed the data. JE, MM, DB, AR, TD, SP, and TT interpreted the data. JE drafted the work. JE, MM, AR, DB, and TD substantively revised the work. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no competing interests.
Ethics Approval
This study was approved by the Indiana University IRB and Roudebush VAMC Research and Development Committee.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Eliacin, J., Matthias, M.S., Burgess, D.J. et al. Pre-implementation Evaluation of PARTNER-MH: A Mental Healthcare Disparity Intervention for Minority Veterans in the VHA. Adm Policy Ment Health 48, 46–60 (2021). https://doi.org/10.1007/s10488-020-01048-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-020-01048-9