Abstract
Integrated health care includes joint, outpatient delivery of medical and behavioral health services. Traditional patient satisfaction measures might fail to capture the discrete delivery approaches in this model. To identify patient satisfaction measures used in integrated health care settings, a systematic review was conducted of US-based studies conducted in adult outpatient integrated care settings from 1999 through 2020. Study quality was assessed using standards recommended by the COSMIN guidelines. The review yielded a sample of 23 studies, consisting of 10 standardized measures and 6 self-developed tools. All studies/measures met at least one of the identified COSMIN guidelines, demonstrating quality of the measures. While most measures evaluated key elements of integration, including access, communication, and relationships, only one standardized measure evaluated elements of care specific to practice in integrated care. Findings suggest a need for a comprehensive patient satisfaction measure that captures important aspects of the integrated health care experience.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
AHRQ. (2017). CAHPS patient-centered medical home item set. Retrieved January 30, 2020 from https://www.ahrq.gov/cahps/surveys-guidance/item-sets/PCMH/index.html.
Biernacki, P. J., Champagne, M. T., Peng, S., Maizel, D. R., & Turner, B. S. (2015). Transformation of care: Integrating the registered nurse care coordinator into the patient-centered medical home. Population Health Management, 18(5), 330–336. https://doi.org/10.1089/pop.2014.0131.
Bleich, S. N., Özaltin, E., & Murray, C. J. (2009). How does satisfaction with the health-care system relate to patient experience? Bulletin of the World Health Organization, 87(4), 271–278. https://doi.org/10.2471/BLT.07.050401.
Borowsky, S. J., Nelson, D. B., Fortney, J. C., Hedeen, A. N., Bradley, J. L., & Chapko, M. K. (2002). VA community-based outpatient clinics—performance measures based on patient perceptions of care. Medical Care, 40(7), 578–586. https://doi.org/10.1097/00005650-200207000-00004.
Bruce, M., & Pearson, J. (1999). Designing an intervention to prevent suicide: PROSPECT (prevention of suicide in primary care elderly: Collaborative trial). Dialogues in Clnical Neuroscience, 1(12), 100–112.
Buche, J., Singer, P. M., Grazier, K., King, E., Maniere, E., & Beck, A. J. (2017). Primary care and behavioral health workforce integration: Barriers and best practices. Retrieved January 30, 2020 from http://www.behavioralhealthworkforce.org/wp-content/uploads/2017/02/FA2P3_Team-based-Care-Case-Studies_Full-Report.pdf.
Carrillo, J. E., Carrillo, V. A., Guimento, R., Mucaria, J., & Leiman, J. (2014). The NewYork-presbyterian regional health collaborative: A three-year progress report. Health Affairs, 33(11), 1985–1992. https://doi.org/10.1377/hlthaff.2014.0408.
Ciechanowski, P. S., Russo, J. E., Katon, W. J., Von Korfif, M., Simon, G. E., Lin, E. H. B., et al. (2006). The association of patient relationship style and outcomes in collaborative care treatment for depression in patients with diabetes. Medical Care, 44(3), 283–291.
Collaborative Family Healthcare Association. (n.d.). What is integrated care? Retrieved January 30, 2020 from https://www.cfha.net/page/IntegratedCare.
Coulter, A., Fitzpatrick, R., & Cornewell, J. (2009). Measures of patients' experience in hospital: Purpose, methods and uses. Retrieved January 30, 2020 from https://www.kingsfund.org.uk/sites/default/files/Point-of-Care-Measures-of-patients-experience-in-hospital-Kings-Fund-July-2009_0.pdf.
Curry, L. A., Nembharrd, I. M., & Bradley, E. H. (2009). Qualitative and mixed methods provide unique contributions to outcomes research. Circulation, 119(10), 1442–1452. https://doi.org/10.1161/CIRCULATIONAHA.107.742775.
Day, J., Scammon, D. L., Kim, J., Sheets-Mervis, A., Day, R., Tomoaia-Cotisel, A., et al. (2013). Quality, satisfaction, and financial efficiency associated with elements of primary care practice transformation: Preliminary findings. Annals of Family Medicine, 11, S50–S59. https://doi.org/10.1370/afm.1475.
Ede, V., Okafor, M., Kinuthia, R., Belay, Z., Tewolde, T., Alema-Mensah, E., et al. (2015). An examination of perceptions in integrated care practice. Community Mental Health Journal, 51(8), 949–961. https://doi.org/10.1007/s10597-015-9837-9.
Funderburk, J. S., Fielder, R. L., DeMartini, K. S., & Flynn, C. A. (2012). Integrating behavioral health services into a University Health Center: Patient and provider satisfaction. Families Systems & Health, 30(2), 130–140. https://doi.org/10.1037/a0028378.
Hays, R. D., Berman, L. J., Kanter, M. H., Hugh, M., Oglesby, R. R., Kim, C. Y., et al. (2014). Evaluating the psychometric properties of the CAHPS patient-centered medical home surve. Clinical Therapeutics, 36(5), 689–696. https://doi.org/10.1016/j.clinthera.2014.04.004.
Hudak, P. L., & Wright, J. G. (2000). The characteristics of patient satisfaction measures. Spine, 25(24), 3167–3177. https://doi.org/10.1097/00007632-200012150-00012.
Katz, D. A., McCoy, K., & Sarrazin, M. V. (2014). Does improved continuity of primary care affect clinician-patient communication in VA? Journal of General Internal Medicine, 29, 682–688. https://doi.org/10.1007/s11606-013-2633-8.
Kingsley, C., & Patel, S. (2017). Patient-reported outcome measures and patient-reported experience measures. BJA Education, 17(4), 137–144. https://doi.org/10.1093/bjaed/mkw060.
Kouyoumdjian, H., Zamboanga, B. L., & Hansen, D. J. (2003). Barriers to community mental health services for Latinos: Treatment considerations. Clinical Psychology: Science and Practice, 10(4), 394–422. https://doi.org/10.1093/clipsy.bpg041.
Krupski, A., West, I. I., Scharf, D. M., Hopfenbeck, J., Andrus, G., Joesch, J. M., et al. (2016). Integrating primary care into community mental health centers: Impact on utilization and costs of health care. Psychiatric Services, 67(11), 1233–1239. https://doi.org/10.1176/appi.ps.201500424.
Landoll, R. R., Nielsen, M. K., & Waggoner, K. K. (2017). Understanding primary care behavioral health across military settings: A preliminary comparison between deployed and in-garrison care. Military Medicine, 182(3), E1575–E1579. https://doi.org/10.7205/milmed-d-16-00272.
Lees, C. (2011). Measuring the patient experience. Nurse Researcher. https://doi.org/10.7748/nr2011.10.19.1.25.c8768.
Malish, R. G. (2016). Capitation as an incentive for transitioning to patient-centered medical homes in the United States army: A brief report. Military Medicine, 181(10), 1228–1234. https://doi.org/10.7205/milmed-d-15-00541.
McFeature, B., & Pierce, T. (2012). Primary care behavioral health consultation reduces depression levels among mood-disordered patients. Journal of Health Disparities Research and Practice, 5(2), 36–44.
Nelson, K. M., Helfrich, C., Sun, H. L., Hebert, P. L., Liu, C. F., Dolan, E., et al. (2014). Implementation of the patient-centered medical home in the veterans health administration associations with patient satisfaction, quality of care, staff burnout, and hospital and emergency department use. JAMA Internal Medicine, 174(8), 1350–1358. https://doi.org/10.1001/jamainternmed.2014.2488.
Nickel, S., Thiedemann, B., & von dem Knesebeck, O. (2010). The effects of integrated inpatient health care on patient satisfaction and health-related quality of life: Results of a survey among heart disease patients in Germany. Health Policy, 98(2–3), 156–163. https://doi.org/10.1016/j.healthpol.2010.06.012.
Patient Protection and Affordable Care Act. (2010). Pub. L. No. 111–148, 124 Stat. 119
Patient-Centered Primary Care Collaborative. (2020). Why it works: Patient-centered strategies to drive health system transform. Retrieved January 30, 2020 from https://www.pcpcc.org/content/why-it-works.
Paul Wellstone and Pete Domenici Mental Health Parity and Addiction Equity Act of 2008. (2008). Pub. L. 110-462008.
Pirraglia, P., Rowland, E., Wu, W., Friedmann, P., O’Toole, T., Cohen, L., & Taveira, T. (2012). Benefits of a primary care clinic co-located and integrated in a mental health setting for veterans with serious mental illness. Preventing Chronic Disease, 9, E51.
Platonova, E. A., Saunders, W. B., Warren-Findlow, J., & Hutchison, J. A. (2016). Patient perceptions of patient-centered medical home characteristics and satisfaction with free clinic services. Population Health Management, 19(5), 324–331. https://doi.org/10.1089/pop.2015.0100.
Presson, A. P., Zhang, C., Abtahi, A. M., Kean, J., Hung, M., & Tyser, A. R. (2017). Psychometric properties of the Press Ganey® Outpatient Medical Practice Survey. Health and Quality of Life Outcomes. https://doi.org/10.1186/s12955-017-0610-3.
Prinsen, C. A. C., Mokkink, L. B., Bouter, L. M., Alonso, J., Patrick, D. L., de Vet, H. C. W., et al. (2018). COSMIN guideline for systematic reviews of patient-reported outcome measures. Quality of Life Research, 27(5), 1147–1157. https://doi.org/10.1007/s11136-018-1798-3.
Rabow, M. W., Dibble, S. L., Pantilat, S. Z., & McPhee, S. J. (2004). The comprehensive care team: A controlled trial of outpatient palliative medicine consultation. Archives of Internal Medicine, 164(1), 83–91. https://doi.org/10.1001/archinte.164.1.83.
Ralston, J. D., Martin, D. P., Anderson, M. L., Fishman, P. A., Conrad, D. A., Larson, E. B., & Grembowski, D. (2009). Group health cooperative’s transformation toward patient-centered access. Medical Care Research and Review, 66(6), 703–724. https://doi.org/10.1177/1077558709338486.
Rodgers, M., Dalton, J., Harden, M., Street, A., Parker, G., & Eastwood, A. (2018). Integrated care to address the physical health needs of people with severe mental illness: A mapping review of the recent evidence on barriers, facilitators and evaluations. International Journal of Integrated Care, 18(1), 9–9. https://doi.org/10.5334/ijic.2605.
SAMHSA-HRSA. (2017). SAMHSA-HRSA center for integrated health solution. Retrieved January 30, 2020 from http://www.integration.samhsa.gov/.
SAMHSA-HRSA. (n.d.). What is integrated care? Retrieved January 30, 2020 from http://www.integration.samhsa.gov/about-us/what-is-integrated-care.
Smith, R. C., Gardiner, J. C., Luo, Z. H., Schooley, S., Lamerato, L., & Rost, K. (2009). Primary care physicians treat somatization. Journal of General Internal Medicine, 24(7), 829–832. https://doi.org/10.1007/s11606-009-0992-y.
Stewart, M. E., & Roter, D. E. (1989). Communicating with medical patients. Nursing Standard. https://doi.org/10.7748/ns.4.4.41.s56.
Stolzmann, K. L., Meterko, M., Shwartz, M., Young, G. J., Pekoz, E. A., Benzer, J. K., et al. (2010). Accounting for variation in technical quality and patient satisfaction the contribution of patient, provider, team, and medical center. Medical Care, 48(8), 676–682. https://doi.org/10.1097/MLR.0b013e3181e35b1f.
Sussman, L. K., Robins, L. N., & Earls, F. (1987). Treatment-seeking for depression by black and white Americans. Social Science & Medicine, 24(3), 187–196. https://doi.org/10.1016/0277-9536(87)90046-3.
Terwee, C. B., Mokkink, L. B., Knol, D. L., Ostelo, R. W., Bouter, L. M., & de Vet, H. C. W. (2012). Rating the methodological quality in systematic reviews of studies on measurement properties: A scoring system for the COSMIN checklist. Quality of Life Research, 21(4), 651–657. https://doi.org/10.1007/s11136-011-9960-1.
Walker, K. O., Labat, A., Choi, J., Schmittdiel, J., Stewart, A. L., & Grumbach, K. (2013). Patient perceptions of integrated care: Confused by the term, clear on the concept. International Journal of Integrated Care, 13, e004.
Wells, R., Breckenridge, E. D., Ajaz, S., Narayan, A., Brossart, D., Zahniser, J. H., et al. (2019). Integrating primary care into community mental health centres in Texas, USA: Results of a case study investigation. International Journal of Integrated Care. https://doi.org/10.5334/ijic.4630.
Woltmann, E., Grogan-Kaylor, A., Perron, B., Georges, H., Kilbourne, A. M., & Bauer, M. S. (2012). Comparative effectiveness of collaborative chronic care models for mental health conditions across primary, specialty, and behavioral health care settings: Systematic review and meta-analysis. American Journal of Psychiatry, 169(8), 790–804. https://doi.org/10.1176/appi.ajp.2012.11111616.
Zickmund, S. L., Burkitt, K. H., Gao, S., Stone, R. A., Rodriguez, K. L., Switzer, G. E., et al. (2015). Racial differences in satisfaction with VA health care: A mixed methods pilot study. Journal of Racial and Ethnic Health Disparities, 2(3), 317–329. https://doi.org/10.1007/s40615-014-0075-6.
Zulman, D. M., Pal Chee, C., Ezeji-Okoye, S. C., Shaw, J. G., Holmes, T. H., Kahn, J. S., & Asch, S. M. (2017). Effect of an intensive outpatient program to augment primary care for high-need veterans affairs patients: A randomized clinical trial. JAMA Internal Medicine, 177(2), 166–175.
Funding
This study was not funded.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflicts of interest.
Research Involving Human and Animal participants
This article does not contain any studies with human participants or with animals performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Black, D., Held, M.L., Skeesick, J. et al. Measures Evaluating Patient Satisfaction in Integrated Health Care Settings: A Systematic Review. Community Ment Health J 57, 1464–1477 (2021). https://doi.org/10.1007/s10597-020-00760-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10597-020-00760-y