Avoid common mistakes on your manuscript.
INTRODUCTION
The Person-Centered Primary Care Measure (PCPCM) received National Quality Forum endorsement in 2021 as a patient-reported outcome performance measure.1, 2 Local stakeholders suggested that Blue Cross Blue Shield of Massachusetts (BCBSMA) use the PCPCM as a basis for pay-for-performance for primary care practitioners (PCPs). BCBSMA requires validity and reliability for financially incentivized measures.
Validity of patient survey measures hinges on adequate risk adjustment. The Clinician and Group Consumer Assessment of Healthcare Providers and Systems (CG-CAHPS) survey, for example, features case-mix adjustment methods.3 However, the PCPCM lacks case-mix adjustment methods. No published analyses have assessed whether the PCPCM requires case-mix adjustment.
METHODS
We surveyed BCBSMA members in June–August 2021 in two mail-only waves, using a Massachusetts Health Quality Partners (MHQP) patient experience survey instrument based on the CG-CAHPS Visit Survey 4.0, with embedded PCPCM items.4
The survey sample included 2400 BCBSMA members who were attributed to PCPs (2000 to 20 physicians, 400 to 29 nurse practitioners) using HMO member self-designation or, in absence of self-designation (most PPO members), the PCP with most recent evaluation and management claim and who had an in-person or virtual primary care visit between September 1, 2020, and February 28, 2021.
We stratified the survey sample by length of relationship with attributed PCP (< 1 year, 1–4 years, > 4 years) and by medical complexity based on claims (high, medium, low; DxCG/Cotiviti).
For each returned complete survey, we calculated PCPCM scores (0 to 100), scores on two global ratings–based MHQP survey items—overall rating of most recent visit (0 to 10), likelihood to recommend provider (0 to 10)—and seven report-based MHQP composites (i.e., those assessing specific activities or events, all scored 0 to 100): Communication, Access, Integration of Care, Knowledge of Patient, Self-Management Support, Office Staff, and Adult Behavioral Health. Detailed information on these composites is available at MHQP.5
Using individual patient responses as units of analysis, we fit regression models that predicted each outcome score as a function of multiple potential case-mix adjustment variables (treating each as a linear predictor): self-identified age, gender, educational attainment, general health, mental health, self-identified length of relationship with PCP, whether most recent visit was in-person, claims-based medical complexity, and claims-based length of relationship with PCP. We also computed associations between PCPCM scores and the other outcome scores.
We used inverse probability of response weights to account for survey non-response and stratified sample design. We performed a complete case analysis, without imputing item-level non-responses. We considered p-values < 0.05 statistically significant.
This research was exempted from review by the WCG IRB.
RESULTS
We received 381 survey responses (15.9% response rate). PCPCM scores were statistically significantly associated with self-reported general health, self-reported mental health, claims-based medical complexity, length of relationship with the PCP (both self-reported and claims-derived), and whether the most recent visit was in-person (Table 1). Overall rating of most recent visit was associated with self-reported general health. Likelihood to recommend provider was associated with self-reported general health, claims-based medical complexity, and whether the most recent visit was in-person. Of the report-based composites, only Knowledge of Patient was associated with more than one case-mix adjustment variable.
PCPCM scores had Pearson’s correlations of 0.74 with overall visit rating, 0.72 with likelihood to recommend, 0.70 with Knowledge of Patient, and correlations < 0.6 with the remaining report-based composites (all statistically significant at p < 0.001).
DISCUSSION
In a Massachusetts pilot, PCPCM scores were associated with standard CG-CAHPS case-mix adjustment variables, claims-based measures of medical complexity, and both claims-based and self-reported length of relationship with the rated PCP. The PCPCM was more highly associated with global ratings items (i.e., “satisfaction” items such as overall rating of most recent visit and likelihood to recommend provider) and Knowledge of Patient than with other report-based scores (e.g., Integration of Care).
The survey was limited to a single state, with modest sample size and response rate.
Our findings suggest that the PCPCM requires development of case-mix adjustment methods. Without case-mix adjustment, threats to validity include, for example, the potential to penalize early career PCPs and those who have recently moved, due to the significant association between length of relationship and PCPCM scores. Additionally, the PCPCM has little independence from existing global ratings survey items (e.g., likelihood to recommend provider).
References
Etz RS, Zyzanski SJ, Gonzalez MM, Reves SR, O’Neal JP, Stange KC. A new comprehensive measure of high-value aspects of primary care. Ann Fam Med. 2019;17:221–230.
Person-Centered Primary Care Measure [homepage on the internet]: https://www.green-center.org/pcpcm. Accessed 1 May 2024.
Analyzing CAHPS Survey Data [homepage on the internet]: https://www.ahrq.gov/cahps/surveys-guidance/helpful-resources/analysis/index.html. Accessed 1 May 2024.
Massachusetts Health Quality Partners survey instrument, with embedded PCPCM items [homepage on the internet]: https://www.mhqp.org/links/PES_2021_Adult_PCPCM_Pilot.pdf. Accessed 1 May 2024.
Massachusetts Health Quality Partners 2021 patient experience survey: adult composite items [homepage on the internet]: https://www.mhqp.org/links/MHQP_PES_2021_Adult_Report_Composites.pdf. Accessed 1 May 2024.
Acknowledgements
We acknowledge the late William Rogers, PhD, and Center for the Study of Services (CSS), who assisted in the development of the sampling algorithm.
Funding
Blue Cross Blue Shield of Massachusetts sponsored this project.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
No author has a financial conflict of interest with this manuscript. Dr. Friedberg is an editor of the journal entitled Journal of General Internal Medicine and has recused himself from all decisions regarding this manuscript. Barbra Rabson is a member of Board of the American Board of Family Medicine.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Friedberg, M.W., Ying, W., Courtemanche, J. et al. Associations Between Person-Centered Primary Care Measure Score, Potential Case-Mix Adjustment Variables, and Other Patient Experience Survey Items. J GEN INTERN MED 39, 2125–2127 (2024). https://doi.org/10.1007/s11606-024-08791-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11606-024-08791-x