Journal of General Internal Medicine

, Volume 23, Issue 11, pp 1784–1790 | Cite as

Quality Monitoring of Physicians: Linking Patients’ Experiences of Care to Clinical Quality and Outcomes

  • Thomas D. SequistEmail author
  • Eric C. Schneider
  • Michael Anastario
  • Esosa G. Odigie
  • Richard Marshall
  • William H. Rogers
  • Dana Gelb Safran
Original Article



Physicians are increasingly asked to improve the delivery of clinical services and patient experiences of care.


We evaluated the association between clinical performance and patient experiences in a statewide sample of physician practice sites and a sample of physicians within a large physician group.

Design, Setting, Participants

We separately identified 373 practice sites and 119 individual primary care physicians in Massachusetts.


Using Health Plan Employer Data and Information Set data, we produced two composites addressing processes of care (prevention, disease management) and one composite addressing outcomes. Using Ambulatory Care Experiences Survey data, we produced seven composite measures summarizing the quality of clinical interactions and organizational features of care. For each sample (practice site and individual physician), we calculated adjusted Spearman correlation coefficients to assess the relationship between the composites summarizing patient experiences of care and those summarizing clinical performance.


Among 42 possible correlations (21 correlations involving practice sites and 21 involving individual physicians), the majority were positive in site level (71%) and physician level (67%) analyses. For the 28 possible correlations involving patient experiences and clinical process composites, 8 (29%) were significant and positive, and only 2 (7%) were significant and negative. The magnitude of the significant positive correlations ranged from 0.13 to 0.19 at the site level and from 0.28 to 0.51 at the physician level. There were no significant correlations between patient experiences and the clinical outcome composite.


The modest correlations suggest that clinical quality and patient experience are distinct, but related domains that may require separate measurement and improvement initiatives.


quality of care patient centered care primary care quality measurement quality improvement 



We would like to thank Massachusetts Health Quality Partners for allowing us use of statewide data for these analyses; Jo-Anne Foley at HVMA for helping to obtain physician-level data; and Angela Li, Angie Rodday, and Hong Chang at Tufts-New England Medical Center for analytic support. This study was funded by the Commonwealth Fund and the William Randolph Hearst Foundation. Dr. Sequist has served as a consultant on the Aetna External Advisory Committee for Racial and Ethnic Equality. Dr. Sequist had full access to all the data in the study and takes responsibility for the integrity and the accuracy of the data analysis.

Conflict of Interest

None disclosed.


  1. 1.
    McGlynn EA, Asch SM, Adams J, et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348:2635–45.PubMedCrossRefGoogle Scholar
  2. 2.
    Jha AK, Perlin JB, Kizer KW, Dudley RA. Effect of the transformation of the Veterans Affairs Health Care System on the quality of care. N Engl J Med. 2003;348:2218–27.PubMedCrossRefGoogle Scholar
  3. 3.
    Trivedi AN, Zaslavsky AM, Schneider EC, Ayanian JZ. Trends in the quality of care and racial disparities in Medicare managed care. N Engl J Med. 2005;353:692–700.PubMedCrossRefGoogle Scholar
  4. 4.
    Jencks SF, Huff ED, Cuerdon T. Change in the quality of care delivered to Medicare beneficiaries, 1998–1999 to 2000–2001. JAMA. 2003;289:305–12.PubMedCrossRefGoogle Scholar
  5. 5.
    Marshall MN, Shekelle PG, Leatherman S, Brook RH. The public release of performance data: what do we expect to gain? A review of the evidence. Jama. 2000;283:1866–74.PubMedCrossRefGoogle Scholar
  6. 6.
    Massachusetts Health Quality Partners. Quality Reports. Available at: = 030000. Accessed August 5, 2008.
  7. 7.
    Fung CH, Lim YW, Mattke S, Damberg C, Shekelle PG. Systematic review: the evidence that publishing patient care performance data improves quality of care. Ann Intern Med. 2008;148:111–23.PubMedGoogle Scholar
  8. 8.
    Rosenthal MB, Landon BE, Normand SL, Frank RG, Epstein AM. Pay for performance in commercial HMOs. N Engl J Med. 2006;355:1895–902.PubMedCrossRefGoogle Scholar
  9. 9.
    Doran T, Fullwood C, Gravelle H, et al. Pay-for-performance programs in family practices in the United Kingdom. N Engl J Med. 2006;355:375–84.PubMedCrossRefGoogle Scholar
  10. 10.
    Rosenthal MB, Frank RG, Li Z, Epstein AM. Early experience with pay-for-performance: from concept to practice. Jama. 2005;294:1788–93.PubMedCrossRefGoogle Scholar
  11. 11.
    Institute of Medicine. Primary Care: America’s Health in a New Era. Washington, DC: National Academy Press; 1996.Google Scholar
  12. 12.
    Safran DG, Karp M, Coltin K, et al. Measuring patients’ experiences with individual primary care physicians. Results of a statewide demonstration project. J Gen Intern Med. 2006;21:13–21.PubMedCrossRefGoogle Scholar
  13. 13.
    Audet AM, Davis K, Schoenbaum SC. Adoption of patient-centered care practices by physicians: results from a national survey. Arch Intern Med. 2006;166:754–9.PubMedCrossRefGoogle Scholar
  14. 14.
    Bergeson SC, Dean JD. A systems approach to patient-centered care. Jama. 2006;296:2848–51.PubMedCrossRefGoogle Scholar
  15. 15.
    Hasnain-Wynia R. Is evidence-based medicine patient-centered and is patient-centered care evidence-based? Health Serv Res. 2006;41:1–8.PubMedCrossRefGoogle Scholar
  16. 16..
    Friedberg MW, Coltin KL, Pearson SD, et al. Does Affiliation of Physician Groups with One Another Produce Higher Quality Primary Care? J Gen Intern Med. 2007.Google Scholar
  17. 17.
    Dillman DA. Mail and Telephone Surveys: The Total Design Method. New York: John Wiley; 1978.Google Scholar
  18. 18.
    Barton MB, Dayhoff DA, Soumerai SB, Rosenbach ML, Fletcher RH. Measuring access to effective care among elderly medicare enrollees in managed and Fee-for-Service care: a retrospective cohort study. BMC Health Serv Res. 2001;1:11.PubMedCrossRefGoogle Scholar
  19. 19.
    Pereira AG, Kleinman KP, Pearson SD. Leaving the practice: effects of primary care physician departure on patient care. Arch Intern Med. 2003;163:2733–6.PubMedCrossRefGoogle Scholar
  20. 20.
    Sequist TD, Marshall R, Lampert S, Buechler EJ, Lee TH. Missed opportunities in the primary care management of early acute ischemic heart disease. Arch Intern Med. 2006;166:2237–43.PubMedCrossRefGoogle Scholar
  21. 21.
    Sequist TD, Adams A, Zhang F, Ross-Degnan D, Ayanian JZ. Effect of quality improvement on racial disparities in diabetes care. Arch Intern Med. 2006;166:675–81.PubMedCrossRefGoogle Scholar
  22. 22.
    Sequist TD, Fitzmaurice GM, Marshall R, Shaykevich S, Safran DG, Ayanian JZ. Physician performance and racial disparities in diabetes mellitus care. Arch Intern Med. 2008;168:1145–51.PubMedCrossRefGoogle Scholar
  23. 23.
    National Center for Quality Assurance. HEDIS 2005 Volume 1: Narrative - What’s in it and why it matters.; 2004.Google Scholar
  24. 24.
    Donabedian A. The definition of quality and approaches to its assessment. Ann Arbor: Health Administration Press; 1980.Google Scholar
  25. 25.
    Nunnally JC, Bernstein IH. Psychometric Theory. New York: McGraw Hilll; 1994.Google Scholar
  26. 26.
    Davis K, Schoenbaum SC, Audet AM. A 2020 vision of patient-centered primary care. J Gen Intern Med. 2005;20:953–7.PubMedCrossRefGoogle Scholar
  27. 27.
    Safran DG. Defining the future of primary care: what can we learn from patients? Ann Intern Med. 2003;138:248–55.PubMedGoogle Scholar
  28. 28.
    Schneider EC, Zaslavsky AM, Landon BE, Lied TR, Sheingold S, Cleary PD. National quality monitoring of Medicare health plans: the relationship between enrollees’ reports and the quality of clinical care. Med Care. 2001;39:1313–25.PubMedCrossRefGoogle Scholar
  29. 29.
    Fung CH, Elliott MN, Hays RD, et al. Patients’ preferences for technical versus interpersonal quality when selecting a primary care physician. Health Serv Res. 2005;40:957–77.PubMedCrossRefGoogle Scholar
  30. 30.
    Montgomery JE, Irish JT, Wilson IB, et al. Primary care experiences of medicare beneficiaries, 1998 to 2000. J Gen Intern Med. 2004;19:991–8.PubMedCrossRefGoogle Scholar
  31. 31.
    Kahn KL, Schneider EC, Malin JL, Adams JL, Epstein AM. Patient centered experiences in breast cancer: predicting long-term adherence to tamoxifen use. Med Care. 2007;45:431–9.PubMedCrossRefGoogle Scholar
  32. 32.
    Kahn KL, Tisnado DM, Adams JL, et al. Does ambulatory process of care predict health-related quality of life outcomes for patients with chronic disease? Health Serv Res. 2007;42:63–83.PubMedCrossRefGoogle Scholar
  33. 33.
    Safran DG, Taira DA, Rogers WH, Kosinski M, Ware JE, Tarlov AR. Linking primary care performance to outcomes of care. J Fam Pract. 1998;47:213–20.PubMedGoogle Scholar
  34. 34.
    DiMatteo MR. Enhancing patient adherence to medical recommendations. Jama. 1994;271:79–83.PubMedCrossRefGoogle Scholar
  35. 35.
    DiMatteo MR, Sherbourne CD, Hays RD, et al. Physicians’ characteristics influence patients’ adherence to medical treatment: results from the Medical Outcomes Study. Health Psychol. 1993;12:93–102.PubMedCrossRefGoogle Scholar
  36. 36.
    Werner RM, Bradlow ET. Relationship between Medicare’s hospital compare performance measures and mortality rates. Jama. 2006;296:2694–702.PubMedCrossRefGoogle Scholar

Copyright information

© Society of General Internal Medicine 2008

Authors and Affiliations

  • Thomas D. Sequist
    • 1
    • 2
    • 3
    Email author
  • Eric C. Schneider
    • 1
    • 4
  • Michael Anastario
    • 5
  • Esosa G. Odigie
    • 5
  • Richard Marshall
    • 2
  • William H. Rogers
    • 5
    • 6
  • Dana Gelb Safran
    • 5
    • 6
    • 7
  1. 1.Division of General Medicine and Primary CareBrigham and Women’s HospitalBostonUSA
  2. 2.Harvard Vanguard Medical AssociatesBostonUSA
  3. 3.Department of Health Care PolicyHarvard Medical SchoolBostonUSA
  4. 4.Department of Health Policy and ManagementHarvard School of Public HealthBostonUSA
  5. 5.The Health Institute, Institute for Clinical Research and Health Policy StudiesTufts-New England Medical CenterBostonUSA
  6. 6.Department of MedicineTufts University School of MedicineBostonUSA
  7. 7.Blue Cross Blue Shield of MassachusettsBostonUSA

Personalised recommendations