Purpose of Review
Current kidney transplant program performance assessment metrics are reviewed, including their use by regulatory entities, and a new approach to program assessment, the Collaborative Innovation and Improvement Network (COIIN), is described.
Current kidney transplant program performance assessment is based on 1-year patient and graft survival data. Program specific reports used by the OPTN, CMS, and third-party payers have resulted in risk-averse clinical decision making by transplant programs limiting the transplantation of less than ideal kidneys and access to transplantation for increased risk recipient candidates. In response, HRSA has funded the COIIN project as an alternative performance monitoring approach based on a data-rich, real-time, collaborative, monitoring framework. The goal is to reduce risk-avoidance decision making allowing the transplantation of a broader range of kidneys into appropriate recipients.
The COIIN project is a 3-year effort being piloted in a diverse group of transplant programs as an alternative to current performance metrics. If successful, this may replace the current performance monitoring system.
This is a preview of subscription content, log in to check access.
Buy single article
Instant access to the full article PDF.
Price includes VAT for USA
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
This is the net price. Taxes to be calculated in checkout.
Papers of particular interest, published recently, have been highlighted as: • of importance •• of major importance
• Klassen DK, Edwards LB, Stewart DE, Glazier AK, Orlowski JP, Berg CL. The OPTN deceased donor potential study: implications for policy and practice. Am J Transplant. 2016;16:1707–14. This article identifies older and less than ideal donors as the group containing the unrealized donor potential.
Snyder JJ, Salkowski N, Wey A, Israni AK, Schold JD, Kasiske DL. Effects of high-risk kidneys on Scientific Registry of Transplant Recipients program quality reports. Am J Transplant. 2016;16:2646–53.
Axelrod DA, Friedewald JJ. Utilizing high-risk kidneys—risks, benefits, and unintended consequences? Am J Transplant. 2016;16:2514–5.
VanWagner LB, Skaro AL. Program-specific reports: implications and impact on program behavior. Curr Opin Organ Transplant. 2013;18:210–5.
•• Hamilton TE. Regulatory oversight in transplantation: are the patients really better off? Curr Opin Organ Transplant. 2013;18:203–9. This article presents the CMS perspective on transplant performance assessment and shows that programs improve outcomes after being cited by CMS for low performance.
Axelrod DA. Balancing accountable care with risk aversion: transplantation as a model. Am J Transplant. 2013;13:7–8.
Schold JD, Srinivas TR, Howard RJ, Jamieson IR, Meier-Kriesche H. The association of candidate mortality rates with kidney transplant outcomes and center performance evaluations. Transplantation. 2008;85:1–6.
• Schold JD, Buccini LD, Srinivas TR, Srinivas RT, Poggio ED, Flechner SM, Soria C, Segev DL, Fung J, Goldfarb DA. The association of center performance evaluations and kidney transplant volume in the United States. Am J Transplant. 2013;13:67–5. This article shows that transplant programs cited for low performance respond by decreasing transplant volumes.
• Schold JD, Buccini LD, Poggio ED, Klechner SM, Goldfarb DA. Association of candidate removals from the kidney transplant waiting list and center performance oversight. Am J Transplant. 2016;16:1276–84. This article shows the association between low performance evaluations and transplant center processes of care for waitlisted candidates. Low performing centers remove candidates from their waiting list.
• White SL, Zinsser DM, Levine GN, Shearon T, Ashby VB, Magee JC, Li Y, Leichtman AB. Patient selection and volume in the era surrounding implementation of Medicare conditions of participation for transplant programs. Health Serv Res. 2015;50:330–50. Centers with CMS COP noncompliance decrease their use of high KDPI kidneys.
•• Schold JD, Buccini LD, Goldfarb DA, Flechner SM, Poggio ED, Sehgall AR. Association between kidney transplant center performance and the survival benefit of transplantation versus dialysis. Clin J Am Soc Nephrol. 2014;9:1773–80. Stewart DE, Garcia VC, Rosendale JD, Klassen DK, Carrico BJ. This is a widely cited article that demonstrates that there is a large survival benefit of transplantation relative to remaining on dialysis at even the lowest performing transplant centers.
Stewart DE, Garcia VC, Rosendale JD, Klassen DK, Carrico BJ. Diagnosing the decades-long rise in the deceased donor kidney discard rate in the US. Transplantation (in press).
• Massie AB, Lou X, Chow EK, Alejo JL, Desai NM, Segev DL. Survival benefit of primary deceased donor transplantation with high-KDPI kidneys. Am J Transplant. 2014;14:2310–6. This article shows the survival benefit from transplantation with high KDPI kidneys in selected patient groups and at centers with longer waiting times.
Rose C, Schaeffner E, Frei U, Gill J, Gill JS. A lifetime of allograft function with kidneys from older donors. J Am Soc Nephrol. 2015;26:2483–93.
Axelrod DA, Schold J. Measuring what matters. Am J Transplant (in press).
Abecassis MM, Burke R, Klintmalm GB, Matas AJ, Merion RM, Millman D, Olthoff K, Roberts JP. American Society of Transplant Surgeons transplant center outcomes requirements—a threat to innovation. Am J Transplant. 2009;9:1279–86.
• Kasiske BL, McBride MA, Cornell DL, Gaston RS, Henry ML, Irwin FD, Israni AK, Metzler NW, Murphy KW, Reed AI, Roberts JP, Salkowski N, Snyder JJ, Sweet SC. Report of a consensus conference on transplant program quality and surveillance. Am J Transplant. 2012;12:1988–96. This article suggests the use of carve outs for research and high risk recipients as an approach to changing center risk-averse behavior.
Reese PP, Harhay MN, Abt PL, Levine MH, Halpern SD. J Am Soc Nephrol. 2016;27:973–80.
Transplant program outcomes review system changes. Available on: https://optn.transplant.hrsa.gov/governance/public-comment/
Transplant program performance outcomes measures. Available on: https://optn.transplant.hrsa.gov/governance/public-comment/
Axelrod DA, Kalbfleisch JD, Sun RJ, Guidinger MK, Biswas P, Levine GN, Arrington CJ, Merion RM. Innovations in the assessment of transplant center performance: implications for quality improvement. Am J Transplant. 2009;9:959–69.
Axelrod DA, Guidinger MK, Metzger RA, Weisner RH, Webb RL, Merion RM. Transplant center quality assessment using a continuously updatable, risk-adjusted technique (CUSUM). Am J Transplant. 2006;6:313–23.
•• Axelrod DA, Schnitzler MA, Xiao H, Naik AS, Segev DL, Dharnidharka VR, Brennan DC, Lentine KL. The changing financial landscape of renal transplant practice: a national cohort analysis. Am J Transplant (in press). This article highlights the financial disincentives for higher risk transplants due to the current reimbursement structure for kidney transplantation.
Schold JD, Reed AI. Developing financial incentives for kidney transplant centers: who is minding the store? Am J Transplant (in press).
• Howard DH, Sminoff LA, Mcbride V, Lin M. Does quality improvement work?: evaluation of organ donation breakthrough collaborative. Health Serv Res. 2007;42(6 Pt1):2160–73. This article describes the findings from the Organ Donation Collaborative (2002- 2004). Results demonstrated an improvement in pre-period conversion rates by 8% in participating hospitals. The principal findings support the conclusion that participation in the Collaborative led to an increase in donation rates.
Massoud MR, Nielsen GA, Nolan K, Schall MW, Sevin C. A framework for spread: from local improvements to system-wide change. IHI innovation series white paper. Cambridge, MA: Institute for Healthcare Improvement; 2006. (Available on www.IHI.org)
• Wilson T, Berwick DM, Cleary PD. What do collaborative improvement projects do? Experience from seven countries. Joint Commission Journal on Quality and Safety. 2003;29(2):85–93. This research study evaluated the perspectives of 15 collaborative leaders to identify the common components of collaboratives to identify variations in how they are deployed. The study identified seven features of collaboratives that leaders felt were critical determinants of effectiveness.
Alemi F, et al. Rapid improvement teams. Jt Comm J Qual Improv. 1998;24:119–29.
Rogers EM. Diffusion of innovations. 5th ed. New York: The Free Press; 2003.
The Breakthrough Series: IHI’s Collaborative model for achieving breakthrough improvement. IHI Innovation Series white paper. Boston: Institute for Healthcare Improvement; 2003. (Available on www.IHI.org).
Gustafson D, Cats-Baril WL, Alemi F. Systems to support health policy analysis: theory models, and uses. Chicago: Health Administration Press; 1992.
Institute of Healthcare Improvement—How to Improve: Science of Improvement—Establishing Measures. (Available on http://www.ihi.org/resources/Pages/HowtoImprove/ScienceofImprovementEstablishingMeasures.aspx)
•• Gittell JH. High performance healthcare: using the power of relationships to achieve quality, efficiency and resilience. New York: McGraw-Hill; 2009 .This text reference explains the critical concepts of “relational coordination” and the coordination of work through shared goals, shared knowledge, and mutual respect. Text includes case studies illustrating how some healthcare organizations are utilizing the theory to drive improvement and transformational change.
Gittell JH. The southwest way: using the power of relationships to achieve high performance. New York: McGraw-Hill; 2003.
Gittell JH, et al. Impact of relational coordination on quality of care, post-operative pain and functioning, and length of stay: a nine hospital study of surgical patients. Med Care. 2000;38(8):807–19.
Gittell JH, Weinberg DB, Pfefferle S, Bishop C. Impact of relational coordination on job satisfaction and quality outcomes: a study of nursing homes. Hum Resour Manag J. 2008;19(2):154–70.
Hartgerink JM, et al. The importance of relational coordination for integrated care delivery to older patients in the hospital. J Nurs Manag. 2012.
Conflict of Interest
Henrisa Tosoc-Haskell reports that she is a director of Member Quality at United Network of Organ Sharing/Organ Procurement Transplant Network, a contractor under the direction of HRSA. David Klassen and Maureen McBride declare no conflict of interests.
Human and Animal Rights and Informed Consent
This article does not contain any studies with human or animal subjects performed by any of the authors.
This article is part of the Topical Collection on OPTN Policy
About this article
Cite this article
Klassen, D.K., McBride, M.A. & Tosoc-Haskell, H. A Look into a New Approach to Transplant Program Evaluation—the COIIN Project. Curr Transpl Rep 4, 59–66 (2017). https://doi.org/10.1007/s40472-017-0140-2
- Risk aversion
- Performance metrics
- Program specific reports
- Kidney transplantation
- Collaborative innovation and improvement network