Skip to main content

Risk-Adjusted Cumulative Sum Charting Procedures

  • Chapter
  • First Online:
Book cover Frontiers in Statistical Quality Control 10

Part of the book series: Frontiers in Statistical Quality Control ((FSQC,volume 10))

Abstract

Risk-adjusted charting procedures for monitoring the performances of a cardiac surgeon or a group of surgeons have recently gained prominence. Charting procedures developed for manufacturing processes are no longer appropriate because they do not take a patient’s risk into account. The first charting procedure, variable life-adjusted display (VLAD) that takes a patient’s risk into account was introduced in 1997. The VLAD plots the predicted mortality count minus the observed count cumulatively. The statistic plotted is intuitive and it has gained widespread attention and adoption. However, the run length performance of this chart is still not clearly understood because of the lack of a proper signalling rule. A risk-adjusted cumulative sum (RA-CUSUM) chart based on testing the odds ratio that a patient dies was proposed in 2000. In this paper, we developed and studied a general RA-CUSUM chart of which the RA-CUSUM chart based on odds ratio is a special case. The general RA-CUSUM chart allows testing to be done beyond just testing the odds ratio. One interesting note: although the VLAD and RA-CUSUM chart look seemingly different, we show that the RA-CUSUM chart and the RA-CUSUM chart based on the VLAD’s monitoring statistic are in fact the same chart.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Benneyan, J. C., & Borgman, A. D. (2003). Risk-adjusted sequential probability ratio tests and longitudinal surveillance methods. International Journal for Quality in Health Care, 15, 5–6.

    Google Scholar 

  2. Biswas, P., & Kalbfleisch, J. D. (2008). A Risk-adjusted CUSUM in continuous time based on the cox model. Statistics in Medicine, 27, 3382–3406.

    Google Scholar 

  3. Blackstone, E. H. (2004). Monitoring surgical performance. The Journal of Thoracic and Cardiovascular Surgery, 128, 807–810.

    Google Scholar 

  4. Chang, T. C. (2008). Cumulative sum schemes for surgical performance monitoring. Journal of the Royal Statistical Society Series A, 171, 407–432.

    Google Scholar 

  5. Coory, M., Duckett, S., & Sketcher-Baker K. (2008). Using control charts to monitor quality of hospital care with administrative data. International Journal for Quality in Health Care, 20, 31–39.

    Google Scholar 

  6. Dorsch, M. F., Lawrance, R. A., Sapsford, R. J., Oldham, J., Greenwood, D. C., Jackson, B. M., Morrell, C., Ball, S. G., Robinson, M. B., Hall, A. S., & The EMMACE Study Group. (2001). A simple benchmark for evaluating quality of care of patients following acute myocardial infarction. Heart, 86, 150–154.

    Google Scholar 

  7. Gan, F. F., & Tan, T. (2010) Risk-adjusted number-between failures charting procedures for monitoring a patient care process for acute myocardial infarctions. Health Care Management Science, 13, 222–233.

    Google Scholar 

  8. Gandy, A., Kvaloy, J. T., Bottle, A., & Zhou, F. (2010) Risk-adjusted monitoring of time to event. Biometrika, 97, 375–388.

    Google Scholar 

  9. Grigg, O., & Farewell, V. (2004). An overview of risk-adjusted charts. Journal of the Royal Statistical Society, Series A, 167, 523–539.

    Google Scholar 

  10. Grigg, O., & Spiegelhalter, D. J. (2007). A simple risk-adjusted exponentially weighted moving average. Journal of the American Statistical Association, 102, 140–152.

    Google Scholar 

  11. Grigg, O., Farewell, V., & Spiegelhalter, D. J. (2003). Use of risk-adjusted CUSUM and RSPRT charts for monitoring in medical contexts. Statistical Methods in Medical Research, 12, 147–170.

    Google Scholar 

  12. Grunkemeier, G. L., Wu, Y. X., & Furnary, A.P. (2003). Cumulative sum techniques for assessing surgical results. Annals of Thoracic Surgery, 76, 663–667.

    Google Scholar 

  13. Gustafson, T. L. (2000). Practical risk-adjusted quality control charts for infection control. American Journal of Infection Control, 28, 406–414.

    Google Scholar 

  14. Hackbusch, W. (1995). Integral equations: Theory and numerical treatment (International series of numerical mathematics, Vol. 120). Basel/Boston/Berlin: Birkhäuser.

    Google Scholar 

  15. Knoth, S. (2005). Accurate ARL computation for EWMA-S 2 control charts. Statistics and Computing, 15, 341–352.

    Google Scholar 

  16. Knoth, S. (2007). Accurate ARL computation for EWMA control charts monitoring normal mean and variance simultaneously. Sequential Analysis, 26, 251–263.

    Google Scholar 

  17. Loke, C. K., & Gan, F. F. (2012) Joint monitoring scheme for clinical failures and predisposed risks. Quality Technology and Quantitative Management, 9, 3–21.

    Google Scholar 

  18. Lovegrove, J., Valencia, O., Treasure, T., Sherlaw-Johnson, C., & Gallivan, S. (1997). Monitoring the results of cardiac surgery by variable-life-adjusted display. The Lancet, 350, 1128–1130.

    Google Scholar 

  19. Lovegrove, J., Sherlaw-Johnson, C., Valencia, O., & Gallivan, S. (1999). Monitoring the performance of cardiac surgeons. Journal of the Operational Research Society, 50, 685–689.

    Google Scholar 

  20. Manche, A., & Schembri, K. (2005). Evaluating a trainee’s progress in surgical dexterity. Malta Medical Journal, 17, 49–53.

    Google Scholar 

  21. Moustakides, G. V. (1986). Optimal stopping times for detecting changes in distributions. The Annals of Statistics, 14, 1379–1387.

    Google Scholar 

  22. Novick, R. J., Fox, S. A., Stitt, L. W., & Forbes, T. L. (2006). Direct comparison of risk-adjusted and non-risk-adjusted CUSUM analysis of coronary artery bypass surgery outcomes. The Journal of Thoracic and Cardiovascular Surgery, 132, 386–391.

    Google Scholar 

  23. Page, E. S. (1954). Continuous inspection schemes. Biometrika, 41, 100–115.

    Google Scholar 

  24. Parsonnet, V., Dean, D., & Bernstein, A. D. (1989). A method of uniform stratification of risks for evaluating the results of surgery in acquired adult heart disease. Circulation, 779 (Suppl 1), 1–12.

    Google Scholar 

  25. Poloniecki, J., Valencia, O., & Littlejohns, P. (1998). Cumulative risk adjusted mortality chart for detecting changes in death rate: Observational study of heart surgery. British Medical Journal, 316, 1697–1700.

    Google Scholar 

  26. Reynolds, M. R., Jr., & Stoumbos, Z. G. (1999). A CUSUM chart for monitoring a proportion when inspecting continuously. Journal of Quality Technology, 31, 87–108.

    Google Scholar 

  27. Rogers, C. A., Reeves, B. C., Caputo, M., Ganesh, J. S., Bosner, R. S., & Angelini, G. D. (2004). Control chart methods for monitoring cardiac surgical performance and their interpretation. The Journal of Thoracic and Cardiovascular Surgery, 128, 811–819.

    Google Scholar 

  28. Roques F., Nashef S. A., Michel P., Gauducheau E., de Vincentiis C., Baudet E., Cortina J., David M., Faichney A., Gabrielle F., Gams E., Harjula A., Jones M. T., Pintor P. P., Salamon R., & Thulin L. (1999). Risk factors and outcome in European cardiac surgery: Analysis of the EuroSCORE multinational database of 19030 patients. European Journal of Cardio-Thoracic Surgery, 15(6), 816–22; discussion 822–823.

    Google Scholar 

  29. Ross, S. (2006). A first course in probability (7th ed.). New Jersey: Pearson Prentice Hall.

    Google Scholar 

  30. Sherlaw-Johnson, C. (2005). A method for detecting runs of good and bad clinical outcomes on variable life-adjusted displays (VLAD) charts. Health Care Management Science, 8, 61–65.

    Google Scholar 

  31. Sismanidis, C., Bland, M., & Poloniecki, J. (2003). Properties of the cumulative risk-adjusted mortality (CRAM) chart, including the number of deaths before a doubling of the death rate is detected. Medical Decision Making, 23, 242–251.

    Google Scholar 

  32. Spiegelhalter, D. J. (2004). Monitoring clinical performance: A commentary. The Journal of Thoracic and Cardiovascular Surgery, 128, 820–822.

    Google Scholar 

  33. Spiegelhalter, D., Grigg, O., Kinsman, R., & Treasure, T. (2003). Risk-adjusted sequential probability ratio tests: Applications to Bristol, shipman and adult cardiac surgery. International Journal for Quality in Health Care, 15, 7–13.

    Google Scholar 

  34. Steiner, S. H., & Jones, M. (2010). Risk-adjusted survival time monitoring with an updating exponentially weighted moving average (EWMA) control chart. Statistics in Medicine, 29, 444–454.

    Google Scholar 

  35. Steiner, S. H., Cook, R. J., Farewell, V. T., & Treasure, T. (2000). Monitoring surgical performances using risk-adjusted cumulative sum charts. Biostatistics, 1, 441–452.

    Google Scholar 

  36. Treasure, T., Valencia, O., Sherlaw-Johnson, C., & Gallivan, S. (2002). Surgical performance measurement. Health Care Management Science, 5, 243–248.

    Google Scholar 

  37. Treasure, T., Gallivan, S., & Sherlaw-Johnson, C. (2004). Monitoring cardiac surgical performance: A commentary. The Journal of Thoracic and Cardiovascular Surgery, 128, 823–825.

    Google Scholar 

  38. Wald, A. (1947). Sequential analysis. New York: John Wiley.

    Google Scholar 

  39. Woodall, W. H. (2006). The use of control charts in health-care and public-health surveillance (with discussion). Journal of Quality Technology, 38, 89–134.

    Google Scholar 

Download references

Acknowledgements

The first and third authors are supported by the Academic Research Fund Tier 1 (R-155-000-092-112), Ministry of Education, Singapore. We wish to thank Dr Alistair Hall for providing the data from the EMMACE-1 Study and the permission to use it here.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fah F. Gan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Gan, F.F., Lin, L., Loke, C.K. (2012). Risk-Adjusted Cumulative Sum Charting Procedures. In: Lenz, HJ., Schmid, W., Wilrich, PT. (eds) Frontiers in Statistical Quality Control 10. Frontiers in Statistical Quality Control, vol 10. Physica, Heidelberg. https://doi.org/10.1007/978-3-7908-2846-7_15

Download citation

Publish with us

Policies and ethics