Skip to main content

Advertisement

Log in

Effect of concurrent oxygen therapy on accuracy of forecasting imminent postoperative desaturation

  • Original Research
  • Published:
Journal of Clinical Monitoring and Computing Aims and scope Submit manuscript

Abstract

Episodic postoperative desaturation occurs predominantly from respiratory depression or airway obstruction. Monitor display of desaturation is typically delayed by over 30 s after these dynamic inciting events, due to perfusion delays, signal capture and averaging. Prediction of imminent critical desaturation could aid development of dynamic high-fidelity response systems that reduce or prevent the inciting event from occurring. Oxygen therapy is known to influence the depth and duration of desaturation epochs, thereby potentially influencing the accuracy of forecasting of desaturation. In this study, postoperative pulse oximetry data were retrospectively modeled using autoregressive methods to create prediction models for \({\hbox {SpO}}_2\) and imminent critical desaturation in the postoperative period. The accuracy of these models in predicting near future \({\hbox {SpO}}_2\) values was tested using root mean square error. The model accuracy for prediction of critical desaturation (\({\hbox {SpO}}_2\) \(\le 89\,\%\)) was evaluated using meta-analytical methods (sensitivity, specificity, likelihood ratios, diagnostic odds ratios and area under summary receiver operating characteristic curves). Between-study heterogeneity was used as a measure of reliability of the model across different patients and evaluated using the tau-squared statistic. Model performance was evaluated in \(20\) patients who received postoperative oxygen supplementation and \(20\) patients who did not receive oxygen. Our results show that model accuracy was high with root mean square errors between 0.2 and 2.8 %. Prediction accuracy as defined by area under the curve for critical desaturation events was observed to be greater in patients receiving oxygen in the 60-s horizon (\(0.95\pm 0.04\) vs. \(0.76\pm 0.16\)). This was likely related to the higher frequency of events in this group (median [IQR] \(133.0\) \([31.5, 508.2]\)) than patients who were not treated with oxygen (\(0\) \([0,110]\); \(p<0.001\)). Model reliability was reflected by the homogeneity of the prediction models which were homogenous across both prediction horizons and oxygen treatment groups. In conclusion, we report the use of autoregressive models to predict \({\hbox {SpO}}_2\) and forecast imminent critical desaturation events in the postoperative period with high degree of accuracy. These models reliably predict critical desaturation in patients receiving supplemental oxygen therapy. While high-fidelity prophylactic interventions that could modify these inciting events are in development, our current study offers proof of concept that the afferent limb of such a system can be modeled with a high degree of accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Ramachandran SK, Haider N, Saran KA, Mathis M, Kim J, Morris M, O’Reilly M. Life-threatening critical respiratory events: a retrospective study of postoperative patients found unresponsive during analgesic therapy. J Clin Anesth. 2011;23(3):207–13.

    Article  PubMed  Google Scholar 

  2. Taylor S, Kirton OC, Staff I, Kozol RA. Postoperative day one: a high risk period for respiratory events. Am J Surg. 2005;190(5):752–6.

    Article  PubMed  Google Scholar 

  3. Hamber EA, Bailey PL, James SW, Wells DT, Lu JK, Pace NL. Delays in the detection of hypoxemia due to site of pulse oximetry probe placement. J Clin Anesth. 1999;11(2):113–8.

    Article  CAS  PubMed  Google Scholar 

  4. Rheineck-Leyssius AT, Kalkman CJ. Advanced pulse oximeter signal processing technology compared to simple averaging II. Effect on frequency of alarms in the postanesthesia care unit. J Clin Anesth. 1999;11(3):196–200.

    Article  CAS  PubMed  Google Scholar 

  5. Rheineck-Leyssius AT, Kalkman CJ. Advanced pulse oximeter signal processing technology compared to simple averaging I. Effect on frequency of alarms in the operating room. J Clin Anesth. 1999;11(3):192–5.

    Article  CAS  PubMed  Google Scholar 

  6. Trivedi NS, Ghouri AF, Shah NK, Lai E, Barker SJ. Pulse oximeter performance during desaturation and resaturation: a comparison of seven models. J Clin Anesth. 1997;9(3):184–8.

    Article  CAS  PubMed  Google Scholar 

  7. Trivedi NS, Ghouri AF, Shah NK, Lai E, Barker SJ. Effects of motion, ambient light, and hypoperfusion on pulse oximeter function. J Clin Anesth. 1997;9(3):179–83.

    Article  CAS  PubMed  Google Scholar 

  8. Claure N, Bancalari E, D’Ugard C, Nelin L, Stein M, Ramanathan R, Hernandez R, Donn SM, Becker M, Bachman T. Multicenter crossover study of automated control of inspired oxygen in ventilated preterm infants. Pediatrics. 2011;127(1):e76–83.

    Article  PubMed  Google Scholar 

  9. ElMoaqet H, Tilbury DM, Ramachandran S-K. Predicting oxygen saturation levels in blood using autoregressive models: a threshold metric for evaluating predictive models. Proceedings of American control conference, 2013. p. 734–739.

  10. ElMoaqet H, Tilbury D, Ramachandran SK. Evaluating predictions of critical oxygen desaturation events. Physiol Meas. 2014;35(4):639–55.

    Article  PubMed  Google Scholar 

  11. Bremer T, Gough DA. Is blood glucose predictable from previous values? A solicitation for data. Diabetes. 1999;48(1):403–22.

    Google Scholar 

  12. Dua P, Doyle FJ, Pistikopoulos EN. Model-based blood glucose control for type 1 diabetes via parametric programming. IEEE Trans Biomed Eng. 2006;53(8):1478–91.

    Article  PubMed  Google Scholar 

  13. Gani A, Gribok A, Rajaraman S, Ward W, Reifman J. Predicting subcutaneous glucose concentration in humans: data-driven glucose modeling. IEEE Trans Biomed Eng. 2009;56(2):246–54.

    Article  PubMed  Google Scholar 

  14. Gani A, Gribok A, Lu Y, Ward W, Vigersky RA, Reifman J. Universal glucose models for predicting subcutaneous glucose concentration in humans. IEEE Trans Inf Technol Biomed. 2010;14(1):157–65.

    Article  PubMed  Google Scholar 

  15. Reifman J, Rajaraman S, Gribok A, Ward W. Predictive monitoring for improved management of glucose levels. Diabetes Sci Technol. 2007;1(4):478–86.

    Article  Google Scholar 

  16. Sparacino G, Zanderigo F, Corazza S, Maran A, Facchinetti A, Cobelli C. Glucose concentration can be predicted ahead in time from continuous glucose monitoring sensor time-series. IEEE Trans Biomed Eng. 2007;54(5):931–7.

    Article  PubMed  Google Scholar 

  17. Sparacino G, Facchinetti A, Cobelli C. Smart continuous glucose monitoring sensors: on-line signal processing issues. Sensors. 2010;10(7):6751–72.

    Article  PubMed Central  PubMed  Google Scholar 

  18. Trajanoski Z, Regittnig W, Wach P. Simulation studies on neural predictive control of glucose using the subcutaneous route. Comput Methods Programs Biomed. 1998;56(2):133–9.

    Article  CAS  PubMed  Google Scholar 

  19. Fu ES, Downs JB, Schweiger JW, Miguel RV, Smith RA. Supplemental oxygen impairs detection of hypoventilation by pulse oximetry. CHEST J. 2004;126(5):1552–8.

    Article  Google Scholar 

  20. Voepel-Lewis T, Parker ML, Burke CN, Hemberg J, Perlin L, Kai S, Ramachandran SK. Pulse oximetry desaturation alarms on a general postoperative adult unit: a prospective observational study of nurse response time. Int J Nurs Stud. 2013;50(10):1351–8.

    Article  PubMed  Google Scholar 

  21. Centers for Medicare and Medicaid Services. National coverage determination (NCD) for home use of oxygen. 1993.

  22. Astrom K, Wittenmark B. Computer controlled systems: theory and design. Upper Saddle River, NJ: Prentice Hall; 1997.

    Google Scholar 

  23. Ljung L. System identification: theory for the user. Upper Saddle River, NJ: Prentice-Hall; 1987.

    Google Scholar 

  24. Clarke WL. The original Clarke error grid analysis (EGA). Diabetes Technol Therapeutics. 2005;7(5):776–9.

    Article  Google Scholar 

  25. Armstrong JS, Collopy F. Error measures for generalizing about forecasting methods: empirical comparisons. Int J Forecast. 1992;8(1):69–80.

    Article  Google Scholar 

  26. Hyndman RJ, Koehler AB. Another look at measures of forecast accuracy. Int J Forecast. 2006;22:679–88.

    Article  Google Scholar 

  27. Altman DG, Bland JM. Diagnostic tests 2: predictive values. Br Med J. 1994;309(6947):102.

    Article  CAS  Google Scholar 

  28. Altman DG, Bland JM. Diagnostic tests 1: sensitivity and specificity. Br Med J. 1994;308(6943):1552.

    Article  CAS  Google Scholar 

  29. Deeks JJ. Systematic reviews of evaluations of diagnostic and screening tests. BMJ. 2001;323(7305):157–62.

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  30. Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt PM. The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol. 2003;56(11):1129–35.

    Article  PubMed  Google Scholar 

  31. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (roc) curve. Radiology. 1982;143(1):29–36.

    Article  CAS  PubMed  Google Scholar 

  32. Moses LE, Shapiro D, Littenberg B. Combining independent studies of a diagnostic test into a summary roc curve: data-analytic approaches and some additional considerations. Stat Med. 1993;12(14):1293–316.

    Article  CAS  PubMed  Google Scholar 

  33. Ramachandran SK, Josephs LA. A meta-analysis of clinical screening tests for obstructive sleep apnea. Anesthesiology. 2009;110(4):928–39.

    Article  PubMed  Google Scholar 

  34. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. Br Med J. 2003;327(7414):557.

    Article  Google Scholar 

  35. Higgins JP. Commentary: heterogeneity in meta-analysis should be expected and appropriately quantified. Int J Epidemiol. 2008;37(5):1158–60.

    Article  PubMed  Google Scholar 

  36. Mitchell MD. Validation of the summary ROC for diagnostic test meta-analysis: a monte carlo simulation. Acad Radiol. 2003;10(1):25–31.

    Article  PubMed  Google Scholar 

  37. Walter S. Properties of the summary receiver operating characteristic (sroc) curve for diagnostic test data. Stat Med. 2002;21(9):1237–56.

    Article  CAS  PubMed  Google Scholar 

  38. Leemis LM, Trivedi KS. A comparison of approximate interval estimators for the bernoulli parameter. Am Stat. 1996;50(1):63–8.

    Google Scholar 

  39. Taenzer AH, Pyke J, McGrath S, Blike G. Impact of pulse oximetry surveillance on rescue events and intensive care unit transfers: a before-and-after concurrence study. Anesthesiology. 2010;112(1):282–7.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

Dr. Ramachandran has received honoraria from Merck for consulting and research support in the current year. This research was supported in part by the National Center for Advancing Translational Sciences of the National Institutes of Health under Award Number \(2UL1TR000433\). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hisham ElMoaqet.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

ElMoaqet, H., Tilbury, D.M. & Ramachandran, S.K. Effect of concurrent oxygen therapy on accuracy of forecasting imminent postoperative desaturation. J Clin Monit Comput 29, 521–531 (2015). https://doi.org/10.1007/s10877-014-9629-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10877-014-9629-8

Keywords

Navigation