Skip to main content

Accuracy of residual respiratory event detection by CPAPs: a meta-analysis

Sleep and Breathing (2023)Cite this article

Abstract

Purpose

Most continuous positive airway pressure (CPAP) machines have built-in manufacturer-specific proprietary algorithms for automatic respiratory event detection (AED) based on very specific respiratory events scoring criteria. With regards to the accuracy of these data from CPAP machines, evidence from the literature seems conflicting, which formed the basis for this meta-analysis.

Methods

A meta-analysis was performed on studies that reported Bland-Altman analysis data on agreement (mean bias and limits of agreement [LoA]) of CPAP-determined apnea-hypopnea index (AHI) at therapeutic pressures (AHIFLOW) with that determined from simultaneously conducted polysomnograms (AHIPSG).

Results

In six studies, ResMed CPAPs were used, and in another six studies, Respironics CPAPs were used, while only one study used Fisher & Paykel (F&P) CPAPs. The pooled mean AHI bias from ResMed CPAP studies was − 1.01 with pooled LoAs from − 3.55 to 1.54 (I2 = 17.5%), and from Respironics CPAP studies, pooled mean AHI bias was − 0.59 with pooled LoAs from − 3.22 to 2.05 (I2 = 0%). Pooled percentage errors (corresponding to LoAs) from four ResMed CPAP studies, four Respironics CPAP studies, and the F&P CPAP study were 73%, 59%, and 112%, respectively. A review of the literature for this meta-analysis also revealed lack of uniformity not only in the CPAP manufacturers’ respiratory events scoring criteria but also in that used for PSGs across the studies analyzed.

Conclusions

Even though the pooled results of mean AHI bias suggest good clinical agreement between AHIPSG and AHIFLOW, percentage errors calculated in this meta-analysis indicate the possibility of a significant degree of imprecision in the estimation of AHIFLOW by CPAP machines.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Data availability

On reasonable request, data can be made available.

References

  1. Patil SP, Ayappa IA, Caples SM, Kimoff RJ, Patel SR, Harrod CG (2019) Treatment of adult obstructive sleep apnea with positive airway pressure: an American Academy of Sleep Medicine Clinical Practice Guideline. J Clin Sleep Med 15(2):335–343. https://doi.org/10.5664/jcsm.7640

    Article  Google Scholar 

  2. Ikeda Y, Kasai T, Kawana F, Kasagi S, Takaya H, Ishiwata S, Narui K (2012) Comparison between the apnea-hypopnea indices determined by the REMstar Auto M series and those determined by standard in-laboratory polysomnography in patients with obstructive sleep apnea. Intern Med 51(20):2877–2885. https://doi.org/10.2169/internalmedicine.51.8249

    Article  Google Scholar 

  3. Baek JJJ, Lee S (2016) Accuracy of the auto scoring by the S9 CPAP in patients with obstructive sleep apnea. Sleep Med Res 7(1):26–32

    Article  Google Scholar 

  4. Li QY, Berry RB, Goetting MG, Staley B, Soto-Calderon H, Tsai SC, Jasko JG, Pack AI, Kuna ST (2015) Detection of upper airway status and respiratory events by a current generation positive airway pressure device. Sleep 38(4):597–605. https://doi.org/10.5665/sleep.4578

    Article  Google Scholar 

  5. Ueno K, Kasai T, Brewer G, Takaya H, Maeno K, Kasagi S, Kawana F, Ishiwata S, Narui K (2010) Evaluation of the apnea-hypopnea index determined by the S8 auto-CPAP, a continuous positive airway pressure device, in patients with obstructive sleep apnea-hypopnea syndrome. J Clin Sleep Med 6(2):146–151

    Article  Google Scholar 

  6. Denotti AL, Wong KK, Dungan GC 2nd, Gilholme JW, Marshall NS, Grunstein RR (2012) Residual sleep-disordered breathing during autotitrating continuous positive airway pressure therapy. Eur Respir J 39(6):1391–1397. https://doi.org/10.1183/09031936.00093811

    Article  Google Scholar 

  7. Prasad B, Carley DW, Herdegen JJ (2010) Continuous positive airway pressure device-based automated detection of obstructive sleep apnea compared to standard laboratory polysomnography. Sleep Breath 14(2):101–107. https://doi.org/10.1007/s11325-009-0285-z

    Article  Google Scholar 

  8. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R, Glanville J, Grimshaw JM, Hrobjartsson A, Lalu MM, Li T, Loder EW, Mayo-Wilson E, McDonald S, McGuinness LA, Stewart LA, Thomas J, Tricco AC, Welch VA, Whiting P, Moher D (2021) The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Rev Esp Cardiol (Engl Ed) 74(9):790–799. https://doi.org/10.1016/j.rec.2021.07.010

    Article  Google Scholar 

  9. Iftikhar IH, Finch CE, Shah AS, Augunstein CA, Ioachimescu OC (2022) A meta-analysis of diagnostic test performance of peripheral arterial tonometry studies. J Clin Sleep Med 18(4):1093–1102. https://doi.org/10.5664/jcsm.9808

    Article  Google Scholar 

  10. Joosten A, Desebbe O, Suehiro K, Murphy LS, Essiet M, Alexander B, Fischer MO, Barvais L, Van Obbergh L, Maucort-Boulch D, Cannesson M (2017) Accuracy and precision of non-invasive cardiac output monitoring devices in perioperative medicine: a systematic review and meta-analysisdagger. Br J Anaesth 118(3):298–310. https://doi.org/10.1093/bja/aew461

    Article  CAS  Google Scholar 

  11. Higgins JP, Thompson SG (2002) Quantifying heterogeneity in a meta-analysis. Stat Med 21(11):1539–1558. https://doi.org/10.1002/sim.1186

    Article  Google Scholar 

  12. Berry RB, Kushida CA, Kryger MH, Soto-Calderon H, Staley B, Kuna ST (2012) Respiratory event detection by a positive airway pressure device. Sleep 35(3):361–367. https://doi.org/10.5665/sleep.1696

    Article  Google Scholar 

  13. Cilli A, Uzun R, Bilge U (2013) The accuracy of autotitrating CPAP-determined residual apnea-hypopnea index. Sleep Breath 17(1):189–193. https://doi.org/10.1007/s11325-012-0670-x

    Article  Google Scholar 

  14. Gagnadoux F, Pevernagie D, Jennum P, Lon N, Loiodice C, Tamisier R, van Mierlo P, Trzepizur W, Neddermann M, Machleit A, Jasko J, Pepin JL (2017) Validation of the system One RemStar Auto A-Flex for obstructive sleep apnea treatment and detection of residual apnea-hypopnea index: a European randomized trial. J Clin Sleep Med 13(2):283–290. https://doi.org/10.5664/jcsm.6464

    Article  Google Scholar 

  15. Khirani S, Delord V, Olmo Arroyo J, De Sanctis L, Frapin A, Amaddeo A, Fauroux B (2017) Can the analysis of built-in software of CPAP devices replace polygraphy in children? Sleep Med 37:46–53. https://doi.org/10.1016/j.sleep.2017.05.019

    Article  Google Scholar 

  16. Kim DE, Hwangbo Y, Bae JH, Yang KI (2015) Accuracy of residual apnea-hypopnea index obtained using the continuous positive airway pressure device: application of new version 2.0 scoring rules for respiratory events during sleep. Sleep Breath 19(4):1335–1341. https://doi.org/10.1007/s11325-015-1257-0

    Article  Google Scholar 

  17. Mihai R, Ellis K, Davey MJ, Nixon GM (2020) Interpreting CPAP device respiratory indices in children. J Clin Sleep Med 16(10):1655–1661. https://doi.org/10.5664/jcsm.8618

    Article  Google Scholar 

  18. Nigro CA, Gonzalez S, Arce A, Aragone MR, Nigro L (2015) Accuracy of a novel auto-CPAP device to evaluate the residual apnea-hypopnea index in patients with obstructive sleep apnea. Sleep Breath 19(2):569–578. https://doi.org/10.1007/s11325-014-1048-z

    Article  Google Scholar 

  19. Schwab RJ, Badr SM, Epstein LJ, Gay PC, Gozal D, Kohler M, Levy P, Malhotra A, Phillips BA, Rosen IM, Strohl KP, Strollo PJ, Weaver EM, Weaver TE, Systems ATSSoCAT (2013) An official American Thoracic Society statement: continuous positive airway pressure adherence tracking systems. The optimal monitoring strategies and outcome measures in adults. Am J Respir Crit Care Med 188(5):613–620. https://doi.org/10.1164/rccm.201307-1282ST

    Article  Google Scholar 

  20. Reiter J, Zleik B, Bazalakova M, Mehta P, Thomas RJ (2016) Residual events during use of CPAP: prevalence, predictors, and detection accuracy. J Clin Sleep Med 12(8):1153–1158. https://doi.org/10.5664/jcsm.6056

    Article  Google Scholar 

  21. Ni YN, Thomas RJ (2022) A longitudinal study of the accuracy of positive airway pressure therapy machine-detected apnea-hypopnea events. J Clin Sleep Med 18(4):1121–1134. https://doi.org/10.5664/jcsm.9814

    Article  Google Scholar 

  22. Geissbuhler M, Hincapie CA, Aghlmandi S, Zwahlen M, Juni P, da Costa BR (2021) Most published meta-regression analyses based on aggregate data suffer from methodological pitfalls: a meta-epidemiological study. BMC Med Res Methodol 21(1):123. https://doi.org/10.1186/s12874-021-01310-0

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Medicine, Division of Pulmonary, Allergy, Critical Care & Sleep Medicine, Emory University School of Medicine, 613 Michael St., Atlanta, GA, USA

    Imran H. Iftikhar & Octavian Ioachimescu

  2. Atlanta Veterans Affairs Medical Center, Decatur, GA, USA

    Imran H. Iftikhar & Octavian Ioachimescu

  3. The University Sleep Disorders Center, Department of Medicine, College of Medicine, King Saud University, Riyadh, Saudi Arabia

    Ahmed BaHammam

  4. Strategic Technologies Program of the National Plan for Sciences and Technology and Innovation in the Kingdom of Saudi Arabia (08-MED511-02), Riyadh, Saudi Arabia

    Ahmed BaHammam

  5. Ministry of Health, Manama, Bahrain

    Haitham Jahrami

  6. College of Medicine and Medical Sciences, Arabian Gulf University, Manama, Bahrain

    Haitham Jahrami

Authors
  1. Imran H. Iftikhar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ahmed BaHammam
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Haitham Jahrami
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Octavian Ioachimescu
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

IHI had full access to all extracted data and took responsibility for the integrity of these data and the accuracy of data analysis. IHI conceptualized the study, searched databases, extracted and analyzed data, and wrote the first draft of the manuscript. HJ contributed to the study’s quality assessment. AB contributed to the database search. OI contributed to Table 1. All authors contributed to editing and revising the manuscript.

Corresponding author

Correspondence to Imran H. Iftikhar.

Ethics declarations

Ethical approval

Ethical approval is not required for this type of study (meta-analysis of published studies).

Informed consent

Informed consent is not required for this type of study (meta-analysis of published studies). Additionally, this article does not contain any studies with human participants performed by any of the authors.

Conflict of interest

The authors declare no competing interests.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 156 KB)

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Iftikhar, I.H., BaHammam, A., Jahrami, H. et al. Accuracy of residual respiratory event detection by CPAPs: a meta-analysis. Sleep Breath (2023). https://doi.org/10.1007/s11325-023-02780-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11325-023-02780-w

Keywords

  • Apnea–hypopnea index
  • Continuous positive airway pressure
  • Polysomnogram: meta-analysis