Skip to main content
SpringerLink
Log in

Reliability of drug-induced sedation endoscopy: interobserver agreement

  • ENT • Original Article
  • Published:
Sleep and Breathing Aims and scope Submit manuscript

Abstract

Purpose

Several studies have demonstrated the validity, reliability, and safety of drug-induced sedation endoscopy (DISE) in assessing the collapse of the upper airway (UA) in patients with obstructive sleep apnea hypoapnea syndrome (OSAHS). The aim of this study was to assess the interobserver agreement on DISE and on therapeutic decision between an expert observer and an observer in training.

Methods

This was a cross-sectional study. Thirty-one DISE videos performed in our service were randomly selected. Videos belonged to patients with OSAHS who wanted alternative treatments to CPAP. The videos were reviewed by an ENT experienced on DISE and a second observer in formation. Each observer independently assessed the presence of collapse of the UA according to a modified VOTE classification and proposed an alternative treatment to CPAP. Interobserver agreement kappa values were calculated.

Results

In assessing the presence of collapse at different levels of the upper airway, the percentage of agreement was 80 % at the level of the soft palate (kappa = 0.1667), 89.29 % in the oropharynx (k = 0.7742), 80.65 % at the tongue base (k = 0.5571), and 74.17 % at the epiglottis (k = 0.4768). When degree and configuration of the collapse was evaluated, the interrater agreement was moderate to good, except at the level of the tongue base where the agreement was weak for both degree and configuration of collapse (k = 0.34 and 0.38, respectively). Interobserver agreement was moderate when the indication of alternative treatments to CPAP is valued based on the findings of DISE.

Conclusions

Overall, DISE is a reliable technique even when assessing interobserver agreement between an experienced observer and one in training; however, tongue base is the level of the upper airway that presents the greatest difficulties when assessing the collapse with DISE. Therefore, it is important to develop learning curves for this technique in order to obtain more reliable results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Sher AE, Schechtman KB, Piccirillo JF (1996) The efficacy of surgical modifications of the upper airway in adults with obstructive sleep apnea syndrome. Sleep 19:156–177

    CAS  PubMed  Google Scholar 

  2. Caples SM, Rowley JA, Prinsell JR et al (2010) Surgical modifications of the upper airway for obstructive sleep apnea in adults: a systematic review and meta-analysis. Sleep 33:1396–1407

    PubMed  PubMed Central  Google Scholar 

  3. Hessel NS, de Vries N (2003) Results of uvulopalatopharyngoplasty after diagnostic workup with polysomnography and sleep endoscopy: a report of 136 snoring patients. Eur Arch Otorhinolaryngol 260:91–95. doi:10.1007/s00405-002-0511-9

    PubMed  Google Scholar 

  4. Katsantonis G (2010) A review of the managemente of obstructive sleep apnea in adults. Otorhinolaryngol Neck Surg:10–41

  5. Vanderveken OM (2013) Drug-induced sleep endoscopy (DISE) for non-CPAP treatment selection in patients with sleep-disordered breathing. Sleep Breath 17:13–14. doi:10.1007/s11325-012-0671-9

    Article  PubMed  Google Scholar 

  6. Carrasco-Llatas M, Dalmau-Galofre J, Lopez Martinez R et al (2005) Our findings in the sleep endoscopy exams. Acta Otorrinolaringol Esp 56:17–21. doi:10.1016/S0001-6519(05)78564-2

    Article  CAS  PubMed  Google Scholar 

  7. Croft CB, Pringle M (1991) Sleep nasendoscopy: a technique of assessment in snoring and obstructive sleep apnoea. Clin Otolaryngol Allied Sci 16:504–509

    Article  CAS  PubMed  Google Scholar 

  8. Borek RC, Thaler ER, Kim C et al (2012) Quantitative airway analysis during drug-induced sleep endoscopy for evaluation of sleep apnea. Laryngoscope 122:2592–2599. doi:10.1002/lary.23553

    Article  PubMed  Google Scholar 

  9. Rabelo FAW, Braga A, Küpper DS et al (2010) Propofol-induced sleep: polysomnographic evaluation of patients with obstructive sleep apnea and controls. Otolaryngol Head Neck Surg 142:218–224. doi:10.1016/j.otohns.2009.11.002

    Article  PubMed  Google Scholar 

  10. Abdullah VJ, Lee DLY, Ha SCN, van Hasselt CA (2013) Sleep endoscopy with midazolam: sedation level evaluation with bispectral analysis. Otolaryngol neck Surg Off J Am Acad Otolaryngol Neck Surg 148:331–337. doi:10.1177/0194599812464865

    Article  Google Scholar 

  11. Berry S, Roblin G, Williams A et al (2005) Validity of sleep nasendoscopy in the investigation of sleep related breathing disorders. Laryngoscope 115:538–540. doi:10.1097/01.mlg.0000157849.16649.6e

    Article  CAS  PubMed  Google Scholar 

  12. Kezirian EJ (2006) Drug-induced sleep endoscopy. Oper Tech Otolaryngol Head Neck Surg 17:230–232. doi:10.1016/j.otot.2006.10.005

    Article  Google Scholar 

  13. Bachar G, Feinmesser R, Shpitzer T et al (2008) Laryngeal and hypopharyngeal obstruction in sleep disordered breathing patients, evaluated by sleep endoscopy. Eur Arch Oto-Rhino-Laryngology 265:1397–1402. doi:10.1007/s00405-008-0637-5

    Article  Google Scholar 

  14. Hohenhorst W, Ravesloot MJL, Kezirian EJ, De Vries N (2012) Drug-induced sleep endoscopy in adults with sleep-disordered breathing: technique and the VOTE classification system. Oper Tech Otolaryngol Head Neck Surg 23:11–18. doi:10.1016/j.otot.2011.06.001

    Article  Google Scholar 

  15. Iwanaga K, Hasegawa K, Shibata N, Kawakatsu K et al (2003) Endoscopic examination of obstructive sleep apnea syndrome patients during drug-induced sleep. Acta Otolaryngol 550:36–40

    Article  Google Scholar 

  16. Soares D, Sinawe H, Folbe AJ et al (2012) Lateral oropharyngeal wall and supraglottic airway collapse associated with failure in sleep apnea surgery. Laryngoscope 122:473–479. doi:10.1002/lary.22474

    Article  PubMed  Google Scholar 

  17. Gillespie MB, Reddy RP, White DR et al (2013) A trial of drug-induced sleep endoscopy in the surgical management of sleep-disordered breathing. Laryngoscope 123:277–282. doi:10.1002/lary.23506

    Article  PubMed  Google Scholar 

  18. Koutsourelakis I, Safiruddin F, Ravesloot M et al (2012) Surgery for obstructive sleep apnea: sleep endoscopy determinants of outcome. Laryngoscope 122:2587–2591. doi:10.1002/lary.23462

    Article  PubMed  Google Scholar 

  19. Fernandez Julian E, Garcia Pérez M, Ferrer F et al (2014) Surgical planning after sleep versus awake techniques in patients with obstructive sleep apnea. Laryngoscope:1970–1974. doi:10.1002/lary.24577

  20. Hewitt RJD, Dasgupta A, Singh A et al (2009) Is sleep nasendoscopy a valuable adjunct to clinical examination in the evaluation of upper airway obstruction? Eur Arch Oto-Rhino-Laryngology 266:691–697. doi:10.1007/s00405-008-0831-5

    Article  Google Scholar 

  21. Rodriguez-Bruno K, Goldberg AN, McCulloch CE, Kezirian EJ (2009) Test-retest reliability of drug-induced sleep endoscopy. Otolaryngol Head Neck Surg 140:646–651. doi:10.1016/j.otohns.2009.01.012

    Article  PubMed  PubMed Central  Google Scholar 

  22. Kezirian E, White D, Malhotra A (2010) Interrater reliability of drug-induced sleep endoscopy. Head Neck 136:393–397. doi:10.1001/archoto.2010.26

    Google Scholar 

  23. Vroegop AVMT, Vanderveken OM, Wouters K et al (2013) Observer variation in drug-induced sleep endoscopy: experienced versus nonexperienced ear, nose, and throat surgeons. Sleep 36:947–953. doi:10.5665/sleep.2732

    PubMed  PubMed Central  Google Scholar 

  24. Kezirian EJ, Hohenhorst W, De Vries N (2011) Drug-induced sleep endoscopy: the VOTE classification. Eur Arch Oto-Rhino-Laryngology 268:1233–1236. doi:10.1007/s00405-011-1633-8

    Article  Google Scholar 

  25. Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174. doi:10.2307/2529310

    Article  CAS  PubMed  Google Scholar 

  26. Ravesloot MJL, De Vries N (2011) One hundred consecutive patients undergoing drug-induced sleep endoscopy: results and evaluation. Laryngoscope 121:2710–2716. doi:10.1002/lary.22369

    Article  PubMed  Google Scholar 

  27. Soares D, Folbe AJ, Yoo G et al (2012) Drug-induced sleep endoscopy vs awake Muller’s maneuver in the diagnosis of severe upper airway obstruction. Otolaryngol Head Neck Surg. doi:10.1177/0194599812460505

    PubMed Central  Google Scholar 

  28. Lluís Carrasco J, Jover L (2004) Métodos estadísticos para evaluar la concordancia. Med Clin (Barc) 122:28–34. doi:10.1157/13057543

    Article  Google Scholar 

  29. Feinstein AR, Cicchetti DV (1990) High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol 43:543–549. doi:10.1016/0895-4356(90)90158-L

    Article  CAS  PubMed  Google Scholar 

  30. Zerpa Zerpa V, Carrasco Llatas M, Agostini Porras G, Dalmau Galofre J (2015) Drug-induced sedation endoscopy versus clinical exploration for the diagnosis of severe upper airway obstruction in OSAHS patients. Sleep Breath 19:1367–1372. doi:10.1007/s11325-015-1266-z

    Article  PubMed  Google Scholar 

  31. Aktas O, Erdur O, Cirik AA, Kayhan FT (2014) The role of drug-induced sleep endoscopy in surgical planning for obstructive sleep apnea syndrome. Eur Arch Oto-Rhino-Laryngology 1–5. doi: 10.1007/s00405-014-3162-8

  32. den Herder C, van Tinteren H, de Vries N (2005) Sleep endoscopy versus modified Mallampati score in sleep apnea and snoring. Laryngoscope 115:735–739. doi:10.1097/01.mlg.0000161347.07881.6d

    Article  Google Scholar 

  33. Eichler C, Sommer JU, BA S et al (2013) Does drug-induced sleep endoscopy change the treatment concept of patients with snoring and obstructive sleep apnea? Sleep Breath 17:63–68. doi:10.1007/s11325-012-0647-9

    Article  PubMed  Google Scholar 

  34. da Cunha Viana Júnior A, Santos Thuler LC, de Araújo de Melo MH (2015) Drug-induced sleep endoscopy in the identification of obstruction sites in patients with obstructive sleep apnea. Braz J Otorhinolaryngol. doi:10.1016/j.bjorl.2015.01.007

    Google Scholar 

  35. De Vito A, Carrasco Llatas M, Vanni A et al (2014) European position paper on drug-induced sedation endoscopy (DISE). Sleep Breath 18:453–465. doi:10.1007/s11325-014-0989-6

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Hospital Universitario Dr. Peset, Valencia, Spain

    Marina Carrasco-Llatas, Vanessa Zerpa-Zerpa & José Dalmau-Galofre

Authors
  1. Marina Carrasco-Llatas
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vanessa Zerpa-Zerpa
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. José Dalmau-Galofre
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marina Carrasco-Llatas.

Ethics declarations

Funding

No funding was received for this research.

Conflict of interest

All authors certify that they have no affiliations with or involvement in any organization or entity with any financial interest (such as honoraria; educational grants; participation in speakers’ bureaus; membership, employment, consultancies, stock ownership, or other equity interest; and expert testimony or patent-licensing arrangements) or non-financial interest (such as personal or professional relationships, affiliations, knowledge or beliefs) in the subject matter or materials discussed in this manuscript.

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Carrasco-Llatas, M., Zerpa-Zerpa, V. & Dalmau-Galofre, J. Reliability of drug-induced sedation endoscopy: interobserver agreement. Sleep Breath 21, 173–179 (2017). https://doi.org/10.1007/s11325-016-1426-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11325-016-1426-9

Keywords

Search

Navigation