Skip to main content

Advertisement

SpringerLink
Log in

Detection accuracy of maxillary sinus floor septa in panoramic radiographs using CBCT as gold standard: a multi-observer receiver operating characteristic (ROC) study

  • Original Article
  • Published:
Clinical Oral Investigations Aims and scope Submit manuscript

Abstract

Objectives

To investigate diagnostic accuracy of panoramic radiography in detecting maxillary sinus floor septa by means of a multi-observer receiver operating characteristic (ROC) analysis and a standardized protocol for reporting (STARD protocol; Clin Chem 49(1):1–6, 2003).

Material and methods

From our database, 25 cone beam computed tomographies (CBCTs) were selected with one maxillary sinus floor septum (height ≥ 2.5 mm). For the same patient, a recent panoramic radiograph (PAN) had to be available in the database. As controls, 28 CBCTs plus corresponding PANs without evidence of a sinus septum were selected. Using the CBCTs as ground truth, 17 observers from our dental school on a five-point confidence scale rated both sinuses in all 53 PANs with respect to presence/absence of a sinus septum. Areas beneath ROC curves (Az-values), sensitivity/specificity (SNT/SPF), positive/negative predictive values (PPV, NPV), and positive/negative likelihood ratios (LR+, LR−) were computed for each observer and pooled over all observers. Inter-rater reproducibility was assessed by means of the intraclass coefficient (ICC) using a two-way random effects model.

Results

A pooled Az-value of 0.839 was observed (SNT 84.6%, SPF 73.5%). PPV ranged between 0.492 and 0.824 (median 0.627) and NPV between 0.838 and 0.976 (median 0.917). A median LR+ of 3.567 was computed (LR− median 0.193). Inter-rater reliability revealed an ICC of 0.55 (95% confidence interval 0.48 to 0.62).

Conclusions

Our results indicate that PAN is a moderately accurate method for sinus elevation planning for the purpose of septum detection. Ruling out a septum by PAN seems to work more accurately than ruling in.

Clinical relevance

For the purpose of maxillary sinus floor septa detection, panoramic radiography can be relatively safely advocated, particularly for judgment of a septum-free sinus.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Kim M-J, Jung U-W, Kim C-S, Kim KD, Choi SH, Kim CK, Cho KS (2006) Maxillary sinus septa: prevalence, height, location, and morphology. A reformatted computed tomography scan analysis. J Periodontol 7(5):903–908. https://doi.org/10.1902/jop.2006.050247

    Article  Google Scholar 

  2. Krennmair G, Ulm C, Lugmayr H (1997) Maxillary sinus septa: incidence, morphology and clinical implications. J Craniomaxillofac Surg 25(5):261–265

    Article  PubMed  Google Scholar 

  3. Krennmair G, Ulm CW, Lugmayr H, Solar P (1999) The incidence, location, and height of maxillary sinus septa in the edentulous and dentate maxilla. J Oral Maxillofac Surg 57(6):667–671 discussion 671-2

    Article  PubMed  Google Scholar 

  4. Ulm CW, Solar P, Krennmair G, Matejka M, Watzek G (1995) Incidence and suggested surgical management of septa in sinus-lift procedures. Int J Oral Maxillofac Implants 10(4):462–465

    PubMed  Google Scholar 

  5. Bornstein MM, Seiffert C, Maestre-Ferrín L, Fodich I, Jacobs R, Buser D, von Arx T (2016) An analysis of frequency, morphology, and locations of maxillary sinus septa using cone beam computed tomography. Int J Oral Maxillofac Implants 31(2):280–287. https://doi.org/10.11607/jomi.4188

    Article  PubMed  Google Scholar 

  6. Pommer B, Ulm C, Lorenzoni M, Palmer R, Watzek G, Zechner W (2012) Prevalence, location and morphology of maxillary sinus septa: systematic review and meta-analysis. J Clin Periodontol 39(8):769–773. https://doi.org/10.1111/j.1600-051X.2012.01897.x

    Article  PubMed  Google Scholar 

  7. Schwarz L, Schiebel V, Hof M, Ulm C, Watzek G, Pommer B (2015) Risk factors of membrane perforation and postoperative complications in sinus floor elevation surgery: review of 407 augmentation procedures. J Oral Maxillofac Surg 73(7):1275–1282. https://doi.org/10.1016/j.joms.2015.01.039

    Article  PubMed  Google Scholar 

  8. von Arx T, Fodich I, Bornstein MM et al (2014) Perforation of the sinus membrane during sinus floor elevation: a retrospective study of frequency and possible risk factors. Int J Oral Maxillofac Implants 29(3):718–726. https://doi.org/10.11607/jomi.3657

    Article  Google Scholar 

  9. González-Santana H, Peñarrocha-Diago M, Guarinos-Carbó J, Sorní-Bröker M (2007) A study of the septa in the maxillary sinuses and the subantral alveolar processes in 30 patients. J Oral Implantol 33(6):340–343. https://doi.org/10.1563/1548-1336(2007)33[340:ASOTSI]2.0.CO;2

  10. Orhan K, Kusakci Seker B, Aksoy S, Bayindir H, Berberoglu A, Seker E (2013) Cone beam CT evaluation of maxillary sinus septa prevalence, height, location and morphology in children and an adult population. Med Princ Pract 22(1):47–53. https://doi.org/10.1159/000339849

    Article  PubMed  Google Scholar 

  11. Šimundić A-M (2009) Measures of diagnostic accuracy: basic definitions. Electron J Int Fed Clin Chem Lab Med 19(4):203–211

    Google Scholar 

  12. Hanley JA (1989) Receiver operating characteristic (ROC) methodology: the state of the art. Crit Rev Diagn Imaging 29:307–335

    PubMed  Google Scholar 

  13. Metz CE (2006) Receiver operating characteristic analysis: a tool for the quantitative evaluation of observer performance and imaging systems. J Am Coll Radiol 3(6):413–422. https://doi.org/10.1016/j.jacr.2006.02.021

    Article  PubMed  Google Scholar 

  14. Ludlow JB, Timothy R, Walker C, Hunter R, Benavides E, Samuelson DB (2015) Correction to effective dose of dental CBCT—a meta analysis of published data and additional data for nine CBCT units. Dentomaxillofac Radiol 44(7):20159003. https://doi.org/10.1259/dmfr.20159003

    Article  PubMed  Google Scholar 

  15. Pauwels R (2015) Cone beam CT for dental and maxillofacial imaging: dose matters. RadiatProt Dosim 165(1–4):156–161. https://doi.org/10.1093/rpd/ncv057

    Article  Google Scholar 

  16. Maestre-Ferrín L, Carrillo-García C, Galán-Gil S et al (2011) Prevalence, location, and size of maxillary sinus septa: panoramic radiograph versus computed tomography scan. J Oral Maxillofac Surg 69(2):507–511. https://doi.org/10.1016/j.joms.2010.10.033

    Article  PubMed  Google Scholar 

  17. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Lijmer JG, Moher D, Rennie D, de Vet HC, Standards for Reporting of Diagnostic Accuracy (2003) Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Standards for reporting of diagnostic accuracy. Clin Chem 49(1):1–6

    Article  PubMed  Google Scholar 

  18. Alpert HR, Hillman BJ (2004) Quality and variability in diagnostic radiology. J Am Coll Radiol 1(2):127–132. https://doi.org/10.1016/j.jacr.2003.11.001

    Article  PubMed  Google Scholar 

  19. Robinson PJ (1997) Radiology’s Achilles’ heel: error and variation in the interpretation of the Röntgen image. Br J Radiol 70(839):1085–1098. https://doi.org/10.1259/bjr.70.839.9536897

    Article  PubMed  Google Scholar 

  20. See J, Howe S, Warm J et al (1995) Meta-analysis of the sensitivity decrement in vigilance. Psychol Bull 117:230–249

    Article  Google Scholar 

  21. Bundesregierung BRD (2002) Verordnung zur Änderung der Röntgenverordnung und anderer atomrechtlicher Verordnungen: Röntgenverordnung, BGBl G5702, Nr.36

  22. Deutsches Institut für Normung DIN (2001) Sicherung der Bildqualität in röntgendiagnostischen Betrieben – Teil 57: Abnahmeprüfung an Bildwiedergabegeräten(6868–57)

  23. Koo TK, Li MY (2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 15(2):155–163. https://doi.org/10.1016/j.jcm.2016.02.012

    Article  PubMed  PubMed Central  Google Scholar 

  24. Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86(2):420–428

    Article  PubMed  Google Scholar 

  25. R Core Team (2017) R: A language and environment for statistical computing. www.R-project.org

  26. Harris D, Horner K, Gröndahl K, Jacobs R, Helmrot E, Benic GI, Bornstein MM, Dawood A, Quirynen M (2012) E.A.O. guidelines for the use of diagnostic imaging in implant dentistry 2011. A consensus workshop organized by the European Association for Osseointegration at the Medical University of Warsaw. Clin Oral Impl Res 23(11):1243–1253. https://doi.org/10.1111/j.1600-0501.2012.02441.x

    Article  Google Scholar 

  27. Bornstein MM, Scarfe WC, Vaughn VM et al (2014) Cone beam computed tomography in implant dentistry: a systematic review focusing on guidelines, indications, and radiation dose risks. Int J Oral Maxillofac Implants 29(Suppl):55–77. https://doi.org/10.11607/jomi.2014suppl.g1.4

    Article  PubMed  Google Scholar 

  28. Goldmann M, Pearson AH, Darzenta N (1974) Reliability of radiographic interpretations. Oral Surg 38(2):287–293

    Article  Google Scholar 

  29. Kaffe I, Gratt BM (1988) Variations in the radiographic interpretation of the periapical dental region. J Endod 14(7):330–335. https://doi.org/10.1016/S0099-2399(88)80193-6

    Article  PubMed  Google Scholar 

  30. Park Y-B, Jeon H-S, Shim J-S, Lee KW, Moon HS (2011) Analysis of the anatomy of the maxillary sinus septum using 3-dimensional computed tomography. J Oral Maxillofac Surg 69(4):1070–1078. https://doi.org/10.1016/j.joms.2010.07.020

    Article  PubMed  Google Scholar 

  31. Chakraborty DP (1989) Maximum likelihood analysis of free-response receiver operating characteristic (FROC) data. Med Phys 16(4):561–568. https://doi.org/10.1118/1.596358

    Article  PubMed  Google Scholar 

  32. Flahault A, Cadilhac M, Thomas G (2005) Sample size calculation should be performed for design accuracy in diagnostic test studies. J Clin Epidemiol 58(8):859–862. https://doi.org/10.1016/j.jclinepi.2004.12.009

    Article  PubMed  Google Scholar 

  33. European Commission (2012) Radiation protection no 172: cone beam ct for dental and maxillofacial radiology. Evidence based guidelines: evidence based guidelines: a report prepared by the sedentexct project, 2011 v20: 1–139

Download references

Acknowledgements

The manuscript bases on the thesis of Alexandra Carina Lang entitled “Comparison of accuracy of panoramic versus Cone Beam Computed Tomography radiographs regarding maxillary sinus-floor septa: ROC-analysis.”

Funding

The entire study has been solely financed by the University Medical Center of the Johannes Gutenberg-University of Mainz.

Author information

Authors and Affiliations

  1. Department of Oral and Maxillofacial Surgery and Plastic Surgery, Section of Oral Radiology, University Medical Centre, Johannes Gutenberg University of Mainz, Augustusplatz 2, 55131, Mainz, Germany

    AC Lang & RK Schulze

Authors
  1. AC Lang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. RK Schulze
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to RK Schulze.

Ethics declarations

Conflict of interest

For the submitted work: Both authors declare there were no potential conflicts of interest involved with this research.

Outside the submitted work: Author Ralf Schulze has received a research grant from Sirona Dental Systems GmbH for a different study. Author Ralf Schulze is non-honorarium-based member of several committees of the German Institut of Standardization (DIN) and also of a national technical committee on radiation protection (Arbeitskreis Röntenverordnung, AKRöV). He is also representative for dental radiology and radiation protection for the World Dental Federation (FDI).

Ethical approval

As retrospective study using radiographs from an existing database without publication of any patient-related information, no ethical approval is required in our University Medical Center.

Informed consent

Since all the data (radiographic images) used for the study were taken from the existing database and were used in an anonymized fashion, no extra informed consent was required for this type of study. In our center, patients give a general consent that their data in anonymized fashion may be used for scientific study purposes, if their personal data rights and medical confidentiality is adhered.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lang, A., Schulze, R. Detection accuracy of maxillary sinus floor septa in panoramic radiographs using CBCT as gold standard: a multi-observer receiver operating characteristic (ROC) study. Clin Oral Invest 23, 99–105 (2019). https://doi.org/10.1007/s00784-018-2414-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00784-018-2414-1

Keywords

Search

Navigation