Abstract
The aim of this study was to evaluate the intra- and inter-observer reliability of maxillary digital dental model integration into cone-beam computed tomography (CBCT) scans to reconstruct three-dimensional (3D) skeletodental models for orthognathic patients. This retrospective study consisted of CBCT and digital maxillary dentition images of 20 Class III orthognathic patients. After two repeated fusions of digital cast images with reconstructed CBCT images by a digital engineer and an orthodontist respectively, the 3D coordinate values of the canines, first molars, and central incisors were evaluated. The intra- and inter-observer reliability of 3D positions of maxillary teeth were compared using intraclass correlation coefficients (ICCs). Intra-observer reliability of x-, y-, and z-coordinate values of maxillary teeth showed significant and excellent agreement in an engineer (0.946 ≤ ICC ≤ 1.000) and an orthodontist (0.876 ≤ ICC ≤ 1.000). The inter-observer reliability of the y- and z-coordinates of each tooth was significantly excellent or good, but that of the x-coordinates showed insignificantly poor to moderate agreement. This study showed that the integration of maxillary digital models into CBCT scans was clinically reliable. However, considering the low inter-observer reliability on the x-coordinates of dentition, clinical experience and repeated learning are needed for accurate application of digital skeletodental model in orthognathic patients.
Similar content being viewed by others
Introduction
Cone-beam computed tomography (CBCT) has been applied for orthodontic diagnosis and the treatment planning of three-dimensional (3D) craniofacial skeletal abnormalities, impacted teeth, and virtual simulation of orthognathic surgery1,2. CBCT with the development of related software can provide clinicians with more useful information on the 3D positions of anatomical features.
However, many studies have reported that the representation of dentition on CBCT is not reliable3,4,5. Digital study models generated from CBCT had less accuracy for all dental measurements compared with those acquired from plaster models6. Therefore, the replacement of the dentition from CBCT scans with digital dental models is more likely to be needed7,8,9,10.
In addition, digital models, which are taken by extra- or intra-oral scanners, are known to be reliable and present as accurate an interocclusal relationship as traditional plaster models, with high accuracy and reproducibility11,12,13. Some studies reported that orthodontic measurements from digital models were comparable to those from plaster models13,14,15,16.
With the increased accuracy of digital dental images, the configuration (positioning) of these images on reconstructed facial CBCT images is important for accurate virtual simulation and planning for orthognathic surgery, actual surgical splint fabrication, and accurate surgery results17,18,19. Previous studies have introduced the accuracy of various methods using fiducial markers or triple CBCT scans, which replaced the dentition area of CBCT scans with digitally scanned dental images10,20,21,22,23. Most of them reported less than 0.3 mm of registration errors and high accuracy for the replacement of dentition with CBCT, despite their different superimposition methods.
However, to the best of our knowledge, there have been few studies about intra- and inter-rater reliability and reproducibility of the implementation of digital dentition into reconstructed CBCT image in patients undergoing orthognathic surgery.
Therefore, it is necessary to evaluate the reliability of merging digital cast images with facial CBCT scans. The null hypothesis is that there would be no difference in the reproducibility of maxillary dentition position when integrating digital dental arches into CBCT scans. The aims of this study were to evaluate the intra-observer and inter-observer reliability of integration of maxillary digital dental models into facial CBCT scans to reconstruct 3D skeletodental models in orthognathic patients and to compare the positional deviations of teeth after repeated registrations between a digital engineer and an orthodontist.
Results
Intra- and inter-observer reliability of x-, y-, and z-coordinates of each tooth during merging of maxillary dentition scanned images and facial CBCT by a digital engineer and an orthodontist
As shown in Table 1, the intra-observer reliability of x-, y-, and z-coordinate values of maxillary teeth was significant and almost perfect for an engineer (0.946 ≤ ICC ≤ 1.000) and an orthodontist (0.876 ≤ ICC ≤ 1.000), respectively.
The inter-observer reliability of the y- and z-coordinate values of maxillary teeth was significant and presented almost perfect or substantial, while that of x-coordinate values of maxillary teeth was nonsignificant and showed poor to moderate agreement. In addition, Bland–Altman plots showed a larger registration error of teeth on the X-axis compared to those of the y- and z-axes between a digital engineer and an orthodontist (Fig. 1).
Reproducibility of registration of x-, y-, and z-coordinates of each tooth of maxillary dentition scanned image and facial CBCT by a digital engineer and an orthodontist
As shown in Table 2, the mean differences from the repeated measurements of each tooth on the x-axis ranged from − 0.020 to 0.006 mm for an engineer and from − 0.210 to 0.013 mm for an orthodontist. The mean differences ranged from − 0.036 to 0.027 mm on the y-axis for an engineer and from − 0.045 to 0.081 mm for an orthodontist and ranged from − 0.015 to 0.005 mm on the z-axis for an engineer and from − 0.564 to 0.136 mm for an orthodontist. However, there was no significant difference for each tooth position of the first and second registrations for each observer or between the engineer and orthodontist.
Discussion
For the virtual planning and clinical application of orthognathic surgery, accurate representation of dentition as well as the maxilla-mandibular complex from CBCT scans is necessary. Most CBCT scans have streak artifacts in the dental portion due to metallic restorations or orthodontic brackets in patients treated with orthognathic surgery7. Therefore, the dentition part from CBCT needs to be replaced by a digital dental model7,8,9,10.
This study evaluated the intra- and inter-observer reliability of the integrated maxillary digital model images and CBCT scans to reconstruct 3D skeletodental models in skeletal class III patients treated with orthognathic surgery.
To date, previous studies have introduced various methods including fiducial markers or triple CBCT scans, which replaced the dentition areas of CBCT scans with digitally scanned dental images10,20,21,22,23. In contrast, in our study, the surface-based fusion method (best-fit method) with the iterative closest point algorithm was used to superimpose a digital cast scan and CBCT scan in each sample4,24,25,26.
The intra-observer reliability of x-, y-, and z-axis positions of maxillary dentition from the repeated fusion of digitally scanned dental images with CBCT scans showed significant and excellent agreement for an engineer and an orthodontist (Table 1). This means that the measurement points, which were the contact points of the central incisors and the cusp tips of the canines and first molars, were defined consistently by each observer. Kim et al. reported that the reliable identification areas of 3D landmarks were distinct structures like cusp tips and points positioned in the midline27.
However, inter-observer reliability proved to be different in two groups. Although the reliability of each tooth on the y- and z-axes showed significantly excellent or good agreement, those on the x-axis showed insignificantly varied agreement levels such as poor, fair, and moderate. This means that low reliability between the two examiners could occur in the tooth positions on the x-axis, which represents the right and left directions, compared to the reliability on y- and z-axes (Table 1, Fig. 2). This error might be associated with streak artifacts in the dentition area of the CBCT images. These artifacts, which are due to orthodontic brackets mainly located on the buccal side of anterior and posterior teeth and partial attachments on the palatal side in orthognathic samples of this study, could cause difficulty during the integration by limiting the surface as a reference for registration. Specifically, numerous buccal and palatal artifacts in the molar area seem to cause a registration error on the x-axis. Therefore, for clinical application in the orthognathic patient, clinicians should be aware that operator errors on the horizontal plane can occur.
With regard to the replacement of the dentition areas of CBCT scans with digital dental images, Uechi et al. reported root-mean-square errors of 0.1 to 0.5 mm, when registered with ceramic balls20. Swennen et al. showed mean errors ranging from 0.1 to 0.3 mm, when using gutta-percha cones21,22,23.
On the other hand, in our study, the surface-based fusion method (best-fit method) was used with the iterative closest point algorithm4,25,28. Noh et al. suggested that registration with the buccal and lingual tooth surfaces should be used as much as possible to increase the accuracy of the integration of laser-scanned dental images into the maxillofacial CBCT scans4. They presented mean distance errors ranging from 0.27 to 0.33 mm between the surface points on the two images. In addition, Lin et al. reported that the mean errors of dentition obtained digitally in 14 patients ranged from 0.10 to 0.43 mm12. Rangel et al. reported a mean absolute distance of 0.39 mm in the upper jaw, when comparing two methods to integrate digital dental models into CBCT scans5. In this study, each tooth after repeated registrations showed mean deviations that ranged from − 0.04 to 0.03 mm for an engineer and from − 0.56 to 0.14 mm for an orthodontist (Table 2). This deviation by an orthodontist was larger than that of a digital engineer, but there was no significant difference between the two groups. This suggests that it may take repeated experiences and a learning curve to reduce 3D positioning errors and to increase the reproducibility of integrating digital dental images into CBCT scan images.
To date, most studies using surface-based fusion evaluated the registration accuracy in adults with normal occlusion and no crown restorations, or with Class II or III malocclusion with no brackets4,12. Almutairi et al. measured the errors related to the fusion of intraoral scan images with CBCT using six dried skulls with orthodontic brackets9. In contrast, our study evaluated the reproducibility of each tooth position after the fusion of digital dental images with CBCT scans in actual surgery patients with orthodontic brackets. Although Kim et al. evaluated the accuracy of the maxillary repositioning after orthognathic surgery using computer-aided and surgical simulation, they did not report on the reproducibility of reference points of the teeth before surgery17.
This retrospective study had some limitations, such as a small sample size and no registration of mandibular dentition. Further studies are needed to evaluate the differences between the positions of maxillary and mandibular teeth registered on facial CBCT scans for digital virtual surgery and their positions mounted for conventional model surgery. Also, the accuracy of results after actual surgery could be evaluated compared to the simulation of virtual surgery.
Conclusion
We failed to reject the null hypothesis that there would be no difference in the reproducibility of maxillary dentition position when integrating digital dental arches into CBCT scans.
This study showed that the integration of maxillary digital models into CBCT scans was clinically reliable. However, considering the low to moderate inter-observer reliability on the x-coordinates of dentition, it is necessary for clinicians to have clinical experience and repeated learning for accurate application of digital skeletodental model in orthognathic patients.
Materials and methods
This retrospective study was reviewed and approved by the Institutional Review Board of Seoul National University Bundang Hospital (B-1911/576-105) and the Institutional Review Board of the University of British Columbia (H19-03765). A total of 20 skeletal Class III adult patients (7 males and 13 females; age, 21.7 ± 4.0 years) were included, who were treated with either one-jaw or double-jaw orthognathic surgery at Seoul National University Bundang Hospital from March 2016 to October 2019. All patients were selected according to the following inclusion criteria: (1) ANB < 0°; (2) had a full set of pre-surgical record, including digital casts and CBCT scans, to fabricate the surgical splint; (3) had fixed edgewise appliances in place when the records were taken. Exclusion criteria were: (1) CBCT scans did not include the whole craniofacial area; (2) had clear aligner therapy.
Image merging procedure and measurement
All patients underwent CBCT (KODAK 9500, Carestream Health Inc., Rochester, NY, USA), which was obtained with a field of view of 200 mm × 180 mm, a voxel size of 0.2 mm, and exposure conditions of 80 kVp, 15 mA, and 10.8 s. During the CBCT scans, the patients were asked to maintain an upright position. Their heads were positioned in which the Frankfort horizontal planes were parallel to the floor, and stabilized by the ear rods. They were instructed to maintain their teeth in maximum intercuspation. All CBCT scans were saved as Digital Imaging and Communications in Medicine (DICOM) data files. The DICOM data were converted to stereolithography format, oriented, and reconstructed using Geomagic software (Geomagic Qualify 2013®, 3D Systems, Morrisville, NC, USA) while following reference planes. The horizontal plane (axial plane; X plane) is the plane passing the nasion, which is parallel to the Frankfort horizontal (FH) plane passing through the left and right orbitales and the right porion. The midsagittal plane (Y plane) is the plane passing through the nasion and basion, while perpendicular to the X plane. The coronal plane (Z plane) is perpendicular to the horizontal and midsagittal planes, setting the plane through the nasion (zero point; 0, 0, and 0) (Fig. 2).
In addition, simultaneously with the acquisition of CBCT for each patient, a conventional impression was taken with alginate (Aroma fine plus normal set, GC Corporation, Tokyo, Japan) to fabricate maxillary and mandibular dental stone casts. For producing digital models, the surface images of the maxillary, mandibular casts and their maximum intercuspation were digitized into standard tessellation language (STL) format using a desktop model scanner (MD-ID0300, Medit Co, Seoul, Korea).
Digital cast images of whole maxillary dentition were merged with the dental portions of reconstructed CBCT images using Geomagic software. First, point-based registration was performed using the cusp tips of the canines and the mesiobuccal cusps of the maxillary first molars in both images. Then, for more precise integration, surface-based registration was performed (Fig. 3). The cusp tips or occluso-buccal surfaces of the teeth above the bracket and the lingual surfaces of the teeth as the registration area were used with the best-fit algorithm26,28. This procedure was carried out twice at a two-week interval by 2 examiners (one digital engineer and one orthodontist [J.-H.K.]).
The 3D coordinate values (x, y, and z) of the cusps of the canines, the mesio-buccal cusps of the first molars, and the contact points between the maxillary central incisors were measured in the coordinate system, which is constructed by X-, Y-, and Z-plane through the nasion (zero point; 0, 0, and 0). The differences in the x-, y-, or z-coordinates of each tooth between two repeated fusions, measured by the 2 examiners, were evaluated13. In addition, intraclass correlation coefficients (ICCs) were calculated to determine the intra- and inter-examiner reliability of the measurements of 3D positions of maxillary dentition after merging by a digital engineer and an orthodontist, and between the 2 examiners.
Statistical analysis
Power analysis with correlation ρ H1 = 0.77, α = 0.05, and power (1 − β) = 0.80 showed a sample size requirement of 10 (G*Power v. 3.1.9.7; Heinrich Heine Universität, Dϋsseldorf, Germany)29.
All statistical data were analyzed with SPSS software (Version 22.0, IBM, Armonk, NY, USA). Paired t-tests, Wilcoxon’s signed-rank tests, ICC tests and Bland–Altman analyses were performed to evaluate the differences and reproducibility between 3D positions (3D coordinates) of maxillary dentition taken two times by each of the two examiners. The intra-examiner’s reliability and inter-examiner’s reliability were evaluated using ICC as follows: ICC > 0.8/0.6/0.4/0.2 or ≤ 0.2 represent almost perfect, substantial, moderate, mediocre, or low strength of agreement, respectively30. Also, the level of significance was set as P < 0.05.
Ethical approval
All procedures performed in studies involving human participants were reviewed and approved by the institutional review board and in accordance with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.
Informed consent
For this type of retrospective, non-interventional clinical study, the informed consent was waived by the institutional review board of Seoul National University Bundang Hospital and the institutional review board of the University of British Columbia.
References
Badiali, G. et al. Virtual orthodontic surgical planning to improve the accuracy of the surgery-first approach: A prospective evaluation. J. Oral Maxillofac. Surg. 77, 2104–2115. https://doi.org/10.1016/j.joms.2019.04.017 (2019).
Farronato, G. et al. Three-dimensional virtual treatment planning: Presurgical evaluation. J. Craniofac. Surg. 29, e433–e437. https://doi.org/10.1097/SCS.0000000000004455 (2018).
Santler, G., Kärcher, H. & Ruda, C. Indications and limitations of three-dimensional models in cranio-maxillofacial surgery. J. Craniomaxillofac. Surg. 26, 11–16. https://doi.org/10.1016/S1010-5182(98)80029-2 (1998).
Noh, H., Nabha, W., Cho, J. H. & Hwang, H. S. Registration accuracy in the integration of laser-scanned dental images into maxillofacial cone-beam computed tomography images. Am. J. Orthod. Dentofacial Orthop. 140, 585–591. https://doi.org/10.1016/j.ajodo.2011.04.018 (2011).
Rangel, F. A. et al. Integration of digital dental casts in cone beam computed tomography scans-a clinical validation study. Clin. Oral Investig. 22, 1215–1222. https://doi.org/10.1007/s00784-017-2203-2 (2018).
Ferreira, J. B. et al. Accuracy and reproducibility of dental measurements on tomographic digital models: A systematic review and meta-analysis. Dentomaxillofac. Radiol. 46, 20160455. https://doi.org/10.1259/dmfr.20160455 (2017).
Rangel, F. A., Maal, T. J., Berge, S. J. & Kuijpers-Jagtman, A. M. Integration of digital dental casts in cone-beam computed tomography scans. ISRN Dent. 2012, 949086. https://doi.org/10.5402/2012/949086 (2012).
Nairn, N. J. et al. Digital replacement of the distorted dentition acquired by cone beam computed tomography (CBCT): A pilot study. Int. J. Oral Maxillofac. Surg. 42, 1488–1493. https://doi.org/10.1016/j.ijom.2013.01.026 (2013).
Almutairi, T. et al. Replacement of the distorted dentition of the cone-beam computed tomography scans for orthognathic surgery planning. J. Oral Maxillofac. Surg. 76, e1–e8. https://doi.org/10.1016/j.joms.2018.02.018 (2018).
Yang, W. M., Ho, C. T. & Lo, L. J. Automatic superimposition of palatal fiducial markers for accurate integration of digital dental model and cone beam computed tomography. J. Oral Maxillofac. Surg. 73(8), e1–e10. https://doi.org/10.1016/j.joms.2015.04.004 (2015).
Rossini, G. et al. Diagnostic accuracy and measurement sensitivity of digital models for orthodontic purposes: A systematic review. Am. J. Orthod. Dentofacial Orthop. 149, 161–170. https://doi.org/10.1016/j.ajodo.2015.06.029 (2016).
Lin, H. H. et al. Artifact-resistant superimposition of digital dental models and cone-beam computed tomography images. J. Oral Maxillofac. Surg. 71, 1933–1947. https://doi.org/10.1016/j.joms.2013.06.199 (2013).
Wiranto, M. G. et al. Validity, reliability, and reproducibility of linear measurements on digital models obtained from intraoral and cone-beam computed tomography scans of alginate impressions. Am. J. Orthod. Dentofacial Orthop. 143, 140–147. https://doi.org/10.1016/j.ajodo.2012.06.018 (2013).
Fleming, P. S., Marinho, V. & Johal, A. Orthodontic measurements on digital study models compared with plaster models: A systematic review. Orthod. Craniofac. Res. 14, 1–16. https://doi.org/10.1111/j.1601-6343.2010.01503.x (2011).
Aragón, M. L. et al. Validity and reliability of intraoral scanners compared to conventional gypsum models measurements: A systematic review. Eur. J. Orthod. 38, 429–434. https://doi.org/10.1093/ejo/cjw033 (2016).
Keul, C. & Güth, J. F. Accuracy of full-arch digital impressions: An in vitro and in vivo comparison. Clin. Oral Investig. 24, 735–745. https://doi.org/10.1007/s00784-019-02965-2 (2020).
Kim, J. W. et al. The accuracy and stability of the maxillary position after orthognathic surgery using a novel computer-aided surgical simulation system. BMC Oral Health 19, 18. https://doi.org/10.1186/s12903-019-0711-y (2019).
Conley, R. S. & Edwards, S. P. Three-dimensional treatment planning for maxillary and mandibular segmental surgery for an adult Class III: Where old meets new. Angle Orthod. 89, 138–148. https://doi.org/10.2319/120117-823.1 (2019).
Zinser, M. J., Mischkowski, R. A., Sailer, H. F. & Zöller, J. E. Computer-assisted orthognathic surgery: Feasibility study using multiple CAD/CAM surgical splints. Oral Surg. Oral Med. Oral Pathol. Oral Radiol. 113(5), 673–687. https://doi.org/10.1016/j.oooo.2011.11.009 (2012).
Uechi, J. et al. A novel method for the 3-dimensional simulation of orthognathic surgery by using a multimodal image-fusion technique. Am. J. Orthod. Dentofacial Orthop. 130, 786–798. https://doi.org/10.1016/j.ajodo.2006.03.025 (2006).
Swennen, G. R. et al. A cone-beam CT based technique to augment the 3D virtual skull model with a detailed dental surface. Int. J. Oral Maxillofac. Surg. 38, 48–57. https://doi.org/10.1016/j.ijom.2008.11.006 (2009).
Swennen, G. R. et al. A cone-beam computed tomography triple scan procedure to obtain a three-dimensional augmented virtual skull model appropriate for orthognathic surgery planning. J. Craniofac. Surg. 20, 297–307. https://doi.org/10.1097/SCS.0b013e3181996803 (2009).
Swennen, G. R., Mollemans, W. & Schutyser, F. Three-dimensional treatment planning of orthognathic surgery in the era of virtual imaging. J. Oral Maxillofac. Surg. 67, 2080–2092. https://doi.org/10.1016/j.joms.2009.06.007 (2009).
de Waard, O. et al. A novel method for fusion of intra-oral scans and cone-beam computed tomography scans for orthognathic surgery planning. Craniomaxillofac. Surg. 44, 160–166. https://doi.org/10.1016/j.jcms.2015.11.017 (2016).
Nkenke, E. et al. Fusion of computed tomography data and optical 3D images of the dentition for streak artefact correction in the simulation of orthognathic surgery. Dentomaxillofac. Radiol. 33, 226–232. https://doi.org/10.1259/dmfr/27071199 (2004).
Kim, B. C. et al. Integration accuracy of digital dental models and 3-dimensional computerized tomography images by sequential point- and surface-based markerless registration. Oral Surg. Oral Med. Oral Pathol. Oral Radiol. Endod. 110, 370–378. https://doi.org/10.1016/j.tripleo.2010.03.036 (2010).
Kim, J. H., An, S. & Hwang, D. M. Reliability of cephalometric landmark identification on three-dimensional computed tomography images. Br. J. Oral Maxillofac. Surg. https://doi.org/10.1016/j.bjoms.2021.07.003 (2021).
Besl, P. J. & McKay, N. D. A method for registration for 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14, 239–256 (1992).
Faul, F., Erdfelder, E., Buchner, A. & Lang, A. Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behav. Res. Methods 41, 1149–1160 (2009).
Landis, J. R. & Koch, G. G. The measurement of observer agreement for categorical data. Biometrics 33, 159–174 (1977).
Acknowledgements
We thank the digital engineer, Sung-Hoon Kim (TRUEM, Seoul, Korea), for his digital assistance with virtual surgical simulation and also Dr. He-Li Choi, Department of Orthodontics, Seoul National University Bundang Hospital, for her helpful advice about illustration.
Author information
Authors and Affiliations
Contributions
N.-K.L. contributed to design of the work, data acquisition, analysis and interpretation of data, writing and revision of the article. B.Z. and J.-H.K. contributed to data analysis, interpretation of data and writing this article. S.-H.K. and T.-H.C. contributed to data acquisition and statistics. Y.S. and Y.-A.K. revised this article. All of the authors reviewed the manuscript and approved to submission of its final version.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Zou, B., Kim, JH., Kim, SH. et al. Accuracy of a surface-based fusion method when integrating digital models and the cone beam computed tomography scans with metal artifacts. Sci Rep 12, 8034 (2022). https://doi.org/10.1038/s41598-022-11677-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-022-11677-9
- Springer Nature Limited
This article is cited by
-
Create virtual dentoskeletal model by superimposing digital dental cast into cone-beam computed tomography scan
International Journal of Computer Assisted Radiology and Surgery (2024)
-
Effectiveness of creating digital twins with different digital dentition models and cone-beam computed tomography
Scientific Reports (2023)