Simultaneous, radiation-free registration of the dentoalveolar position and the face by combining 3D photography with a portable scanner and impression-taking
- 131 Downloads
Simultaneous, radiation-free registration of the teeth and the upper and lower jaw positions in relation to the extraoral soft tissue could improve treatment planning and documentation. The purpose of this study is to describe a workflow to solve this form of registration and surface acquisition with a mobile device.
Facial scans of ten healthy participants were taken using a blue-light LED 3D scanner (Artec® Space Spider; Artec® Group; Luxembourg). An impression of the maxillary dentoalveolar arch was taken simultaneously to the 3D photo using a modified impression tray with two different extraoral registration geometries (sphere vs. cross). Following, an impression of the mandibular dentoalveolar arch was taken once. Both impressions were scanned with the 3D scanner. All resulting standard tesselation language (.stl) files of the geometries were compared to the original, virtual .stl files and the root mean square errors (RMSE) were calculated for each surface (Artec Studio 13 Professional × 64; Artec® Group; Luxembourg) to determine which geometry serves as a better reference for intra-extraoral registration.
The RMSE between the original geometries and the scanned counterfeits were statistically lower for spherical geometries (p < 0.008). Once scanned and aligned, both geometries enabled an alignment of the intra- and extraoral scan. However, the spherical geometries showed virtually better results without significance (p = 0.70).
The presented study provides a radiation-free solution for simultaneous dentoalveolar correlations in relation to the extraoral soft tissue. Spherical geometries achieved more precise and easier intra-extraoral alignments using the applied mobile 3D scanner and workflow.
KeywordsDentoalveolar registration 3D photography Intra-extraoral registration
The position of the maxillary dentulous or edentulous dentoalveolar arches in relation to the extraoral soft tissues is usually determined by using facebows and cast models that are positioned in an articulator after registration. To correlate the soft tissue and facial anatomy, auxiliary lines are marked on the models to transfer the patient’s situation as well and as realistically as possible . This method, however, is susceptible to errors and may result in inaccuracies due to varying soft tissue situations, movements (e.g. grimacing), material properties in terms of shrinking and secondary deformation [2, 3, 4]. Three-dimensional (3D) photography is already used for various indications in dentistry and cranio-maxillofacial surgery, including esthetical dental rehabilitation of incisors, as a pre-interventional visualization tool to supplement the recorded information, treatment planning and follow-up documentation in orthognathic surgery [5, 6, 7, 8]. This sort of mobile or stationary surface imaging is non-invasive and is becoming an additional gold standard tool for documentation and planning, especially in craniofacial surgery [9, 10, 11, 12]. Several mobile systems have shown to be a valid and reliable solution with a reasonable cost–benefit ratio alongside the established expensive stationary systems of the last decade due to ongoing technical developments [11, 13, 14].
In terms of surface matching combining two different capturing methods, the combination of cone-beam computed tomography (CBCT) and 3D photogrammetry or scanned dental casts has proven to be a reliable and feasible method. An overview of various investigations was provided by Mangano and colleagues [15, 16, 17]. This results in good accuracy of the dental arch positioning and/or soft tissue illustration , which is necessary in pre-interventional planning of orthognathic surgery or orthodontic treatment and might facilitate the planning and simulation of a full mouth restoration. But of course, CBCT is associated with radiation and therefore should be restricted to defined indications with respect to the radiation protection law and current guidelines.
As a consequence, Bechtold et al. have described a radiation-free integration of a virtual maxillary dentoalveolar arch model into a facial scan in ten steps using a stationary photogrammetry system. This was found to have comparable precision to 3D-data derived from CBCT images alone . In cases of an edentulous jaw Schweiger et al. as well as Hassan et al. presented a virtual workflow for complete dentures for which also facial scans were used. Their workflow aligns the digitalized dental arches according to the facial scan and provides valuable information to evaluate the tooth arrangements, however, without a definite intra-extraoral registration [20, 21].
The aim of this presented study was to analyse and describe a solution and workflow to register the intraoral position of the maxillary dentoalveolar arch simultaneously to the extraoral 3D photography with an intra-extraoral geometry using a portable 3D scanner. This would enable a virtual and radiation-free registration of the intraoral dental situation to the extraoral facial anatomy. The provided workflow could be used for prosthetic/orthodontic/orthognathic planning and post-interventional follow-ups and provides a recommendation for a straightforward geometry design and a step-by-step explanation.
Materials and methods
Applied software, hardware and analyses
The mobile 3D scanner (Artec3D® Space Spider, Artec; Luxembourg) with a 3D resolution up to 0.1 mm and point accuracy up to 0.05 mm was used for capturing the facial surface and for digitalizing the impression-takings directly as described elsewhere . To digitalize the dental plaster model, a 3D triangulation scanner (3Shape D500, 3Shape A/S, Denmark) was used.
Both impressions and the modified impression tray were scanned with the 3D scanner. All resulting standard tessellation language (.stl) files (dentoalveolar arches, sphere and cross geometry) were compared to the original, virtual .stl files of the digitalized plaster model. The root mean square errors (RMSE, [mm]) were calculated for each surface and aligned (Artec Studio 13 Professional × 64; Artec® Group; Luxembourg) to determine which geometry serves as a better reference for intra- and extraoral registration (Fig. 3) . An analysis of the variance of a tenfold repetition of the digital workflow was performed.
Workflow for simultaneous intra-extraoral registration in six steps
To represent surface deviations between two .stl files the RMSE was calculated. G-Power Software (Version 3.1) was used for the sample size calculation [23, 24]. For the evaluation of the scannability of the two geometries (cross vs. sphere) the RMSE of the original .stl file and the scanned counterfeits were compared and a sample size of five scans was calculated to be sufficient (Power: 0.95). Based on initially five scans comparing the RMSE analysis between the two kinds of scanned geometries after the virtual alignments, a sample size estimation resulted in eight necessary participants, which was extended to ten.
Root mean square error (RMSE) analysis of the original standard tesselation language (.stl) files and the scanned counterfeits after virtual alignments (n = 5)
RMSE sphere geometry [mm]
RMSE cross geometry [mm]
p < 0.008
Root mean square error (RMSE) analysis of the sphere and cross geometries after alignments (n = 10) within the facial scan using a 3D scanner (Artec® Space Spider; Artec® Group; Luxembourg)
RMSE sphere geometry [mm]
RMSE cross geometry [mm]
p = 0.70
The consecutive exemplary alignment of a digitalized dental cast model along the gumline of the scanned impression and the positioning of the mandibular model along the occlusion points in maximal intercuspation was also possible in all cases, resulting in a complete virtual model indicating the three-dimensional position of upper and lower jaws in relation to the extraoral face (Fig. 6).
The tenfold repetition of the virtual alignment workflow showed a mean RMSE of 0.27 mm (range: 0.17–0.40 mm) with a standard deviation of 0.078 mm and a variance of 0.006 mm2.
Radiation-free solutions for intra-extraoral registrations are wanted in times of CAD/CAM-assisted surgery as well as increasing awareness and interest to health and radiation safety. Further, simultaneous registration and virtual and plaster-free workflows would reduce time and increase accuracy. Accuracy of facial plaster casts varies between 0.95 and 3.55 mm according to Holberg et al. . This might be due to the reported finding that the influence of facial movements is greater than the technical influence in terms of technical error . Grimacing is another common reason for insufficient quality for both direct 3D acquisition and indirect impression-taking as well as model or impression scanning [29, 30]. A quiet room with monotone walls and surroundings is therefore recommended for every kind of (3D) image-taking.
In addition, facial 3D photography has reached a high level of accuracy and reproducibility, even with portable devices [11, 13, 14]. Additionally, intraoral scanners have become a standardized and promising tool and the direct data capturing in terms of scanning/digitalization of the impression achieves more accurate results than the indirect/conventional way by creating a corresponding plaster model . But a whole arch scan might be susceptible for more deviation in accuracy and should be restricted to ten units without wide edentulous areas [31, 32]. The direct scanning of dental arches takes longer than a conventional impression. Further, application is restricted to adults and to patients with regular mouth opening. The scanning time and the dimensions of the intraoral scanners are still too long and big for regular use in children or even newborns for diagnostic purposes or full virtual feeding-plate planning and production . Therefore, our workflow for simultaneous, radiation-free intra-extraoral registration remains dependent on conventional impression-taking.
The idea of digital facebows that combine intra- and extraoral registrations using spherical geometries have been described and patented before . Our geometries, which have been designed independently of the mentioned patent, have less contact to the lips and are in our opinion more easily transferred to the clinical setting. Bechtold et al. described a ten-step workflow for simultaneous intra-extraoral registration using a stationary photogrammetry system . In contrast to their technique, our modified impression tray was much smaller and easier to design than their extraoral registration geometry and we only needed six steps for virtual segmentation and alignment. In contrast, we did not perform a control analysis of the maxillary or mandibular dentoalveolar arch position in correlation to the extraoral facial anatomy with a CBCT or comparable methodology after virtual alignment, something that is a common procedure in the literature . There is no ethical approval granted by the Ethical Committee of the Technical University of Munich to perform a CBCT of our enrolled healthy participants. Therefore, this presented study focused on the accuracy of the two attached and scanned geometries as well as the feasibility of our virtual workflow and showed a low variance of alignments after a tenfold workflow repetition. The reduction of information when only performing six steps instead of ten seems to have only minor or even no impact. Here, the extraoral geometry showed best results in the RMSE analysis when the spherical geometry was used. This is in concordance to good results in the navigation-assisted surgery, where the intraoperative registration devices commonly also have spherical geometries for optimized tracking in the three-dimensional space. Spherical geometries can be detected from multiple angles easily . We wanted to compare the standard geometry to the cross geometry, because automated registration and positioning of the geometry is wanted in a further step in our diagnostics and treatment planning for children with cleft lip and palate. A cross-like geometry has shown best results in this automated step (data not published) and would have been the missing link for fully automated generation of CAD/CAM-assisted appliances for nasoalveolar moulding (NAM) therapy as described earlier [37, 38]. Furthermore, a cross-like geometry seems to be more suitable for the alignment due to definite edges which can be used for reference marker positioning. However, our analysis showed that the spherical geometry is detected better by the scanner used in our clinical practice due to the technical scanning algorithm – the cross was also fully scanned but the edges seemed to be radiused. Since the scanner always needs a swing, e.g. for scanning the nose completely, the advantages of the detection of a spherical geometry compared to an edged geometry are pushed into the background. Once scanned, there were no statistically significant differences in RMSE analysis between the two kinds of geometries. For this purpose, we therefore need to perform more analysis on the basis of this feasibility study to improve the missing cornerstone. Next steps will be the design of individualized impression trays with an integrated threaded basis in order to abolish the need for an additional attachment of it to further optimize the CAD procedure.
Lin et al. and Jayaratne et al. compared the accuracy of low-dose cone beam CT scan protocols with the 3dMD system and obtained an RMS error between 0.74 ± 0.24 and 1.8 ± 0.4 mm [35, 39]. The precision of other stationary 3D camera systems is reported to be good, with the mean absolute differences for the VECTRA system lying within 1.2 mm and less than 1 mm by using 3dMD [40, 41]. These reported results are more precise than a deviation of 2 mm. RMS error values larger than 2 mm are considered unreliable according to the literature [11, 35]. Our tenfold repetition of alignment and the consecutive analysis of RMSE of the superimposed models showed a mean deviation of 0.27 mm with a standard deviation of 0.078 and a variance of 0.006. For documentation and illustration for the patient, this deviation is clinically negligible. Virtual surgery planning (VSP) is reported to be feasible, reliable and accurate. But nevertheless, the difference between the virtual plan and the postoperative result still ranges between 1 and 2 mm or up to ±12.5° in mandibular reconstructions using the free fibula flap and in VSP orthognathic surgery [42, 43, 44, 45].
Nevertheless, studies comparing 3D photos compare only the “theoretical truth” with all the inaccuracies of the used systems . Further, no technique enables a precise simulation and prediction of the postoperative result, yet. Within the reported and known limitations we therefore think that our results are clinically acceptable and relevant .
The study population may appear very small. But in a preliminary analysis of the expected accuracy of our geometry, this number with the corresponding power of 0.95 was calculated and granted for analysis by the Ethical Committee of the Technical University of Munich. We have not found the perfect geometry for automated registration and segmentation in the post-processing process. However, in this first feasibility study we wanted to define the best extraoral geometry for simultaneous intra-extraoral registration, with a small dimension that would be applicable in children as well.
In summary, the study presents an optimization of our chair-side 3D scanner which can be transported and used anywhere, in contrast to a stationary system. Despite having the advantage of being a hand-held device there are no cutbacks on a high scanning resolution as with other mobile devices such as tablets or smartphones. We show an easy-to-replicate six-step workflow that can be used for digital planning or pre- and postinterventional documentation which is intuitively accessible.
Simultaneous, radiation-free intra-extraoral registration is possible and we described a six-step approach to solving this interesting and promising procedure, which can be applied in many fields in modern documentation and treatment planning. Our results implied a superiority of spherical geometry for extraoral registration.
Our analysed workflow for simultaneous dentoalveolar and extraoral soft tissue registration enables a radiation-free solution and can be applied in many fields of treatment planning and documentation.
We would particularly like to thank Mrs. Dr. Sonja Grill, M.Sc. for statistical consultations, Mr. Ulrich Schenzer from Antonius Köster Company for his support in 3D application matters, and Mr. Daniel Ross, M.Sc. for his language corrections. Further, we would like to thank the medical staff of our department for their interest and willingness to help us to improve further. The publication charges were covered by the German Research Foundation (DFG) and the Technical University of Munich (TUM) in the framework of the Open Access Publishing Program.
FG: study design, participant recruitment, data collection and analysis, manuscript writing; KDW: participant recruitment, manuscript editing; PE: data collection, manuscript editing; LMR: study design, data analysis, manuscript editing. All authors read and approved the final manuscript.
Ethics approval and consent to participate
All clinical investigations and procedures were conducted according to the principles expressed in the Declaration of Helsinki. Ethical approval for the prospective study was granted by the Ethical Committee of the Technical University of Munich (Approval No. 260/19S). All participants were recruited from the medical staff of our Department of Oral and Maxillofacial Surgery, written and informed consent was obtained.
Consent for publication
Consent for publication of data was further obtained with the written and informed consent mentioned upon.
The authors declare no financial or non-financial competing interests. The used 3D camera was partly financed by the Helene-Matras-Award.
- 2.Leukhardt M. Transferring esthetically relevant facial reference lines to the articulator. Journal of Craniomandibular Function. 2010;2(4):311–28.Google Scholar
- 12.Morioka D, Sato N, Kusano T, Muramatsu H, Tosa Y, Ohkubo F, Yoshimoto S. Difference in nasolabial features between awake and asleep infants with unilateral cleft lip: anthropometric measurements using three-dimensional stereophotogrammetry. J Craniomaxillofac Surg. 2015;43(10):2093–9.CrossRefGoogle Scholar
- 13.Ritschl LM, Roth M, Fichter AM, Mittermeier F, Kuschel B, Wolff KD, Grill FD, Loeffelbein DJ. The possibilities of a portable low-budget three-dimensional stereophotogrammetry system in neonates: a prospective growth analysis and analysis of accuracy. Head Face Med. 2018;14(1):11.CrossRefGoogle Scholar
- 25.R Development Core Team, R: A language and environment for statistical computing, R Foundation for Statistical Computing, Vienna, Austria, 2008.Google Scholar
- 26.RStudio Team, Integrated development for R. RStudio, Inc, Boston, MA, 2012.Google Scholar
- 34.K. Tegtmeyer, Digital face-bow, in: Weltorganisation für geistiges Eigentum (Ed.) 2018.Google Scholar
- 36.R. Brazeal, ow cost spherical registration targets for terrestrial laser, Sur 6905 – Point Cloud Analysis (2013).Google Scholar
- 37.Grill FD, Ritschl LM, Bauer FX, Rau A, Gau D, Roth M, Eblenkamp M, Wolff KD, Loeffelbein DJ. A semi-automated virtual workflow solution for the design and production of intraoral molding plates using additive manufacturing: the first clinical results of a pilot-study. Sci Rep. 2018;8(1):11845.CrossRefGoogle Scholar
- 38.Grill FD, Ritschl LM, Dikel H, Rau A, Roth M, Eblenkamp M, Wolff KD, Loeffelbein DJ, Bauer FX. Facilitating CAD/CAM nasoalveolar molding therapy with a novel click-in system for nasal stents ensuring a quick and user-friendly chairside nasal stent exchange. Sci Rep. 2018;8(1):12084.CrossRefGoogle Scholar
- 41.Wong JY, Oh AK, Ohta E, Hunt AT, Rogers GF, Mulliken JB, Deutsch CK. Validity and reliability of craniofacial anthropometric measurement of 3D digital photogrammetric images. The Cleft palate-craniofacial journal: official publication of the American Cleft Palate-Craniofacial Association. 2008;45(3):232–9.CrossRefGoogle Scholar
- 43.N.S.J. Tang, I. Ahmadi, A. Ramakrishnan, Virtual surgical planning in fibula free flap head and neck reconstruction: a systematic review and meta-analysis, journal of plastic, reconstructive & aesthetic surgery : JPRAS (2019).Google Scholar
- 44.Hanafy M, Akoush Y, Abou-ElFetouh A, Mounir RM. Precision of orthognathic digital plan transfer using patient-specific cutting guides and osteosynthesis versus mixed analogue-digitally planned surgery: a randomized controlled clinical trial. Int J Oral Maxillofac Surg. 2019.Google Scholar
- 46.Gibelli D, Pucciarelli V, Cappella A, Dolci C, Sforza C. Are portable Stereophotogrammetric devices reliable in facial imaging? A validation study of VECTRA H1 device. J Oral Maxillofac Surg. 2018.Google Scholar
- 47.Zinser MJ, Sailer HF, Ritter L, Braumann B, Maegele M, Zoller JE. A paradigm shift in orthognathic surgery? A comparison of navigation, computer-aided designed/computer-aided manufactured splints, and “classic” intermaxillary splints to surgical transfer of virtual orthognathic planning. J Oral Maxillofac Surg. 2013;71(12):2151 e1–21.CrossRefGoogle Scholar
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.