Skip to main content
SpringerLink
Log in

Virtual facial reconstruction based on accurate registration and fusion of 3D facial and MSCT scans

Virtuelle Gesichtsrekonstruktion auf der Grundlage genauer Registrierung und Fusion von 3-D- und MSCT-Scans

  • Original Article
  • Published:
Journal of Orofacial Orthopedics / Fortschritte der Kieferorthopädie Aims and scope Submit manuscript

Abstract

Objectives

Accurate registration and feasible fusion of a three-dimensional (3D) photorealistic surface images (captured using the FaceSCAN3D® Scientific Photo Lab) from multislice spiral computed tomography (MSCT) images is important to achieve optimal craniomaxillofacial surgery outcomes; thus, the aim of this work was to optimize this process.

Methods

MSCT and 3D facial scans were acquired from 37 randomly selected patients. Using the Invesalius software package, skin and bone tissue models were reconstructed. The 3D photorealistic surface images were then constructed. Four image registration processes were performed using Geomagic Studio software: manual Procrustes and semi-automatic registration (global modified ICP) using both 7 and 15 anthropometric landmarks. The statistical differences were assessed using one-way ANOVA and LSD tests. P values <0.05 were considered significant.

Results

Average distances between these two surfaces measured 0.99 (SD 0.13 mm), 0.77 (SD 0.11 mm), 0.99 (SD 0.15 mm), and 0.77 mm (SD 0.10 mm) via the four image registration methods. Statistical differences were observed between the manual and semi-automatic registration groups (according to 7 and 15 anthropometric landmarks, respectively). Image registration errors for the entire virtual face were <0.8 mm in the semi-automatic registration groups.

Conclusion

Employing the Procrustes registration system using seven anthropometric landmarks together with global registration allows accurate registration and feasible fusion of 3D facial scans with reconstructed 3D MSCT image data.

Zusammenfassung

Ziele

Der Prozess der genauen Registrierung und der praktikablen Fusion von fotorealistischen 3-D-Oberflächenbildern (FaceSCAN3D® Scientific Photo Lab) mit MSCT(“multislice spiral computed tomography”)-Bilddatensätzen ist von hoher Relevanz für optimale Ergebnisse bei kraniomaxillofazialen operativen Interventionen. Daher war es Ziel der Arbeit, diesen Prozess zu optimieren.

Methoden

Von 37 randomisiert ausgewählten Patienten wurden MSCT- und 3-D-Gesichtsscans erstellt. Mit der Software InVesalius wurden Haut- und Knochenmodelle rekonstruiert. Die fotorealistischen 3-D-Oberflächenbilder wurden rekonstruiert. Mit der Software Geomagic Studio wurden 4 Registrierungsprozesse vorgenommen: manuelle Prokrustes- und semiautomatische Registrierung (“global modified ICP”, Iterative Closest Point) unter Verwendung von sowohl 7 als auch 15 anthropometrischen Landmarken. Statistische Unterschiede wurden mit dem Ein-Wege-ANOVA(“analysis of variance”)- und dem LSD (“least significant difference”)-Test ermittelt. Als signifikant definiert wurden p-Werte <0,05.

Ergebnisse

Die durchschnittlichen Entfernungen zwischen den 2 gemessenen Oberflächen lagen bei 0,99 (SD 0,13 mm), 0,77 (SD 0,11 mm), 0,99 (SD 0,15 mm) und 0,77 mm (SD 0,10 mm) bei den 4 eingesetzten Bildregistrierungsmethoden. Zu beobachten waren statistische Unterschiede zwischen den Gruppen mit manueller und semiautomatischer Registrierung (an 7 bzw. 15 anthropometrischen Landmarken). Die Registrierungsfehler für das gesamte virtuelle Gesicht waren in den semiautomatischen Registrierungsgruppen geringer als 0,8 mm.

Schlussfolgerungen

Das Prokrustes-Registrierungssystem mit 7 anthropometrischen Landmarken ermöglicht in Verbindung mit einer globalen Registrierung die genaue Registrierung und machbare Fusion dreidimensionaler Gesichtsscans mit rekonstruierten 3-D-MSCT-Bilddaten.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Adolphs N, Haberl E-J, Liu W, Keeve E, Menneking H, Hoffmeister B (2013) Virtual planning for craniomaxillofacial surgery—7 years of experience. J Cranio-Maxillofac Surg

  2. Ayoub AF, Xiao Y, Khambay B, Siebert JP, Hadley D (2007) Towards building a photo-realistic virtual human face for craniomaxillofacial diagnosis and treatment planning. Int J Oral Maxillofac Surg 36:423–428

    Article  PubMed  Google Scholar 

  3. Billings S, Taylor R (2014) Iterative most likely oriented point registration. Med Image Comput Comput Assist Interv 17:178–185

    PubMed  Google Scholar 

  4. Gelesko S, Markiewicz MR, Weimer K, Bell RB (2012) Computer-aided orthognathic surgery. Atlas Oral Maxillofac Surg Clin 20:107–118

    Article  Google Scholar 

  5. Govindu VM, Pooja A (2014) On averaging multiview relations for 3D scan registration. IEEE Trans Image Process 23:1289–1302

    Article  PubMed  Google Scholar 

  6. Grauer D, Cevidanes LS, Proffit WR (2009) Working with DICOM craniofacial images. Am J Orthod Dentofac Orthop 136:460–470

    Article  Google Scholar 

  7. Hu Y, Li H, Qiao G, Liu H, Ji A, Ye F (2011) Computer-assisted virtual surgical procedure for acetabular fractures based on real CT data. Injury 42:1121–1124

    Article  PubMed  Google Scholar 

  8. Jayaratne YS, McGrath CP, Zwahlen RA (2012) How accurate are the fusion of cone-beam CT and 3-D stereophotographic images? PLoS One 7:e49585

    Article  PubMed  PubMed Central  Google Scholar 

  9. Khambay B, Nebel JC, Bowman J, Walker F, Hadley DM, Ayoub A (2002) 3D stereophotogrammetric image superimposition onto 3D CT scan images: the future of orthognathic surgery. A pilot study. Int J Adult Orthod Orthognath Surg 17:331–341

    Google Scholar 

  10. Nahm KY, Kim Y, Choi YS, Lee J, Kim SH, Nelson G (2014) Accurate registration of cone-beam computed tomography scans to 3-dimensional facial photographs. Am J Orthod Dentofac Orthop 145:256–264

    Article  Google Scholar 

  11. Naudi KB, Benramadan R, Brocklebank L, Ju X, Khambay B, Ayoub A (2013) The virtual human face: superimposing the simultaneously captured 3D photorealistic skin surface of the face on the untextured skin image of the CBCT scan. Int J Oral Maxillofac Surg 42:393–400

    Article  PubMed  Google Scholar 

  12. Noh H, Nabha W, Cho JH, Hwang HS (2011) Registration accuracy in the integration of laser-scanned dental images into maxillofacial cone-beam computed tomography images. Am J Orthod Dentofac Orthop 140:585–591

    Article  Google Scholar 

  13. Plooij JM, Maal TJ, Haers P, Borstlap WA, Kuijpers-Jagtman AM, Berge SJ (2011) Digital three-dimensional image fusion processes for planning and evaluating orthodontics and orthognathic surgery. A systematic review. Int J Oral Maxillofac Surg 40:341–352

    Article  PubMed  Google Scholar 

  14. Popat H, Richmond S, Drage NA (2010) New developments in: three-dimensional planning for orthognathic surgery. J Orthod 37:62–71

  15. Saad A, Winters R, Wise MW, Dupin CL, St Hilaire H (2013) Virtual surgical planning in complex composite maxillofacial reconstruction. Plast Reconstr Surg 132:626–633

    Article  PubMed  Google Scholar 

  16. Schendel SA, Duncan KS, Lane C (2011) Image fusion in preoperative planning. Facial Plast Surg Clin N Am 19:577–90 vii

  17. Terzic A, Schouman T, Scolozzi P (2013) Accuracy of morphological simulation for orthognatic surgery. Assessment of a 3D image fusion software. Rev Stomatol Chir Maxillofac Chir Orale

  18. Tzou CH, Frey M (2011) Evolution of 3D surface imaging systems in facial plastic surgery. Facial Plast Surg Clin N Am 19:591–602 vii

  19. Uechi J, Tsuji Y, Konno M, Hayashi K, Shibata T, Nakayama E, Mizoguchi I (2014) Generation of virtual models for planning orthognathic surgery using a modified multimodal image fusion technique. Int J Oral Maxillofac Surg

Download references

Acknowledgments

This study was funded by the Chinese National 863 Program (2013AA040804).

Author information

Author notes

    Authors and Affiliations

    1. Department of Oral and Maxillofacial Surgery, West China College of Stomatology, Sichuan University, No. 14, 3rd Section, Renmin South Road, Chengdu, 610041, Sichuan, People’s Republic of China

      Zhongwei Zhou, Peng Li, Jiayin Ren, Weidong Tian & Wei Tang

    2. Department of Oral and Maxillofacial Surgery, General Hospital, Ningxia Medical University, No. 804, Sheng Li South Road, Yinchuan, 750004, Ningxia, People’s Republic of China

      Zhongwei Zhou & Yongqing Huang

    3. College of Computer Science, Sichuan University, No. 24, South Section 1, Yihuan Road, Chengdu, 610065, Sichuan, People’s Republic of China

      Jixiang Guo

    4. State Key Laboratory of Oral Disease, Sichuan University, No. 14, 3rd Section, Renmin South Road, Chengdu, 610041, Sichuan, People’s Republic of China

      Weidong Tian

    Authors
    1. Zhongwei Zhou
      View author publications

      You can also search for this author in PubMed Google Scholar

    2. Peng Li
      View author publications

      You can also search for this author in PubMed Google Scholar

    3. Jiayin Ren
      View author publications

      You can also search for this author in PubMed Google Scholar

    4. Jixiang Guo
      View author publications

      You can also search for this author in PubMed Google Scholar

    5. Yongqing Huang
      View author publications

      You can also search for this author in PubMed Google Scholar

    6. Weidong Tian
      View author publications

      You can also search for this author in PubMed Google Scholar

    7. Wei Tang
      View author publications

      You can also search for this author in PubMed Google Scholar

    Corresponding authors

    Correspondence to Weidong Tian or Wei Tang.

    Ethics declarations

    All studies on humans described in the present manuscript were carried out with the approval of the responsible ethics committee and in accordance with national law and the Helsinki Declaration of 1975 (in its current, revised form). Informed consent was obtained from all patients included in studies.

    Conflict of interest

    Zhong Wei Zhou, Peng Li, Jia Yin Ren, Ji Xiang Guo, Yongqing Huang, Wei Dong Tian, and Wei Tang state that there are no conflicts of interest.

    Additional information

    Z. W. Zhou and P. Li contributed to the study equally.

    Rights and permissions

    Reprints and permissions

    About this article

    Check for updates. Verify currency and authenticity via CrossMark

    Cite this article

    Zhou, Z., Li, P., Ren, J. et al. Virtual facial reconstruction based on accurate registration and fusion of 3D facial and MSCT scans. J Orofac Orthop 77, 104–111 (2016). https://doi.org/10.1007/s00056-016-0014-8

    Download citation

    • Received:

    • Accepted:

    • Published:

    • Issue Date:

    • DOI: https://doi.org/10.1007/s00056-016-0014-8

    Keywords

    Schlüsselwörter

    Search

    Navigation