Skip to main content

Advertisement

Log in

Contactless surface registration of featureless anatomy using structured light camera: application to fibula navigation in mandible reconstruction

  • Original Article
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

Abstract

Purpose

Mandibular reconstruction using fibula free flap is a challenging surgical procedure. To assist osteotomies, computer-assisted surgery (CAS) can be used. Nevertheless, precise registration is required and often necessitates anchored markers that disturb the patient and clinical flow. This work proposes a new contactless surface-based method adapted to featureless anatomies such as fibula to achieve a fast, precise, and reproducible registration.

Methods

Preoperatively, a CT-scan of the patient is realized and osteotomies are virtually planned. During surgery, a structured light camera digitizes the fibula. The obtained intraoperative point cloud is coarsely registered with the preoperative model using 3 points defined in the CT-scan and located on the patient’s bone with a laser beam. Then, a fine registration is performed using an ICP algorithm. The registration accuracy was evaluated comparing the position of points engraved in a 3D-printed fibula with their position in the registered model and evaluating resulting osteotomies. Accuracy and execution time were compared to a conventional stylus-based registration method. The work was validated in vivo.

Results

The experiment performed on a 3D-printed model showed that execution time is equivalent to surface-based registration using a stylus, with a better accuracy (mean TRE of 0.9 mm vs 1.3 mm using stylus) and guarantee good osteotomies. The preliminary in vivo study proved the feasibility of the method.

Conclusion

The proposed contactless surface-based registration method using structured light camera gave promising results in terms of accuracy and execution speed and should be useful to implement CAS for mandibular reconstruction.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Hidalgo DA (1989) Fibula free flap: a new method of mandible reconstruction. Plast Reconstr Surg 84(1):71–79

    Article  CAS  PubMed  Google Scholar 

  2. Blackwell KE, Brown MT, Gonzalez D (1997) Overcoming the learning curve in microvascular head and neck reconstruction. Arch Otolaryngol Head Neck Surg 123(12):1332–1335

    Article  CAS  PubMed  Google Scholar 

  3. Niklas R, Rainer KM, Hagen RN, Josef BFM, Klaus-Dietrich W, Jochen W (2017) Mandible reconstruction with free fibula flaps: outcome of a cost-effective individual planning concept compared with virtual surgical planning. J Cranio-Maxillofac Surg 45(8):1246–1250

    Article  Google Scholar 

  4. Fan W, Dai Y, Giordano G (2020) CAOS TKA provides improved functional outcomes compared to conventional TKA. In: CAOS 2020. The 20th annual meeting of the international society for computer assisted orthopaedic surgery, pp 74–69

  5. Shan X-F, Chen H-M, Liang J, Huang J-W, Zhang L, Cai Z-G, Chuanbin G (2016) Surgical navigation-assisted mandibular reconstruction with fibula flaps. Int J Oral Maxillofac Surg 45(4):448–453

    Article  PubMed  Google Scholar 

  6. Li P, Xuan M, Liao C, Tang W, Wang X, Tian W, Long J (2016) Application of intraoperative navigation for the reconstruction of mandibular defects with microvascular fibular flaps-preliminary clinical experiences. J Craniofac Surg 27(3):751–755

  7. Chao AH, Weimer K, Raczkowsky J, Zhang Y, Kunze M, Cody D, Selber JC, Hanasono MM, Skoracki RJ (2016) Pre-programmed robotic osteotomies for fibula free flap mandible reconstruction: a preclinical investigation: robotic osteotomies of fibula free flaps. Microsurgery 36(3):246–249

    Article  PubMed  Google Scholar 

  8. Zhu J-H, Deng J, Liu X-J, Wang J, Guo Y-X, Guo C-B (2016) Prospects of robot-assisted mandibular reconstruction with fibula flap: comparison with a computer-assisted navigation system and freehand technique. J Reconstr Microsurg 32(9):661–669

    Article  PubMed  Google Scholar 

  9. de Boutray M, Cavalcanti Santos J, Bourgeade A, Ohayon M, Chammas P-E, Garrel R, Poignet P, Zemiti N (2022) Fibular registration using surface matching in navigation-guided osteotomies: a proof of concept study on 3d-printed models. Int J Comput Assist Radiol Surg 17(7):1321–1331

    Article  PubMed  Google Scholar 

  10. Hoffmann J, Westendorff C, Leitner C, Bartz D, Reinert S (2005) Validation of 3d-laser surface registration for image-guided cranio-maxillofacial surgery. J Cranio-Maxillofac Surg 33(1):13–18

    Article  Google Scholar 

  11. Sta S, Ogor J, Letissier H, Stindel E, Hamitouche C, Dardenne G (2021) Towards markerless computer assisted surgery: application to total knee arthroplasty. Int J Med Robot Comput Assist Surg 17:e2296

    Article  Google Scholar 

  12. Torres PMB, Gonçalves PJS, Martins JMM (2018) Robotic system navigation developed for hip resurfacing prosthesis surgery. In: Husty M, Hofbaur M (eds) New trends in medical and service robots, vol 48. Mechanisms and machine science. Springer, Berlin, pp 173–183

    Chapter  Google Scholar 

  13. Enebuse I, Foo M, Ibrahim BSKK, Ahmed H, Supmak F, Eyobu OS (2021) A comparative review of hand-eye calibration techniques for vision guided robots. IEEE Access 9:113143–113155

    Article  Google Scholar 

  14. Kahn S, Haumann D, Willert V (2014) Hand-eye calibration with a depth camera: 2D OR 3D? In: 2014 international conference on computer vision theory and applications (VISAPP), vol 3, pp 481–489

  15. Cuau L (2022) Fast and automatic optical 3D cameras calibration for contactless surface registration in computer assisted surgery. In: 2022 11th conference on new technologies for computer and robot assisted surgery

  16. Yang L, Cao Q, Lin M, Zhang H, Ma Z (2018) Robotic hand-eye calibration with depth camera: a sphere model approach. In: 2018 4th international conference on control, automation and robotics (ICCAR). IEEE, pp 104–110

  17. Zhang Z (1994) Iterative point matching for registration of free-form curves and surfaces. Int J Comput Vis 13(2):119–152

    Article  Google Scholar 

  18. Yaniv Z (2015) Which pivot calibration? In Webster RJ, Ziv RY (eds) SPIE medical imaging, p 941527

  19. Qi CR, Su H, Mo K, Guibas LJ (2016) Pointnet: deep learning on point sets for 3d classification and segmentation. CoRR, arxiv:1612.00593

  20. Myronenko A, Song X (2010) Point set registration: coherent point drift. IEEE Trans Pattern Anal Mach Intell 32(12):2262–2275

    Article  PubMed  Google Scholar 

  21. Segal A, Haehnel D, Thrun S (2009) Generalized-ICP. In: Robotics: science and systems V. Robotics: Science and Systems Foundation

  22. Yang J, Li H, Jia Y (2013) Go-ICP: solving 3d registration efficiently and globally optimally. In: 2013 IEEE international conference on computer vision. IEEE, pp 1457–1464

  23. Pellini R, Mercante G, Spriano G (2012) Step-by-step mandibular reconstruction with free fibula flap modelling. Acta Otorhinolaryngol Ital 32(6):405–409

    CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

This work was supported in part by the French National Agency for Research (Agence Nationale pour la Recherche, ANR) within the Investissements d’Avenir Program (Labex CAMI, ANR-11-LABX0004, Labex NUMEV, ANR-10-LABX-20) and by the ROBOTEX 2.0 (Grants ROBOTEX ANR-10-EQPX-44-01 and TIRREX ANR-21-ESRE-0015).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lénaïc Cuau.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical standard

Written informed consent was obtained from all individual participants before study commencement. All procedures performed in our study were in accordance with the 1964 Helsinki declaration and its later amendments. Institutional review and approval were not required due to the noninvasive nature of our study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cuau, L., De Boutray, M., Cavalcanti Santos, J. et al. Contactless surface registration of featureless anatomy using structured light camera: application to fibula navigation in mandible reconstruction. Int J CARS 18, 2073–2082 (2023). https://doi.org/10.1007/s11548-023-02966-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-023-02966-3

Keywords

Navigation