Skip to main content
SpringerLink
Log in

Surgical Navigation System for Pedicle Screw Placement Based on Mixed Reality

  • Regular Papers
  • Control Theory and Applications
  • Published:
International Journal of Control, Automation and Systems Aims and scope Submit manuscript

Abstract

Inaccurate screw insertion has been a major concern in pedicle screw placement in spinal surgery because of the potential for postoperative complications. Efforts to improve screw insertion have led to the development of novel surgical navigation systems. However, current surgical navigation systems have several problems in that the attention of surgeons is frequently interrupted during surgery, and complications occur in their depth perception because of the limitations of 2D monitors. This study proposes a surgical navigation system to address these issues using mixed reality (MR)-based smart glasses. We developed a navigation system that provides 3D visualization of the surgical tool with respect to the patient’s anatomy. It utilizes preoperative surgical planning data to provide visual feedback and guidance. An orthopedic surgeon performed pedicle screw placement with the navigation system in two different environments, using Microsoft HoloLens (HoloLens) and a 2D monitor. The results were evaluated according to procedural time, translational error, angular error, and clinical accuracy. The mean procedural time was 111.3 ± 52.7 s with the HoloLens and 192.1 ± 104.0 s with the 2D monitor. The mean translational error was 2.14 ± 1.13 mm at the entry and 3.14 ± 0.90 mm at the target with HoloLens. With the 2D monitor, the mean translational error was 2.10 ± 0.97 mm and 3.41 ± 2.16 mm at the entry and the target, respectively. The mean angular error was 6.44 ± 1.94 deg with HoloLens and 7.14 ± 4.20 deg with the 2D monitor. All screws were inserted intrapedicularly in both environments. The navigation system enables free visualization, reflects the human eye’s perspective, and retains the advantages of MR-based smart glasses. A navigation system compatible with minimally invasive surgery should be developed in the future.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. B. J. Shin, A. R. James, I. U. Njoku, and R. Härtl, “Pedicle screw navigation: A systematic review and meta-analysis of perforation risk for computer-navigated versus freehand insertion,” Journal of Neurosurgery: Spine, vol. 17, no. 2, pp. 113–122, 2012.

    Google Scholar 

  2. I. D. Gelalis, N. K. Paschos, E. E. Pakos, A. N. Politis, C. M. Arnaoutoglou, A. C. Karageorgos, A. Ploumis, and T. A. Xenakis, “Accuracy of pedicle screw placement: A systematic review of prospective in vivo studies comparing free hand, fluoroscopy guidance and navigation techniques,” European Spine Journal, vol. 21, no. 2, pp. 247–255, 2012.

    Article  Google Scholar 

  3. V. Kosmopoulos and C. Schizas, “Pedicle screw placement accuracy: A meta-analysis,” Spine, vol. 32, no. 3, 2007.

  4. J. Fichtner, N. Hofmann, A. Rienmüller, N. Buchmann, J. Gempt, J. S. Kirschke, F. Ringel, B. Meyer, and Y.-M. Ryang, “Revision rate of misplaced pedicle screws of the thoracolumbar spine-comparison of three-dimensional fluoroscopy navigation with freehand placement: A systematic analysis and review of the literature,” World Neurosurgery, vol. 109, pp. e24–e32, 2018.

    Article  Google Scholar 

  5. F. Liebmann, S. Roner, M. von Atzigen, D. Scaramuzza, R. Sutter, J. Snedeker, M. Farshad, and P. Fürnstahl, “Pedicle screw navigation using surface digitization on the Microsoft HoloLens,” International Journal of Computer Assisted Radiology and Surgery, vol. 14, no. 7, pp. 1157–1165, 2019.

    Article  Google Scholar 

  6. H. Frisk, E. Lindqvist, O. Persson, J. Weinzierl, L. K. Bruetzel, P. Cewe, G. Burström, E. Edström, and A. Elmi-Terander, “Feasibility and accuracy of thoracolumbar pedicle screw placement using an augmented reality head mounted device,” Sensors, vol. 22, no. 2, 522, 2022.

    Article  Google Scholar 

  7. A. J. Butler, M. W. Colman, J. Lynch, and F. M. Phillips, “Augmented reality in minimally invasive spine surgery: Early efficiency and complications of percutaneous pedicle screw instrumentation,” The Spine Journal, vol. 23, no. 1, pp. 27–33, 2023.

    Article  Google Scholar 

  8. Y. Liu, M.-G. Lee, and J.-S. Kim, “Spine surgery assisted by augmented reality: Where have we been?,” Yonsei Medical Journal, vol. 63, no. 4, pp. 305–316, 2022.

    Article  Google Scholar 

  9. K. S. Arun, T. S. Huang, and S. D. Blostein, “Least-squares fitting of two 3-D point sets,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-9, no. 5, pp. 698–700, 1987.

    Article  Google Scholar 

  10. F. Müller, S. Roner, F. Liebmann, J. M. Spirig, P. Fürnstahl, and M. Farshad, “Augmented reality navigation for spinal pedicle screw instrumentation using intraoperative 3D imaging,” The Spine Journal, vol. 20, no. 4, pp. 621–628, 2020.

    Article  Google Scholar 

  11. Z. Zhang, “Iterative closest point (ICP),” Computer Vision, pp. 433–434, 2014.

  12. G. Burström, R. Nachabe, O. Persson, E. Edström, and A. Elmi-Terander, “Augmented and virtual reality instrument tracking for minimally invasive spine surgery,” Spine, vol. 44, no. 15, pp. 1097–1104, 2019.

    Article  Google Scholar 

  13. S. D. Gertzbein and S. E. Robbins, “Accuracy of pedicular screw placement in vivo,” Spine, vol. 15, no. 1, pp. 11–14, 1990.

    Article  Google Scholar 

  14. J. Traub, T. Sielhorst, S.-M. Heining, and N. Navab, “Advanced display and visualization concepts for image guided surgery,” Journal of Display Technology, vol. 4, no. 4, pp. 483–490, 2008.

    Article  Google Scholar 

  15. P. Zhang, H. Liu, H. Li, and J. J. Wang, “The application of navigation system based on augmented reality head-mounted devices in spine surgery,” Neuroscience Informatics, vol. 2, no. 2, 100076, 2022.

    Article  Google Scholar 

  16. W. Eric L. Grimson, R. Kikinis, F. A. Jolesz, and P. M. Black, “Image-guided surgery,” Scientific American, vol. 280, no. 6, pp. 62–69, 1999.

    Article  Google Scholar 

  17. N.-F. Tian and H.-Z. Xu, “Image-guided pedicle screw insertion accuracy: A meta-analysis,” International Orthopaedics, vol. 33, no. 4, pp. 895–903, 2009.

    Article  Google Scholar 

  18. C. L. Goldstein, K. Macwan, K. Sundararajan, and Y. R. Rampersaud, “Perioperative Outcomes and adverse events of minimally invasive versus open posterior lumbar fusion: Meta-analysis and systematic review,” Journal of Neurosurgery: Spine, vol. 24, no. 3, pp. 416–427, 2016.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical, Electronic, and Computer Engineering, University of Ulsan, 93 Daehak-ro, Namgu, Ulsan, 44610, Korea

    Seokbin Hwang

  2. Department of Orthopaedic Surgery, Gyeongsang National University College of Medicine and Gyeongsang National University Changwon Hospital, 11 Samjeongja-ro, Seongsan-gu, Changwon, Gyeongsangnam-do, Korea

    Suk-joong Lee

  3. Department of Biomedical Engineering, University of Ulsan, 93 Daehak-ro, Nam-gu, Ulsan, 44610, Korea

    Sungmin Kim

Authors
  1. Seokbin Hwang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Suk-joong Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sungmin Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sungmin Kim.

Ethics declarations

The authors declare that they have no conflict of interest.

Additional information

Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This research was supported by “Regional Innovation Strategy (RIS)” through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (MOE)(2021-RIS-003).

Seokbin Hwang received his B.S. degree in biomedical engineering from the University of Ulsan, Ulsan, Korea, in 2022. He is currently undergoing an M.S. degree in the Department of Electrical, Electronic, and Computer Engineering at the University of Ulsan. His research interests include mixed reality and surgical navigation.

Suk-joong Lee received his B.S. degree in medicine from the School of Medicine, Jeonbuk National University, Jeonju, Korea, in 2003. He received his M.S. and Ph.D. degrees from the School of Medicine, Kyungpook National University. His research interests include mixed reality and surgical navigation in spine surgery.

Sungmin Kim received his B.S. degree in mechanical engineering and his M.S. and Ph.D. degrees in biomedical engineering from Hanyang University, in 2003, 2005, and 2010, respectively. He is currently an assistant professor in the Department of Biomedical Engineering at the University of Ulsan from 2019. His research interests include image-guided surgery, surgical navigation and robotics, medical image processing, surgical planning and improving the clinical environment with novel interfaces using AR, VR, and MR techniques.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hwang, S., Lee, Sj. & Kim, S. Surgical Navigation System for Pedicle Screw Placement Based on Mixed Reality. Int. J. Control Autom. Syst. 21, 3983–3993 (2023). https://doi.org/10.1007/s12555-023-0083-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12555-023-0083-6

Keywords

Search

Navigation