Skip to main content
SpringerLink
Log in

Auditory feedback to support image-guided medical needle placement

  • Original Article
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

Abstract

Purpose

During medical needle placement using image-guided navigation systems, the clinician must concentrate on a screen. To reduce the clinician’s visual reliance on the screen, this work proposes an auditory feedback method as a stand-alone method or to support visual feedback for placing the navigated medical instrument, in this case a needle.

Methods

An auditory synthesis model using pitch comparison and stereo panning parameter mapping was developed to augment or replace visual feedback for navigated needle placement. In contrast to existing approaches which augment but still require a visual display, this method allows view-free needle placement. An evaluation with 12 novice participants compared both auditory and combined audiovisual feedback against existing visual methods.

Results

Using combined audiovisual display, participants show similar task completion times and report similar subjective workload and accuracy while viewing the screen less compared to using the conventional visual method. The auditory feedback leads to higher task completion times and subjective workload compared to both combined and visual feedback.

Conclusion

Audiovisual feedback shows promising results and establishes a basis for applying auditory feedback as a supplement to visual information to other navigated interventions, especially those for which viewing a patient is beneficial or necessary.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Arnolli MM, Hanumara NC, Franken M, Brouwer DM, Broeders IA (2015) An overview of systems for CT- and MRI-guided percutaneous needle placement in the thorax and abdomen. Med Robot Comput Assist Surg 11(4):458–475

    Article  Google Scholar 

  2. Beller S, Hünerbein M, Eulenstein S, Lange T, Schlag PM (2007) Feasibility of navigated resection of liver tumors using multiplanar visualization of intraoperative 3-dimensional ultrasound data. Ann Surg 246:288–294

    Article  PubMed  PubMed Central  Google Scholar 

  3. Black D, Kocev B, Meine H, Nabavi A, Kikinis R (2016) Towards uncertainty-aware auditory display for surgical navigation. In: Proceedings of gesellschaft für computer- und roboterassistierte chirurgie (CURAC), Bern, Switzerland

  4. Cash DM, Miga MI, Glasgow SC, Dawant BM, Clements LW, Cao Z, Galloway RL, Chapman WC (2007) Concepts and preliminary data toward the realization of image-guided liver surgery. Gastroint Surg 11:844–859

    Article  Google Scholar 

  5. Chen X, Wang L, Fallavollita P, Navab N (2013) Precise X-ray and video overlay for augmented reality fluoroscopy. Int J Comput Assist Radiol Surg 8(1):29–28

    Article  CAS  PubMed  Google Scholar 

  6. Cho B, Oka M, Matsumoto N, Ouchida R, Hong J, Hashizume M (2013) Warning navigation system using realtime safe region monitoring for otologic surgery. Comput Assist Radiol Surg 8:395–405

    Article  Google Scholar 

  7. Dixon BJ, Chan H, Daly MJ, Vescan AD, Witterick IJ, Irish JC (2012) The effect of augmented real-time image guidance on task workload during endoscopic sinus surgery. Int Forum Allergy Rhinol 2:405–410

    Article  PubMed  Google Scholar 

  8. Dixon BJ, Daly MJ, Chan H, Vescan AD, Witterick IJ, Irish JC (2013) Surgeons blinded by enhanced navigation: the effect of augmented reality on attention. Surg Endosc 27(2):454–461

    Article  PubMed  Google Scholar 

  9. Dixon BJ, Daly MJ, Chan H, Vescan AD, Witterick IJ, Irish JC (2014) Augmented real-time navigation with critical structure proximity alerts for endoscopic skull base surgery. Laryngoscope 124:853–859

    Article  PubMed  Google Scholar 

  10. Fischbach F, Bunke J, Thormann M, Gaffke G, Jungnickel K, Smink J, Ricke J (2011) MR-guided freehand biopsy of liver lesions with fast continuous imaging using a 1.0-T open MRI scanner: experience in 50 patients. Cardiovasc Interv Radiol 34:188–192

    Article  Google Scholar 

  11. Haerle SK, Daly MJ, Chan H, Vescan AD, Witterick I, Gentili F, Zadeh G, Kucharczyk W, Irish JC (2015) Localized intraoperative virtual endoscopy (LIVE) for surgical guidance in 16 skull base patients. Otolaryngol Head Neck Surg 152:165–171

    Article  PubMed  Google Scholar 

  12. Hansen C, Black D, Lange C, Rieber F, Lamad W, Donati M, Oldhafer K, Hahn H (2013) Auditory support for resection guidance in navigated liver surgery. Med Robot Comput Assist Surg 9(1):36–43

  13. Hansen C, Wieferich J, Ritter F, Rieder C, Peitgen HO (2013) Illustrative visualization of 3D planning models for augmented reality in liver surgery. Int J Comput Assist Radiol Surg 5(2):133–141

    Article  Google Scholar 

  14. Hansen C, Zidowitz S, Ritter F, Lange C, Oldhafer K, Hahn HK (2013) Risk maps for liver surgery. Int J Comput Assist Radiol Surg 8(3):419–428

    Article  PubMed  Google Scholar 

  15. Hart SG (2006) NASA-Task Load Index (NASA-TLX); 20 years later. In: Human Factors and Ergonomics Society 50th annual meeting. HFES, Santa Monica, pp 904–908

  16. Hermann T (2008) Taxonomy and definitions for sonification and auditory display. In: 14th international conference on auditory display, Paris, France

  17. Kersten-Oertel C, Jannin P, Collins DL (2012) DVV: a taxonomy for mixed reality visualization in image guided surgery. IEEE TVCG 18(2):332–352

    PubMed  Google Scholar 

  18. Luz M, Manzey D, Modemann S, Strauss G (2015) Less is sometimes more: a comparison of distance-control and navigated-control concepts of image-guided navigation support for surgeons. Ergonomics 58:383–393

    Article  PubMed  Google Scholar 

  19. Marcus HJ, Pratt P, Hughes-Hallett A, Cundy TP, Marcus AP, Yang GZ, Darzi A, Nandi D (2015) Comparative effectiveness and safety of image guidance systems in neurosurgery: a preclinical randomized study. J Neurosurg 123(2):307–313

    Article  PubMed  PubMed Central  Google Scholar 

  20. Peterhans M, Oliveira T, Banz V, Candinas D, Weber S (2012) Computer-assisted liver surgery: clinical applications and technological trends. Crit Rev Biomed Eng 40:199–220

  21. Puckette, M (1996) Pure Data: another integrated computer music environment. In: Second intercollege computer music concerts, pp 37–41

  22. Voormolen EH, Woerdeman PA, van Stralen M, Noordmans HJ, Viergever MA, Regli L, van der Sprenkel JW (2012) Validation of exposure visualization and audible distance emission for navigated temporal bone drilling in phantoms. PLoS ONE 7:e41262

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  23. Walker BN, Nees MA (2011) Theory of sonification. In: Hermann T, Hunt A, Neuhoff J (eds) Handbook of sonification. Academic Press, New York

    Google Scholar 

  24. Wegner K, Karron D (1998) Audio-guided blind biopsy needle placement. Stud Health Technol Inform 50:90–95

    CAS  PubMed  Google Scholar 

  25. Willems PW, Noordmans HJ, van Overbeeke JJ, Viergever MA, Tulleken CA, van der Sprenkel JW (2005) The impact of auditory feedback on neuronavigation. Acta Neurochir (Wien) 147:167–173

    Article  CAS  Google Scholar 

  26. Woerdeman PA, Willems PW, Noordmans HJ, van der Sprenkel JW (2009) Auditory feedback during frameless image-guided surgery in a phantom model and initial clinical experience. Neurosurgery 110:257–262

    Article  Google Scholar 

  27. Wright M, Freed A (1997) Open sound control: a new protocol for communicating with sound synthesizers. In: Proceedings of the 1997 international computer music conference

  28. Wright M, Freed A, Momeni A (2003) OpenSound control: state of the art 2003 In: Proceedings of the 2003 conference on new interfaces for musical expression, pp 153–160

Download references

Acknowledgements

The work of this paper is partly funded by the German Research Foundation (DFG) under Grant Number HA 7819/1-1, and the Federal Ministry of Education and Research within the Forschungscampus STIMULATE under Grant Number 13GW0095A.

Funding was also provided by Neuroimaging Analysis Center (Grant No. P41 EB015902), Image Guided Therapy Center (Grant No. P41 EB015898), Accelerating Community-Driven Medical Innovation with VTK (Grant No. R01EB014955), Quantitative Image Informatics of Cancer Research (QIICR) (Grant No. U24CA180918).

Author information

Authors and Affiliations

  1. Jacobs University, Bremen, Germany

    David Black & Horst Hahn

  2. Medical Image Computing, University of Bremen, Bremen, Germany

    David Black & Ron Kikinis

  3. Fraunhofer MEVIS, Bremen, Germany

    David Black, Ron Kikinis & Horst Hahn

  4. Faculty of Computer Science, Otto-von-Guericke University Magdeburg, Magdeburg, Germany

    Julian Hettig, Maria Luz & Christian Hansen

  5. Surgical Planning Laboratory, Brigham and Women’s Hospital, Boston, MA, USA

    Ron Kikinis

Authors
  1. David Black
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Julian Hettig
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Maria Luz
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Christian Hansen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ron Kikinis
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Horst Hahn
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to David Black.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Black, D., Hettig, J., Luz, M. et al. Auditory feedback to support image-guided medical needle placement. Int J CARS 12, 1655–1663 (2017). https://doi.org/10.1007/s11548-017-1537-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-017-1537-1

Keywords

Search

Navigation