Surgical soundtracks: automatic acoustic augmentation of surgical procedures
- 209 Downloads
Advances in sensing and digitalization enable us to acquire and present various heterogeneous datasets to enhance clinical decisions. Visual feedback is the dominant way of conveying such information. However, environments rich with many sources of information all presented through the same channel pose the risk of over stimulation and missing crucial information. The augmentation of the cognitive field by additional perceptual modalities such as sound is a workaround to this problem. A major challenge in auditory augmentation is the automatic generation of pleasant and ergonomic audio in complex routines, as opposed to overly simplistic feedback, to avoid alarm fatigue.
In this work, without loss of generality to other procedures, we propose a method for aural augmentation of medical procedures via automatic modification of musical pieces.
Evaluations of this concept regarding recognizability of the conveyed information along with qualitative aesthetics show the potential of our method.
In this paper, we proposed a novel sonification method for automatic musical augmentation of tasks within surgical procedures. Our experimental results suggest that these augmentations are aesthetically pleasing and have the potential to successfully convey useful information. This work opens a path for advanced sonification techniques in the operating room, in order to complement traditional visual displays and convey information more efficiently.
KeywordsComputer-assisted interventions Auditory display Surgical sonification Medical augmented reality Acoustic augmentation Psychoacoustics
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
There is no study presented in this paper which requires ethical approval.
This articles does not contain patient data.
Supplementary material 1 (mp4 13361 KB)
- 2.Bluteau J, Dubois M-D, Coquillart S, Gentaz E, Payan Y (2010) Vibrotactile guidance for trajectory following in computer aided surgery. In: Engineering in medicine and biology society (EMBC), 2010 annual international conference of the IEEE, pp 2085–2088. IEEEGoogle Scholar
- 4.Howard T, Szewczyk J (2014) Visuo-haptic feedback for 1-d guidance in laparoscopic surgery. In: Biomedical robotics and biomechatronics, 2014 5th IEEE RAS & EMBS International Conference on, IEEE, pp 58–65Google Scholar
- 5.Kestin IG, Miller BR, Lockhart CH (1988) Auditory alarms during anesthesia monitoring. Anesthesiol J Am Soc Anesthesiol 69(1):106–108Google Scholar
- 6.Matinfar S, Nasseri MA, Eck U, Roodaki H, Navab N, Lohmann CP, Maier M, Navab N (2017) Surgical Soundtracks: towards automatic musical augmentation of surgical procedures. In: International conference on medical image computing and computer-assisted intervention. Springer, Cham, pp 673–681Google Scholar
- 7.Hermann T, Hunt A (2011) The sonification handbook. In: Neuhoff JG (ed) Logos Verlag, BerlinGoogle Scholar
- 10.Allen K, Blascovich J (1994) Effects of music on cardiovascular reactivity among surgeons (correction)Google Scholar
- 11.Wegner K (1998) Surgical navigation system and method using audio feedback. Georgia Institute of TechnologyGoogle Scholar
- 17.Eckel G, Iovino F, Causs R (1995) Sound synthesis by physical modelling with Modalys. In: Proceedings of the international symposium on musical acoustics, pp 479–482Google Scholar
- 18.Verfaille V, Guastavino C, Traube C (2006) An interdisciplinary approach to audio effect classification. In Proceedings of the 9th international conference on digital audio effectsGoogle Scholar