Tactile Augmented Reality for Arteries Palpation in Open Surgery Training

  • Sara Condino
  • Rosanna Maria Viglialoro
  • Simone Fani
  • Matteo Bianchi
  • Luca Morelli
  • Mauro Ferrari
  • Antonio Bicchi
  • Vincenzo Ferrari
Conference paper
First Online:
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9805)

Abstract

Palpation is an essential step of several open surgical procedures for locating arteries by arterial pulse detection. In this context, surgical simulation would ideally provide realistic haptic sensations to the operator. This paper presents a proof of concept implementation of tactile augmented reality for open-surgery training. The system is based on the integration of a wearable tactile device into an augmented physical simulator which allows the real time tracking of artery reproductions and the user finger and provides pulse feedback during palpation. Preliminary qualitative test showed a general consensus among surgeons regarding the realism of the arterial pulse feedback and the usefulness of tactile augmented reality in open-surgery simulators.

Keywords

Augmented Reality Haptic Feedback Haptic Device Arterial Pulse Haptic Interface 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.

Notes

Acknowledgements

Work supported by the SThARS project (funded by the Italian Ministry of Health and Regione Toscana through the call “Ricerca Finalizzata 2011–2012”); the European Research Council under the Advanced Grant Soft Hands “A Theory of Soft Synergies for a New Generation of Artificial Hands” (No. ERC-291166), the EU H2020 projects “SoftPro: Synergy-based Open-source Foundations and Technologies for Prosthetics and Rehabilitation” (No. 688857), and the EU FP7 project (No. 601165) “WEARable HAPtics for Humans and Robots (WEARHAP)”.

References

  1. 1.
    Poorten, V.E., Demeester, E., Lammertse, P.: Haptic feedback for medical applications, a survey. In: Proceedings of the Actuator, pp. 18–20 (2012)Google Scholar
  2. 2.
    Hu, J., Chang, C.Y., Tardella, N., Pratt, J., English, J.: Effectiveness of haptic feedback in open surgery simulation and training systems. Stud. Health Technol. 119, 213–218 (2006)Google Scholar
  3. 3.
    Ullrich, S., Kuhlen, T.: Haptic palpation for medical simulation in virtual environments. IEEE Trans. Vis. Comput. Graph. 18, 617–625 (2012)CrossRefGoogle Scholar
  4. 4.
    Coles, T., John, N.W., Gould, D.A., Caldwell, D.G.: Haptic palpation for the femoral pulse in virtual interventional radiology. In: Second International Conferences on Advances in Computer-Human Interactions, ACHI 2009, pp. 193–198 (2009)Google Scholar
  5. 5.
    Luboz, V., Zhang, Y., Johnson, S., Song, Y., Kilkenny, C., Hunt, C., Woolnough, H., Guediri, S., Zhai, J., Odetoyinbo, T., Littler, P., Fisher, A., Hughes, C., Chalmers, N., Kessel, D., Clough, P.J., Ward, J., Phillips, R., How, T., Bulpitt, A., John, N.W., Bello, F., Gould, D.: ImaGiNe Seldinger: first simulator for Seldinger technique and angiography training. Comput. Methods Programs Biomed. 111, 419–434 (2013)CrossRefGoogle Scholar
  6. 6.
    Coles, T.R., John, N.W., Gould, D.A., Caldwell, D.G.: Integrating haptics with augmented reality in a femoral palpation and needle insertion training simulation. IEEE Trans. Haptics 4, 199–209 (2011)CrossRefGoogle Scholar
  7. 7.
    Iwamoto, T., Tatezono, M., Shinoda, H.: Non-contact method for producing tactile sensation using airborne ultrasound. In: Ferre, M. (ed.) EuroHaptics 2008. LNCS, vol. 5024, pp. 504–513. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  8. 8.
    Hung, G.M., John, N.W., Hancock, C., Hoshi, T.: Using and validating airborne ultrasound as a tactile interface within medical training simulators. In: Bello, F., Cotin, S. (eds.) ISBMS 2014. LNCS, vol. 8789, pp. 30–39. Springer, Heidelberg (2014)Google Scholar
  9. 9.
    Ferrari, V., Viglialoro, R.M., Nicoli, P., Cutolo, F., Condino, S., Carbone, M., Siesto, M., Ferrari, M.: Augmented reality visualization of deformable tubular structures for surgical simulation. Int. J. Med. Robot. Comput. Assist. Surg. 12, 231–240 (2016)Google Scholar
  10. 10.
    Maria Viglialoro, R., Condino, S., Gesi, M., Ferrari, M., Ferrari, V.: Augmented reality simulator for laparoscopic cholecystectomy training. In: De Paolis, L.T., Mongelli, A. (eds.) AVR 2014. LNCS, vol. 8853, pp. 428–433. Springer, Heidelberg (2014)Google Scholar
  11. 11.
    Viglialoro, R., Condino, S., Gesi, M., Ferrari, M., Ferrari, V., Freschi, C., Cutolo, F.: AR visualization of “synthetic Calot’s triangle” for training in cholecystectomy. In: 12th IASTED International Conference on Biomedical Engineering, BioMed 2016 (2016)Google Scholar
  12. 12.
    Abdalla, S., Pierre, S., Ellis, H.: Calot’s triangle. Clin. Anat. 26, 493–501 (2013)CrossRefGoogle Scholar
  13. 13.
    Bianchi, M., Battaglia, E., Poggiani, M., Ciotti, S., Bicchi, A.: A wearable fabric-based display for haptic multi-cue delivery. In: 2016 IEEE Haptics Symposium (HAPTICS), pp. 277–283 (2016)Google Scholar
  14. 14.
    Bianchi, M., Scilingo, E.P., Serio, A., Bicchi, A.: A new softness display based on bi-elastic fabric. In: EuroHaptics Conference, 2009 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, World Haptics 2009, Third Joint, pp. 382–383 (2009)Google Scholar
  15. 15.
    Bianchi, M., Serio, A., Scilingo, E.P., Bicchi, A.: A new fabric-based softness display. In: 2010 IEEE Haptics Symposium, pp. 105–112 (2010)Google Scholar
  16. 16.
    Serio, A., Bianchi, M., Biechi, A.: A device for mimicking the contact force/contact area relationship of different materials with applications to softness rendering. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4484–4490 (2013)Google Scholar
  17. 17.
    Bianchi, M., Serio, A.: Design and characterization of a fabric-based softness display. IEEE Trans. Haptics 8, 152–163 (2015)CrossRefGoogle Scholar
  18. 18.
    Minamizawa, K., Fukamachi, S., Kajimoto, H., Kawakami, N., Tachi, S.: Gravity grabber: wearable haptic display to present virtual mass sensation. In: ACM SIGGRAPH 2007 Emerging Technologies, San Diego, California, p. 8. ACM (2007)Google Scholar
  19. 19.
    Ullrich, S., Mendoza, J., Ntouba, A., Rossaint, R., Kuhlen, T.: Haptic pulse simulation for virtual palpation. In: Tolxdorff, T., Braun, J., Deserno, T.M., Horsch, A., Handels, H., Meinzer, H.-P. (eds.) Bildverarbeitung für die Medizin 2008: Algorithmen — Systeme — Anwendungen Proceedings des Workshops vom 6. bis 8. April 2008 in Berlin, pp. 187–191. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  20. 20.
    O’Leary, E., Hubbard, K., Tormey, W., Cunningham, A.J.: Laparoscopic cholecystectomy: haemodynamic and neuroendocrine responses after pneumoperitoneum and changes in position. Br. J. Anaesth. 76, 640–644 (1996)CrossRefGoogle Scholar
  21. 21.
    Nafis, C., Jensen, V., Beauregard, L., Anderson, P.: Method for estimating dynamic EM tracking accuracy of surgical navigation tools - art. no. 61410K. In: Medical Imaging 2006: Visualization, Image-Guided Procedures, and Display, vol. 6141, pp. 152–167 (2006)Google Scholar
  22. 22.
    Bia, D., Aguirre, I., Zocalo, Y., Devera, L., Cabrera Fischer, E., Armentano, R.: Regional differences in viscosity, elasticity and wall buffering function in systemic arteries: pulse wave analysis of the arterial pressure-diameter relationship. Rev. Esp. Cardiol. 58, 167–174 (2005)CrossRefGoogle Scholar
  23. 23.
    Benetos, A., Laurent, S., Hoeks, A.P., Boutouyrie, P.H., Safar, M.E.: Arterial alterations with aging and high blood pressure. A noninvasive study of carotid and femoral arteries. Arterioscler. Thromb. J. Vasc. Biol./Am. Heart Assoc. 13, 90–97 (1993)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Sara Condino
    • 1
  • Rosanna Maria Viglialoro
    • 1
  • Simone Fani
    • 2
  • Matteo Bianchi
    • 2
    • 3
  • Luca Morelli
    • 1
  • Mauro Ferrari
    • 1
    • 5
  • Antonio Bicchi
    • 2
    • 3
  • Vincenzo Ferrari
    • 1
    • 4
    • 5
  1. 1.EndoCAS Center, Department of Translational Research and New Technologies in Medicine and SurgeryUniversity of PisaPisaItaly
  2. 2.Research Center “E.Piaggio” Faculty of EngineeringUniversity of PisaPisaItaly
  3. 3.Department of Advanced RoboticsIstituto Italiano di TecnologiaGenoaItaly
  4. 4.Department of Engineering InformationUniversity of PisaPisaItaly
  5. 5.Vascular Surgery UnitCisanello University Hospital AOUPPisaItaly

Personalised recommendations