Abstract
The introduction of surgical robots in minimally invasive surgery has allowed enhanced manual dexterity through the use of microprocessor controlled mechanical wrists. They permit the use of motion scaling for reducing gross hand movements and the performance of micro-scale tasks that are otherwise not possible. The high degree of freedom offered by robotic surgery, however, can introduce the problems of complex instrument control and hand-eye coordination. The purpose of this project is to investigate the use of real-time binocular eye tracking for empowering the robots with human vision using knowledge acquired in situ, thus simplifying, as well as enhancing, robotic control in surgery. By utilizing the close relationship between the horizontal disparity and the depth perception, varying with the viewing distance, we demonstrate how vergence can be effectively used for recovering 3D depth at the fixation points and further be used for adaptive motion stabilization during surgery. A dedicated stereo viewer and eye tracking system has been developed and experimental results involving normal subjects viewing real as well as synthetic scene are presented. Detailed quantitative analysis demonstrates the strength and potential value of the method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Mon-Williams, M., Tresilian, J.R., Roberts, A.: Vergence provides veridical depth perception from horizontal retinal image disparities. Exp Brain Res 133, 407–413 (2000)
Yang, G.-Z., Dempere-Marco, L., Hu, X.-P., Rowe, A.: Visual search: psychophysical models and practical applications. Image and Vision Computing 20, 291–305 (2002)
Bookstein, F.L.: Principal Warps: Thin Plate Splines and The Decomposition of Deformations. IEEE Trans Pattern Anal. Mach. Intell 11 (June 1989)
Dorf, R.C., Bishop, R.H.: Modern Control Systems, 9th edn. Prentice Hall, Englewood Cliffs (2001)
Howard, I.P., Allison, R.S., Zacher, J.: The dynamics of vertical vergence. Exp Brain Res. 116(1), 153–159 (1997)
Kawata, H., Ohtsuka, K.: Dynamic asymmetries in convergence eye movements under natural viewing conditions. Jpn J Ophthalmol. 45(5), 437–444 (2001)
Stork, S., Neggers, S.F.W., Müsseler, J.: Intentionally-evoked modulations of smooth pursuit eye movements. Human Movement Science 21, 335–348 (2002)
Rottach, K.G., Zivotofsky, A.Z., Das, V.E., Averbuch-Heller, L., Discenna, A.O., Poonyathalang, A., Leigh, R.: Comparison of horizontal, vertical and diagonal smooth pursuit eye movements in normal human subjects. Vision Res. 36(14), 2189–2195 (1996)
van Leeuwen, A.F., Collewijn, H., Erkelens, C.: Dymanics of horizontal vergence movements: interaction with horizontal and vertical saccades. Vision Res. 38(24), 3943-3954 (1998)
Takeda, T., Hashimoto, K., Hiruma, N., Fukui, Y.: Characteristics of accommodation toward apparent depth. Vision Res. 1999, 2087–2097 (2087)
Wann, J.P., Rushton, S., Mon-Williams, M.: Natural problems for stereoscopic depth perception in virtual environments. Vision Res. 35(19), 2731–2736 (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mylonas, G.P., Darzi, A., Yang, GZ. (2004). Gaze Contingent Depth Recovery and Motion Stabilisation for Minimally Invasive Robotic Surgery. In: Yang, GZ., Jiang, TZ. (eds) Medical Imaging and Augmented Reality. MIAR 2004. Lecture Notes in Computer Science, vol 3150. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-28626-4_38
Download citation
DOI: https://doi.org/10.1007/978-3-540-28626-4_38
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22877-6
Online ISBN: 978-3-540-28626-4
eBook Packages: Springer Book Archive