Gaze Contingent Depth Recovery and Motion Stabilisation for Minimally Invasive Robotic Surgery

  • George P. Mylonas
  • Ara Darzi
  • Guang-Zhong Yang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3150)


The introduction of surgical robots in minimally invasive surgery has allowed enhanced manual dexterity through the use of microprocessor controlled mechanical wrists. They permit the use of motion scaling for reducing gross hand movements and the performance of micro-scale tasks that are otherwise not possible. The high degree of freedom offered by robotic surgery, however, can introduce the problems of complex instrument control and hand-eye coordination. The purpose of this project is to investigate the use of real-time binocular eye tracking for empowering the robots with human vision using knowledge acquired in situ, thus simplifying, as well as enhancing, robotic control in surgery. By utilizing the close relationship between the horizontal disparity and the depth perception, varying with the viewing distance, we demonstrate how vergence can be effectively used for recovering 3D depth at the fixation points and further be used for adaptive motion stabilization during surgery. A dedicated stereo viewer and eye tracking system has been developed and experimental results involving normal subjects viewing real as well as synthetic scene are presented. Detailed quantitative analysis demonstrates the strength and potential value of the method.


binocular eyetracking minimally invasive robotic surgery gaze contingent control eye-hand coordination 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Mon-Williams, M., Tresilian, J.R., Roberts, A.: Vergence provides veridical depth perception from horizontal retinal image disparities. Exp Brain Res 133, 407–413 (2000)CrossRefGoogle Scholar
  2. 2.
    Yang, G.-Z., Dempere-Marco, L., Hu, X.-P., Rowe, A.: Visual search: psychophysical models and practical applications. Image and Vision Computing 20, 291–305 (2002)CrossRefGoogle Scholar
  3. 3.
    Bookstein, F.L.: Principal Warps: Thin Plate Splines and The Decomposition of Deformations. IEEE Trans Pattern Anal. Mach. Intell 11 (June 1989)Google Scholar
  4. 4.
    Dorf, R.C., Bishop, R.H.: Modern Control Systems, 9th edn. Prentice Hall, Englewood Cliffs (2001)Google Scholar
  5. 5.
    Howard, I.P., Allison, R.S., Zacher, J.: The dynamics of vertical vergence. Exp Brain Res. 116(1), 153–159 (1997)CrossRefGoogle Scholar
  6. 6.
    Kawata, H., Ohtsuka, K.: Dynamic asymmetries in convergence eye movements under natural viewing conditions. Jpn J Ophthalmol. 45(5), 437–444 (2001)CrossRefGoogle Scholar
  7. 7.
    Stork, S., Neggers, S.F.W., Müsseler, J.: Intentionally-evoked modulations of smooth pursuit eye movements. Human Movement Science 21, 335–348 (2002)CrossRefGoogle Scholar
  8. 8.
    Rottach, K.G., Zivotofsky, A.Z., Das, V.E., Averbuch-Heller, L., Discenna, A.O., Poonyathalang, A., Leigh, R.: Comparison of horizontal, vertical and diagonal smooth pursuit eye movements in normal human subjects. Vision Res. 36(14), 2189–2195 (1996)CrossRefGoogle Scholar
  9. 9.
    van Leeuwen, A.F., Collewijn, H., Erkelens, C.: Dymanics of horizontal vergence movements: interaction with horizontal and vertical saccades. Vision Res. 38(24), 3943-3954 (1998)Google Scholar
  10. 10.
    Takeda, T., Hashimoto, K., Hiruma, N., Fukui, Y.: Characteristics of accommodation toward apparent depth. Vision Res. 1999, 2087–2097 (2087)Google Scholar
  11. 11.
    Wann, J.P., Rushton, S., Mon-Williams, M.: Natural problems for stereoscopic depth perception in virtual environments. Vision Res. 35(19), 2731–2736 (1995)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • George P. Mylonas
    • 1
  • Ara Darzi
    • 1
  • Guang-Zhong Yang
    • 1
  1. 1.Royal Society/Wolfson Medical Image Computing LaboratoryImperial College LondonLondonUnited Kingdom

Personalised recommendations