The Role of Insertion Points in the Detection and Positioning of Instruments in Laparoscopy for Robotic Tasks

  • Christophe Doignon
  • Florent Nageotte
  • Michel de Mathelin
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4190)


In robot-assisted laparoscopic surgery, an endoscopic camera is used to control the motion of surgical instruments. With this minimally invasive surgical (MIS) technique, every instrument has to pass through an insertion point in the abdominal wall and is mounted on the end-effector of a surgical robot which can be controlled by visual feedback. To achieve an accurate vision-based positioning of laparoscopic instruments, we introduce the motion constraint in MIS which is based on the location of out-of-field of view insertion points. The knowledge of the (image of the) insertion point location is helpful for real-time image segmentation issues, particularly to initiate the search for region seeds corresponding to the instruments. Moreover, with this ”eye-to-hand” robot vision system, visual servoing is a very convenient technique to automatically guide an instrument but it requires the velocity screw to be expressed in the appropriate frame. Then, the location of the insertion point is seen as the main part of the larger problem of determining the overall transformation between the camera and the robot end-effector frame. This is achieved thanks to a novel algorithm for the pose determination of cylindrical-shaped instruments. With the proposed method, the location of insertion points can be recovered, on-line, with no marker, without any knowledge of robot kinematics and without an external measurement device.


Surgical Instrument Insertion Point Visual Servoing Camera Frame Surgical Robot 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Funda, J., Taylor, R., Eldridge, B., Gomory, S., Gruben, K.: Constrained cartesian motion control for teleoperated surgical robots. IEEE Trans. on Robotics and Automation 12 (1996)Google Scholar
  2. 2.
    Hutchinson, S., Hager, G.D., Corke, P.: A tutorial on visual servo control. IEEE Trans. on Robotics and Automation 12, 651–670 (1996)CrossRefGoogle Scholar
  3. 3.
    Espiau, B., Chaumette, F., Rives, P.: A new approach to visual servoing in robotics. IEEE Transactions on Robotics and Automation 8, 313–326 (1992)CrossRefGoogle Scholar
  4. 4.
    Wei, G.Q., Arbter, K., Hirzinger, G.: Real-time visual servoing for laparoscopic surgery. IEEE Engineering in Medicine and Biology 16, 40–45 (1997)CrossRefGoogle Scholar
  5. 5.
    Wang, Y.F., Uecker, D.R., Wang, Y.: A new framework for vision-enabled and robotically assisted minimally invasive surgery. Journal of Computerized Medical Imaging and Graphics 22, 429–437 (1998)CrossRefGoogle Scholar
  6. 6.
    Hayashibe, M., Nakamura, Y.: Laser-pointing endoscope system for intra-operative geometric registration. In: Proc. of ICRA 2001, Seoul, South Korea (2001)Google Scholar
  7. 7.
    Krupa, A., Gangloff, J., Doignon, C., de Mathelin, M., Morel, G., Leroy, J., Soler, L., Marescaux, J.: Autonomous 3-d positioning of surgical instruments in robotized laparoscopic surgery using visual servoing. IEEE Trans. on Robotics and Automation 10, 842–853 (2003)CrossRefGoogle Scholar
  8. 8.
    Burschka, D., Corso, J.J., Dewan, M., Hager, G.D., Lau, W., Li, M., Lin, H., Marayong, P., Ramey, N.: Navigating inner space: 3-D assistance for minimally invasive surgery. In: Workshop Advances in Robot Vision, IEEE/RSJ Int’l. Conf. on Intelligent Robots and Systems, Sendai, Japan, pp. 67–78 (2004)Google Scholar
  9. 9.
    Ortmaier, T., Hirzinger, G.: Cartesian control issues for minimally invasive robot surgery. In: Proceedings of IROS 2000, Takamatsu, Japan (2000)Google Scholar
  10. 10.
    Hartley, R., Zisserman, A.: Multiple view geometry in computer vision. Cambridge Univ. Press, Cambridge (2000)MATHGoogle Scholar
  11. 11.
    Doignon, C., Graebling, P., de Mathelin, M.: Real-time segmentation of surgical instruments inside the abdominal cavity using a joint hue saturation color feature. Real-Time Imaging 11, 429–442 (2005)CrossRefGoogle Scholar
  12. 12.
    Wong, K.Y., Mendonça, P.R.S., Cipolla, R.: Reconstruction of surfaces of revolution from single uncalibrated views. Image and Vis. Computing 22, 829–836 (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Christophe Doignon
    • 1
  • Florent Nageotte
    • 1
  • Michel de Mathelin
    • 1
  1. 1.Control, Vision and Robotic Team, LSIIT (UMR ULP-CNRS 7005)University of StrasbourgFrance

Personalised recommendations