Abstract
We describe an approach to contour following unknown objects using a handeye robotic system. Relevant and sufficient feature points providing optical flow data are extracted from the edges of the target object. The desired motion of the end-effector is computed with the objective of keeping the visual features always at the same target location in the image plane. A cartesian PD controller is used to perform the desired motion by the robot's end-effector. To address thecontrol issues, we take advantage of the unifying robot control theory stated in the literature as thetask-function approach [21]. To validate our approach, we restricted our experiments to motionless objects positioned in a plane parallel to the image plane: three degrees of freedom (two of translation, one of rotation) are thus controlled.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Anderson, B. D. and Moore, J. B.:Optimal Control-Linear Quadratic Methods, Prentice-Hall, 1990.
Boussinot, F. and de Simone, R.: The ESTEREL language,Proc. IEEE Special Issue,79(9) (Sep. 1991).
Canny, J. F.: A computational approach to edge detection,IEEE/PAMI,8(6) (Nov. 1986), 679–698
Coste-Manière, E., Espiau, B., and Rutten, E.: Task-level programming combining object-oriented design and synchronous approach, inIEEE Internat. Conf. on Robotics and Automation, Nice, May 1992, pp. 2751–2756.
Coste-Manière, E., Espiau, B. and Simon, D.: Reactive objects in a task-level open controller, inIEEE Internat. Conf. on Robotics and Automation, Nice, May 1992, pp. 2732–2737.
Coste-Manière, E. and Gatenholm, M.: A contribution of visual servoing techniques to robotics deburring, inSPIE: Intelligent Robots and Computer Vision XII: Algorithms and Techniques, Boston, September 7–10, 1993, pp. 344–355.
Couvignou, P. and Khosla, P. K.: Singularities in the recovery of rigid body motions from aptical flow data, Technical Report to appear, Carnegie Mellon University, The Robotics Institut, 1993.
Couvignou, P., Papanikolopoulos, N., and Khosla, P. K.: Hand-eye robotic visual servoing around moving objects using active deformable models, inIEEE/RSJ Internat. Conf. on Intelligent Robots and Systems (IROS'92), Vol. 3, Raleigh, July 1992.
Deriche, R.: Using canny's criteria to derive a recursively implemented optimal edge detector,Int. J. Computer Vision (1987), 167–187.
Deriche, R. and Giraudon, G.: Accurate corner detection: an analytical study, Technical Report 1420, INRIA Research Report, April 1991.
Espiau, B., Chaumette, F., and Rives, P.: A new approach to visual servoing in robotics,IEEE Trans. on Robotics and Automation 8 (1992), 313–326.
Espiau, B., Merlet, J. P., and Samson, C.: Force-feedback control and non-contact sensing: a unified approach, inRomansy-90, Krakow, Poland, July 1990.
Espiau, B. and Rives, P.: Closed-loop recursive estimation of 3d features for a mobile vision system, inIEEE Internat. Conf. on Robotics and Automation, Raleigh, April 1987, pp. 1436–1443.
Feddema, J. T. and Lee, C. S. G.: Adaptive image feature prediction and control for visual tracking with a hand-eye coordinated camera,IEEE Trans. on Robotics and Automation 20(5) (1990), 1172–1183.
Feddema, J. T., Lee, C. S. G., and Mitchell, O. R.: Automatic selection of image features for visual servoing of a robot manipulator, inIEEE Internat. Conf. on Robotics and Automation, Scottsdale, May 1989, pp. 832–837.
Jang, W. and Bien, Z.: Feature-based visual servoing of an eye-in-hand robot with improved tracking and performance, in:IEEE Internat. Conf. on Robotics and Automation, Sacramento, April 1991, pp. 2254–2260.
Khosla, P. K. and Kanade, T.: Experimental evaluation of non-linear feedback and feedforward control schemes for manipulators,Int. J. Robotics Res. 7(1) (Feb. 1988).
Khosla, P. K. and Kanade, T.: Real-time implementation and evaluation of the computed torque scheme,IEEE Trans. Robotics Automation 5(2) (April 1989), 245–253.
Sanderson, A. C. and Neuman, C. P.: Dynamic sensor-based control of robots with visual feedback,IEEE J. Robotics Automation 3(5) (1987), 404–417.
Papanikolopoulos, N., Khosla, P. K. and Kanade, T.: Vision and control techniques for robotic visual tracking, inIEEE Internat. Conf. on Robotics and Automation, April 1991, pp. 857–864.
Samson, C., Le Borgne, M. and Espiau, B.:Robot Control: the Task-Function Approach, Clarendon Press, Oxford 1991.
Samson, C. and Espiau, B.: Application of the task-function approach to sensor-based control of robot manipulators, inIFAC, Tallinn, USSR, August 1990.
Simon, D. and Joubert, A.: Orccad: Towards an open robot controller computer aided design system, Technical Report 1396, INRIA Research Report, February 1991.
Stewart, D. B., Schmitz, D. E., and Khosla, P. K.: Implementing real-time robotic systems using chimera-II, inProc. IEEE Internat. Conf. on Robotics and Automation, September 1990, pp. 598–603.
Weiss, L. E.: Dynamic visual servo control of robots. An adaptative image based approach, Technical Report CMU-RI-TR-84-16, The Robotics Institute, Carnegie-Mellon University, 1984.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Coste-Manière, E., Couvignou, P. & Khosla, P.K. Visual servoing in the task-function framework: A contour following task. J Intell Robot Syst 12, 1–21 (1995). https://doi.org/10.1007/BF01258305
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF01258305