Abstract
The stabilization to a desired pose of a nonholonomic mobile robot, based on visual data from a hand-eye system mounted on it, is considered. Instances of this problem occur in practice during docking or parallel parking maneuvers of such vehicles. In this paper, we investigate the use of visual servoing techniques for their control. After briefly presenting the relevant visual servoing framework, we point out some problems encountered when it is considered for nonholonomic mobile robots. In particular, simple velocity control schemes using visual data as feedback cannot be applied anymore. We show how, by using the extra degrees of freedom provided by the hand-eye system, we can design controllers capable of accomplishing the desired task. A first approach, allows to perform a visual servoing task defined in the camera frame without explicitly controlling the pose of the nonholonomic mobile basis. A second approach based on continuous time-varying state feedback techniques allows to stabilize both the pose of the nonholonomic vehicle and that of the camera.
The experimental evaluation of the proposed techniques uses a mobile manipulator prototype developed in our laboratory and dedicated multiprocessor real-time image processing and control systems.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
R.W. Brockett, “Asymptotic Stability and Feedback Stabilization”, in Differential Geometric Control Theory, Eds. R.W. Brockett, R.S. Millman and H.J. Sussmann, Birkhauser, Boston, 1983.
J.P. Laumond and al., “Robot Motion Planning and Control”, Ed. J.P. Laumond, Lecture Notes in Control and Information Sciences, 229, Springer Verlag, 1997.
F. Chaumette, La relation vision-commande: théorie et applications à des tâches robotiques, Ph.D. Thesis, University of Rennes I, France, July 1990.
B. Espiau, F. Chaumette and P. Rives, “A New Approach to Visual Servoing in Robotics”, IEEE Trans. on Robotics and Automation 8, 313–326, 1992.
G.D. Hager and S. Hutchinson, Eds., “Vision-based Control of Robotic Manipulators”, Special section of IEEE Trans. Robotics and Automation 12, 649–774, 1996.
K. Hashimoto, Ed., Visual Servoing, World Scientific, 1993.
B.K.P. Horn, Robot Vision, Mc Graw-Hill, 1986.
P. Morin and C. Samson, “Application of Backstepping Techniques to the Time-Varying Exponential Stabilization of Chained Form Systems”, INRIA Research Report No. 2792, Sophia-Antipolis, 1996
R. Pissard-Gibollet and P. Rives, “Applying Visual Servoing Techniques to Control a Mobile Hand-Eye System”, IEEE Intl. Conf. on Robotics and Automation, 1995.
C. Samson, M. Le Borgne and B. Espiau, Robot Control: The Task Function Approach, Oxford University Press, 1991.
J.-B. Pomet and C. Samson, “Time-Varying Exponential Stabilization of Nonholonomic Systems in Power Form”, INRIA Research Report No. 2126, Sophia-Antipolis, 1993.
P. Rives, R. Pissard-Gibollet and L. Pelletier, “Sensor-based Tasks: From the Specification to the Control Aspects”, The 6th Intl. Symposium on Robotics and Manufacturing, Montpellier, France, May 28–30, 1996.
C. Samson, “Velocity and Torque Feedback Control of a Nonholonomic Cart”, in Advanced Robot Control, Ed. C. Canudas de Wit, Lecture Notes in Control and Information Sciences, No. 162, Springer-Verlag, 1990.
D.P. Tsakiris, C. Samson and P. Rives, “Vision-based Time-varying Mobile Robot Control”, Final European Robotics Network (ERNET) Workshop, Darmstadt, Germany, September 9–10, 1996. Published in Advances in Robotics: The ERNET Perspective, Eds. C. Bonivento, C. Melchiorri and H. Tolle, pp. 163–172, World Scientific Publishing Co., 1996.
D.P. Tsakiris, K. Kapellos, C. Samson, P. Rives and J.-J. Borrelly, “Experiments in Real-time Vision-based Point Stabilization of a Nonholonomic Mobile Manipulator”, Preprints of the Fifth International Symposium on Experimental Robotics (ISER'97), pp. 463–474, Barcelona, Spain, June 15–18, 1997.
D.P. Tsakiris, P. Rives and C. Samson, “Applying Visual Servoing Techniques to Control Nonholonomic Mobile Robots”, Workshop on “New Trends in Image-based Robot Servoing”, International Conference on Intelligent Robots and Systems (IROS'97), pp. 21–32, Grenoble, France, September 8–12, 1997.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag
About this paper
Cite this paper
Tsakiris, D.P., Rives, P., Samson, C. (1998). Extending visual servoing techniques to nonholonomic mobile robots. In: Kriegman, D.J., Hager, G.D., Morse, A.S. (eds) The confluence of vision and control. Lecture Notes in Control and Information Sciences, vol 237. Springer, London. https://doi.org/10.1007/BFb0109666
Download citation
DOI: https://doi.org/10.1007/BFb0109666
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-85233-025-5
Online ISBN: 978-1-84628-528-8
eBook Packages: Springer Book Archive