Selection of Observation Position and Orientation in Visual Servoing with Eye-in-vehicle Configuration for Manipulator
In this paper, we propose a method to select the observation position in visual servoing with an eye-in-vehicle configuration for the manipulator. In traditional visual servoing, the images taken by the camera may have various problems, including being out of view, large perspective aberrance, improper projection area of object in images and so on. In this paper, we propose a method to determine the observation position to solve these problems. A mobile robot system with pan-tilt camera is designed, which calculates the observation position based on an observation and then moves there. Both simulation and experimental results are provided to validate the effectiveness of the proposed method.
KeywordsEye-in-vehicle observation position mobile robot visual servoing pan-tilt camera platform
Unable to display preview. Download preview PDF.
This work was supported by Natural Science Foundation of China (No. 61773374) and Key Research and Development Program of China (No. 2017YFB1300104).
- A. Saxena, H. Pandya, G. Kumar, A. Gaud, K. M. Krishna. Exploring convolutional networks for end-to-end visual servoing. In Proceedings of IEEE International Conference on Robotics and Automation, Singapore, pp. 3817–3823, 2007.Google Scholar
- F. Nagata, K. Watanabe. Adaptive learning with large variability of teaching signals for neural networks and its application to motion control of an industrial robot. International Journal of Automation and Computing, vol. 8, no. 1, pp. 54–61, 2011. DOI: https://doi.org/10.1007/s11633-010-0554-0.CrossRefGoogle Scholar
- B. Thuilot, P. Martinet, L. Cordesses, J. Gallice. Position based visual servoing: Keeping the object in the field of vision. In Proceedings of IEEE International Conference on Robotics and Automation, Washington, USA, vol. 2, pp. 1624–1629, 2002.Google Scholar
- Z. Zhu, W. Zou, Q. B. Wang, F. Zhang. A velocity compensation visual servo method for oculomotor control of bionic eyes. International Journal of Robotics & Automation, vol. 33, no. 1, pp. 33–44, 2018. DOI: https://doi.org/10.2316/Journal.206.2018.1.206-4938.CrossRefGoogle Scholar
- N. V. Tinh, P. T. Cat, P. M. Tuan, T. T. Q. Bui. Visual control of integrated mobile robot-pan tilt-camera system for tracking a moving target. In Proceedings of IEEE International Conference on Robotics and Biomimetics, Bali, Indonesia, pp. 1566–1571, 2014.Google Scholar
- V. C. Le, T. C. Pham. Optimal tracking a moving target for integrated mobile robot-pan tilt-stereo camera. In Proceedings of IEEE International Conference on Advanced Intelligent Mechatronics, Banff, Canada, pp. 530–535, 2016.Google Scholar
- R. Sharma, S. Hutchinson. Optimizing hand/eye configuration for visual-servo systems. In Proceedings of IEEE International Conference on Robotics and Automation, IEEE, Nagoya, Japan, pp. 172–177, 1995.Google Scholar
- K. Tarabanis, R. Y. Tsai, P. K. Allen. Automated sensor planning for robotic vision tasks. In Proceedings of IEEE International Conference on Robotics and Automation, Sacramento, USA, vol. 1, pp. 76–82, 1991.Google Scholar
- J. Y. Zheng, Q. Chen, S. Tsuji. Active camera guided manipulation. In Proceedings of IEEE International Conference on Robotics and Automation, Sacramento, USA, vol. 1, pp. 632–638, 1991.Google Scholar