Abstract
In this research, three vision-based control schemes are proposed to control a 4-DOF manipulator that uses parallelogram mechanisms to keep the end-effector always parallel to the horizontal. The image features including area, orientation, and centroid are used as input to control four velocities components of the robot in the first scheme. The other two schemes are affine transformation-based and homography-based controllers, respectively. In the homography-based controller, the homography matrix is directly used to design the controller without performing decomposition as shown in the previously developed schemes. The camera intrinsic and extrinsic parameters do not need to be calculated in all three suggested methods while performing. The effectiveness and simplicity of the proposed schemes are proved through a series of simulations.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Chaumette, F.: Potential Problems of Stability and Convergence in Image-based and Position-based Visual Servoing, vol. 237, pp. 66–78. Springer, Berlin (1998)
Chaumette, F., Hutchinson, S., Corke, P.: Visual servoing. In: Siciliano, B., Khatib, O. (eds.) Handbook of Robotics, 2nd edition, pp. 841–866. Springer (2016). https://hal.inria.fr/hal-01355384
Chen, J., Dixon, W., Dawson, M., McIntyre, M.: Homography-based visual servo tracking control of a wheeled mobile robot. IEEE Trans. Robot. 22(2), 406–415 (2006). https://doi.org/10.1109/TRO.2006.862476
Cong, V.D.: Industrial robot arm controller based on programmable system-on-chip device. FME Trans. 49(4), 1025–1034 (2021)
Cong, V.D., Hanh, L.D.: Evaluate control laws related to interaction matrix for image-based visual servoing. In: 2019 6th NAFOSTED Conference on Information and Computer Science (NICS), pp. 454–459 (2019). https://doi.org/10.1109/NICS48868.2019.9023863
Cong, V.D., Hanh, L.D.: A new decoupled control law for image-based visual servoing control of robot manipulators. Int. J. Intell. Roboti. Appl. 6, 576–585 (2022). https://doi.org/10.1007/s41315-022-00223-5
Cong, V.D., Hanh, L.D., Phuong, L.H., Duy, D.A.: Design and development of robot arm system for classification and sorting using machine vision. FME Trans. 50(1), 181–192 (2022)
Corke, P., Hutchinson, S.: A new partitioned approach to image-based visual servo control. IEEE Trans. Robot. Autom. 17(4), 507–515 (2001). https://doi.org/10.1109/70.954764
Faugeras, O., Lustman, F.: Motion and structure from motion in a piecewise planar environment. J. Pattern Recognit. Artif. Intell. IJPRAI, Int (1988). https://doi.org/10.1142/S0218001488000285
Ghasemi, A., Xie, W.F.: Decoupled image-based visual servoing for robotic manufacturing systems using gain scheduled switch control. In: 2017 International Conference on Advanced Mechatronic Systems (ICAMechS), pp. 94–99 (2017). https://doi.org/10.1109/ICAMechS.2017.8316557
Ghasemi, A., Li, P., Xie, W.: Adaptive switch image-based visual servoing for industrial robots. Int. J. Control Autom. Syst. 18, 1324–1334 (2020). https://doi.org/10.1007/s12555-018-0753-y
Hashimoto, K.: Visual servoing: real-time control of robot manipulators based on visual sensory feedback. In: World Scientific, Singapore (1993)
Hutchinson, S., Hager, G., Corke, P.: A tutorial on visual servo control. IEEE Trans. Robot. Autom. 12(5), 651–670 (1996). https://doi.org/10.1109/70.538972
Kyrki, V., Kragic, D., Christensen, H.: New shortest-path approaches to visual servoing. In: 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), vol 1, pp. 349–354 (2004). https://doi.org/10.1109/IROS.2004.1389376
Malis, E., Chaumette, F.: 2 1/2 d visual servoing with respect to unknown objects through a new estimation scheme of camera displacement. Int. J. Comput. Vis. 37, 79–97 (2000). https://doi.org/10.1023/A:1008181530296
Ren, X., Li, H., Li, Y.: Image-based visual servoing control of robot manipulators using hybrid algorithm with feature constraints. IEEE Access 8, 223495–223508 (2020). https://doi.org/10.1109/ACCESS.2020.3042207
Shirai, Y., Inoue, H.: Guiding a robot by visual feedback in assembling tasks. Pattern Recognit. 5, 99–106 (1973)
Sun, X., Zhu, X., Wang, P., Chen, H.: A review of robot control with visual servoing. In: 2018 IEEE 8th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER), pp. 116–121 (2018). https://doi.org/10.1109/CYBER.2018.8688060
Yan, F., Li, B., Shi, W., Wang, D.: Hybrid visual servo trajectory tracking of wheeled mobile robots. IEEE Access 6, 24291–24298 (2018). https://doi.org/10.1109/ACCESS.2018.2829839
Zhang, Z., Hanson, A.: Scaled euclidean 3d reconstruction based on externally uncalibrated cameras. In: Proceedings of International Symposium on Computer Vision-ISCV, pp. 37–42 (1995). https://doi.org/10.1109/ISCV.1995.476974
Zhong, X., Zhong, X., Hu, H., Peng, X.: Adaptive neuro-filtering based visual servo control of a robotic manipulator. IEEE Access 7, 76891–76901 (2019). https://doi.org/10.1109/ACCESS.2019.2920941
Acknowledgements
We acknowledge the support of time and facilities from Ho Chi Minh City University of Technology (HCMUT), VNU-HCM for this study
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Cong, V.D., Hanh, L.D. Visual servoing control schemes of 4 DOF robot manipulators. Int J Intell Robot Appl 6, 804–813 (2022). https://doi.org/10.1007/s41315-022-00259-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41315-022-00259-7