Predictive control for visual servoing control of cyber physical systems with packet loss

  • Jinhui Wu
  • Xu Chen
  • Andong LiuEmail author
  • Li Yu
Part of the following topical collections:
  1. Special Issue on Networked Cyber-Physical Systems


Networked robotic visual servoing system is a representative cyber-physical system (CPS). This paper studies the robust predictive control problem of networked robotic visual servoing system with packet losses and uncertainty. Firstly, according to eye-to-hand framework, the system is modeled as a nonlinear discrete model with packet loss based on image-based visual servoing (IBVS) approach, where the packet losses obey a Bernoulli distribution. Since the discretization error of the system is a norm-bounded parameter, a nonlinear system with bounded uncertainty is derived. With regard to the principle of the MPC and the stochastic system method, the upper bound of the MPC performance index and the min-max optimization problem with uncertainty are presented. Based on robust least-square approach, the parameter-dependent predictive controller is obtained and an iterative algorithm is presented to solve the horizon optimization problem. Finally, numerical simulations and experiments are proposed to verify the effectiveness of the proposed algorithm.


Cyber-physical system Robust predictive control Networked robotic visual servo Min-max optimization 



This work was supported in part by the Zhejiang Provincial Natural Science Foundation of China under Grant LY17F030019, in part by the NSFC-Zhejiang Joint Foundation for the Integration of Industrialization and Informatization under Grant U1709213, and in part by the Talent Project of Zhejiang Association for Science and Technology under Grant 2018YCGC018.


  1. 1.
    Zhang H, Shu Y, Cheng P et al (2016) Privacy and performance trade-off in cyber-physical systems. IEEE Netw 30(2):62–66CrossRefGoogle Scholar
  2. 2.
    Zhang H, Zheng WX (2018) Denial-of-service power dispatch against linear quadratic control via a Fading Channel. IEEE Trans Autom Control 63(9):3032–3039MathSciNetCrossRefzbMATHGoogle Scholar
  3. 3.
    Zhang H, Meng W C, Qi J J et al (2019) Distributed load sharing under false data injection attack in inverter-based microgrid. IEEE Trans Ind Electron 66(2):1543–1551CrossRefGoogle Scholar
  4. 4.
    Zhu Y, Zhong Z, Basin M V et al (2018) A descriptor system approach to stability and stabilization of discrete-time switched PWA systems. IEEE Trans Autom Control 63(10):3456–3463MathSciNetCrossRefzbMATHGoogle Scholar
  5. 5.
    Zhu Y, Zhang L, Zheng WX (2016) Distributed H-infinity filtering for a class of discrete-time Markov Jump Lur’e systems with redundant channels. IEEE Trans Ind Electron 63(3):1876–1885CrossRefGoogle Scholar
  6. 6.
    Khan M U, Li S, Wang Q et al (2016) CPS oriented control design for networked surveillance robots with multiple physical constraints. IEEE Trans Comput Aided Des Integr Circuits Syst 35(5):778–791CrossRefGoogle Scholar
  7. 7.
    Khalid A, Kirisci P, Khan Z H et al (2018) Security framework for industrial collaborative robotic cyber-physical systems. Comput Ind 97(4):132–145CrossRefGoogle Scholar
  8. 8.
    Meng W, Yang Q, Si J et al (2017) Consensus control of nonlinear multiagent systems with time-varying state constraints. IEEE trans Cybern 47(8):2110–2120CrossRefGoogle Scholar
  9. 9.
    Lai C C, Su KL (2018) Development of an intelligent mobile robot localization system using Kinect RGB-D mapping and neural network. Comput Electr Eng 67:620–628CrossRefGoogle Scholar
  10. 10.
    Liu A, Zhang WA, Yu L et al Formation control of multiple mobile robots incorporating an extended state observer and distributed model predictive approach. IEEE Transactions on Systems, Man, and Cybernetics: Systems, to be published.
  11. 11.
    Liu A, Zhang W A, Chen M Z Q et al (2017) Moving horizon estimation for mobile robots with multirate sampling. IEEE Trans Ind Electron 64(2):1457–1467CrossRefGoogle Scholar
  12. 12.
    Piasco N, Sidibé D, Demonceaux C et al (2018) A survey on visual-based localization: On the benefit of heterogeneous data. Pattern Recogn 74:90–109CrossRefGoogle Scholar
  13. 13.
    Zhao Y, Gong L, Huang Y et al (2016) A review of key techniques of vision-based control for harvesting robot. Comput Electron Agric 127:311–323CrossRefGoogle Scholar
  14. 14.
    Gupta M, Kumar S, Behera L et al (2017) A novel vision-based tracking algorithm for a human-following mobile robot. IEEE Trans Syst Man Cybern Syst Hum 47(7):1415– 1427CrossRefGoogle Scholar
  15. 15.
    Liao J, Chen Z, Yao B (2017) Performance-oriented coordinated adaptive robust control for four-wheel independently driven skid steer mobile robot. IEEE Access 5:19048–19057CrossRefGoogle Scholar
  16. 16.
    Park B S, Yoo S J, Park J B et al (2009) Adaptive neural sliding mode control of nonholonomic wheeled mobile robots with model uncertainty. IEEE Trans Control Syst Technol 17(1):207– 214CrossRefGoogle Scholar
  17. 17.
    Li Z, Yang C, Su C Y et al (2016) Vision-based model predictive control for steering of a nonholonomic mobile robot. IEEE Trans Control Syst Technol 24(2):553–564Google Scholar
  18. 18.
    Zhang L, Xie W, Wang J (2017) Robust distributed model predictive control of linear systems with structured time-varying uncertainties. Int J Control 90(11):2449–2460MathSciNetCrossRefzbMATHGoogle Scholar
  19. 19.
    Zhang L, Xie W, Liu J (2018) Robust control of saturating systems with Markovian packet dropouts under distributed MPC. ISA transactionsGoogle Scholar
  20. 20.
    Bardaro G, Bascetta L, Ceravolo E et al (2018) MPC-based control architecture of an autonomous wheelchair for indoor environments. Control Eng Pract 78:160–174CrossRefGoogle Scholar
  21. 21.
    Allibert G, Courtial E, Chaumette F (2010) Predictive control for constrained image-based visual servoing. IEEE Trans Robot 26(5):933–939CrossRefGoogle Scholar
  22. 22.
    Hajiloo A, Keshmiri M, Xie W F et al (2016) Robust online model predictive control for a constrained image-based visual servoing. IEEE Trans Ind Electron 63(4):2242–2250Google Scholar
  23. 23.
    González R, Fiacchini M, Guzmán J L et al (2011) Robust tube-based predictive control for mobile robots in off-road conditions. Robot Auton Syst 59(10):711–726CrossRefGoogle Scholar
  24. 24.
    Mammarella M, Capello E, Park H et al (2018) Tube-based robust model predictive control for spacecraft proximity operations in the presence of persistent disturbance. Aerosp Sci Technol 77:585–594CrossRefGoogle Scholar
  25. 25.
    Honek M, Kvasnica M, Szcs A et al (2015) A low-complexity explicit MPC controller for AFR control. Control Eng Pract 42:118–127CrossRefGoogle Scholar
  26. 26.
    Goebel G, Allgöwer F (2015) A simple semi-explicit MPC algorithm. IFAC-PapersOnLine 48(23):489–494CrossRefGoogle Scholar
  27. 27.
    Wang T, Liu B (2016) Different polytopic decomposition for visual servoing system with LMI-based predictive control, 2016 35th Chinese control conference, China, pp 10320– 10324Google Scholar
  28. 28.
    Wang T T, Xie W F, Liu G D et al (2015) Quasi-min-max model predictive control for image-based visual servoing with tensor product model transformation. Asian J Control 17(2):402– 416MathSciNetCrossRefzbMATHGoogle Scholar
  29. 29.
    Muis A, Ohnishi K (2005) Eye-to-hand approach on eye-in-hand configuration within real-time visual servoing. IEEE/ASME Trans Mechatron 10(4):404–410CrossRefGoogle Scholar
  30. 30.
    Chang WC (2018) Robotic assembly of smartphone back shells with eye-in-hand visual servoing. Robot Comput Integr Manuf 50:102–113CrossRefGoogle Scholar
  31. 31.
    Li X, Luo X, Wang J et al (2018) Bearing-based formation control of networked robotic systems with parametric uncertainties. Neurocomputing 306:234–245CrossRefGoogle Scholar
  32. 32.
    Zhang T Y, Liu GP (2018) Tracking control of wheeled mobile robots with communication delay and data loss. J Syst Sci Complex 31:927–925MathSciNetCrossRefzbMATHGoogle Scholar
  33. 33.
    Liu A, Zhang R, Zhang W A et al (2017) Nash-optimization distributed model predictive control for multi mobile robots formation. Peer-to-Peer Networking and Applications 10(3):688–696CrossRefGoogle Scholar
  34. 34.
    Chen M (2016) Disturbance attenuation tracking control for wheeled mobile robots with skidding and slipping. IEEE Trans Ind Electron 64(4):3359–3368CrossRefGoogle Scholar
  35. 35.
    Wang D, Chang BL (2008) Modeling and analysis of skidding and slipping in wheeled mobile robots control design perspective. IEEE Trans Robot 24(3):676–687CrossRefGoogle Scholar
  36. 36.
    Yang F, Wang CL (2011) Adaptive stabilization for uncertain nonholonomic dynamic mobile robots based on visual servoing feedback. Acta Automat Sin 37(7):857–864MathSciNetCrossRefzbMATHGoogle Scholar
  37. 37.
    Sayed A H, Nascimento V H, Cipparrone FAM (2002) A regularized robust design criterion for uncertain data. SIAM J Matrix Anal Appl 23(4):1120–1142MathSciNetCrossRefzbMATHGoogle Scholar
  38. 38.
    Kothare M V, Balakrishnan V, Morari M (1996) Robust constrained model predictive control using linear matrix inequalities. Automatica 32(10):1361–1379MathSciNetCrossRefzbMATHGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.College of Information EngineeringZhejiang University of Technology, Zhejiang Provincial United Key Laboratory of Embedded SystemHangzhouChina

Personalised recommendations