Skip to main content
SpringerLink
Log in

Iterative Learning Control of Stochastic Multi-Agent Systems with Variable Reference Trajectory and Topology

  • STOCHASTIC SYSTEMS
  • Published:
Automation and Remote Control Aims and scope Submit manuscript

Abstract

In modern smart manufacturing, robots are often connected via a network, and their task can change according to a predetermined program. Iterative learning control (ILC) is widely used for robots executing high-precision operations. Under network conditions, the efficiency of ILC algorithms may decrease if the program is restructured. In particular, the learning error may temporarily increase to an unacceptable value when changing the reference trajectory. This paper considers a networked system with the following features: the reference trajectory and parameters change between passes according to a known program, agents are subjected to random disturbances, and measurements are carried out with noise. In addition, the network topology changes due to the disconnection of some agents from the network and the connection of new agents to the network according to a given program. A distributed ILC design method is proposed based on vector Lyapunov functions for repetitive processes in combination with Kalman filtering. This method ensures the convergence of the learning error and reduces its increase caused by changes in the reference trajectory and network topology. The effectiveness of the proposed method is confirmed by an example.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1.
Fig. 2.

REFERENCES

  1. Saez, M.A., Maturana, F.P., Barton, K., and Tilbury, D.M., Context-Sensitive Modeling and Analysis of Cyber-Physical Manufacturing Systems for Anomaly Detection and Diagnosis, IEEE Transaction on Automation Science and Engineering, 2020, vol. 17, no. 1, pp. 29–40.

    Article  Google Scholar 

  2. Balta, E.C., Tilbury, D.M., and Barton, K., Switch-Based Iterative Learning Control for Tracking Iteration Varying References, IFAC PapersOnLine, 2020, vol. 20, no. 2, pp. 1493–1498.

    Article  Google Scholar 

  3. Tsypkin, Ya.Z., Adaptation and Learning in Automatic Systems, New York: Academic, 1971.

    MATH  Google Scholar 

  4. Arimoto, S., Kawamura, S., and Miyazaki, F., Bettering Operation of Robots by Learning, J. Robot. Syst., 1984, vol. 1, pp. 123–140.

    Article  Google Scholar 

  5. Bristow, D.A., Tharayil, M., and Alleyne, A.G., A Survey of Iterative Learning Control: A Learning-Based Method for High-Performance Tracking Control, IEEE Control Syst. Magaz., 2006, vol. 26, no. 3, pp. 96–114.

    Article  Google Scholar 

  6. Ahn, H-S., Chen, Y.Q., and Moore, K.L., Iterative Learning Control: Survey and Categorization, IEEE Trans. Syst. Man Cybern. Part C: Appl. Rev., 2007, vol. 37, no. 6, pp. 1099–1121.

    Article  Google Scholar 

  7. Pakshin, P., Emelianova, J., and Emelianov, M., Iterative Learning Control of Stochastic Linear Systems under Switching of the Reference Trajectory and Parameters, Proc. 29th Mediterranean Conference on Control and Automation (MED 2021), Bari, 2021, pp. 1311–1316.

  8. Pakshin, P., Emelianova, J., Rogers, E., and Galkowski, K., Iterative Learning Control of Stochastic Linear Systems with Reference Trajectory Switching, Proc. 60th IEEE Conference on Decision and Control (CDC), December 13–15, 2021, Austin, Texas, pp. 6565–6570.

  9. Ahn, H.S. and Chen, Y.Q., Iterative Learning Control for Multi-agent Formation, Proc. ICROS-SICE Int. Joint Conf., 2009, pp. 3111–3116.

  10. Liu, Q. and Bristow, D.A., An Iteration-Domain Filter for Controlling Transient Growth in Iterative Learning Control, Proc. 2010 Amer. Control Conf., 2010, pp. 2039–2044.

  11. Liu, Y. and Jia, Y., An Iterative Learning Approach to Formation Control of Multi-agent Systems, Syst. Control Lett., 2012, vol. 61, pp. 148–154.

    Article  MathSciNet  MATH  Google Scholar 

  12. Yang, S., Xu, J.X., Huang, D., and Tan, Y., Optimal Iterative Learning Control Design for Multi-agent Systems Consensus Tracking, Systems & Control Letters, 2014, vol. 69, pp. 80–89.

    Article  MathSciNet  MATH  Google Scholar 

  13. Li, Jin. and Li, Jun., Adaptive Iterative Learning Control for Coordination of Second-Order Multi-agent Systems, Int. J. Robust Nonlinear Control, 2014, vol. 24, pp. 3282–3299.

  14. Meng, D., Du, W., and Jia, Y., Data-Driven Consensus Control for Networked Agents: an Iterative Learning Control-Motivated Approach, IET Control Theory & Applications, 2015, vol. 9, pp. 2084–2096.

    Article  MathSciNet  Google Scholar 

  15. Yu, X., Hou, Z., and Polycarpou, M.M., Distributed Data-Driven Iterative Learning Consensus Tracking for Nonlinear Discrete-Time Multiagent Systems, IEEE Transactions on Automatic Control, 2022, vol. 67, no. 7, pp. 3670–3677.

    Article  MathSciNet  MATH  Google Scholar 

  16. Hock, A. and Schoellig, A., Distributed Iterative Learning Control for Multi-Agent Systems, Autonomous Robots, 2019, vol. 43, pp. 1989–2010.

    Article  Google Scholar 

  17. Pakshin, P.V., Emelianova, J.P., and Emelianov, M.A., Iterative Learning Control Design for Multiagent Systems Based on 2D Models, Autom. Remote Control, 2018, vol. 79, no. 6, pp. 1040–1056.

    Article  MathSciNet  MATH  Google Scholar 

  18. Pakshin, P.V., Koposov, A.S., and Emelianova, J.P., Iterative Learning Control of a Multiagent System under Random Perturbations, Autom. Remote Control, 2020, vol. 81, no. 3, pp. 483–502.

    Article  MathSciNet  MATH  Google Scholar 

  19. Ahn, H.S., Moore, K.L., and Chen, Y.Q., Iterative Learning Control. Robustness and Monotonic Convergence for Interval Systems, Lecture Notes in Control and Information Sciences, London: Springer-Verlag, 2007.

  20. Hock, A. and Schoellig, A., Distributed Iterative Learning Control for a Team of QuadRotors, Proceedings of the 55th IEEE Conference on Decision and Control, 2016, pp. 4640–4646.

  21. Sun, S., Endo, T., and Matsuno, F., Iterative Learning Control Based Robust Distributed Algorithm for Non-holonomic Mobile Robots Formation, IEEE Access, 2018, vol. 6, pp. 61904–61917.

    Article  Google Scholar 

  22. Koposov, A., Emelianova, J., and Pakshin, P., Iterative Learning Control of Multi-Agent Systems under Changing Network Configuration, IFAC PapersOnLine, 2021, vol. 54, no. 20, pp. 669–674.

    Article  Google Scholar 

  23. Koposov, A., Emelianova, J., and Pakshin, P., Iterative Learning Control of Multi-Agent Systems under Changing Reference Trajectoty, IFAC PapersOnLine, 2022, vol. 55, no. 12, pp. 759–764.

    Article  Google Scholar 

  24. Pakshin, P. and Emelianova, J., Iterative Learning Control Design for Discrete-Time Stochastic Switched Systems, Autom. Remote Control, 2020, vol. 81, no. 11, pp. 2011–2025.

    Article  MathSciNet  MATH  Google Scholar 

  25. Apkarian, J., Karam, P., and Levis, M., Workbook on Flexible Link Experiment for Matlab/Simulink Users, Quanser, 2011.

    Google Scholar 

Download references

Funding

This work was financially supported by the Russian Science Foundation, project no. 22-21-00612, https://rscf.ru/project/22-21-00612.

Author information

Authors and Affiliations

  1. Alekseev Arzamas Polytechnic Institute, Nizhny Novgorod State Technical University, Arzamas, Nizhny Novgorod oblast, Russia

    A. S. Koposov & P. V. Pakshin

Authors
  1. A. S. Koposov
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. P. V. Pakshin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to A. S. Koposov or P. V. Pakshin.

Additional information

This paper was recommended for publication by A.I. Kibzun, a member of the Editorial Board

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Koposov, A.S., Pakshin, P.V. Iterative Learning Control of Stochastic Multi-Agent Systems with Variable Reference Trajectory and Topology. Autom Remote Control 84, 612–625 (2023). https://doi.org/10.1134/S0005117923060073

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0005117923060073

Keywords:

Search

Navigation