Multi Aerial Robot Planning

Part of the Intelligent Systems, Control and Automation: Science and Engineering book series (ISCA, volume 71)


Multi-robot systems are a major research topic in robotics. Designing, testing and deploying in the real world a large number of aerial robots is a concrete possibility due to the recent technological advances. The first section of this chapter treats the different aspects of cooperation in a multi-agent systems. A cooperative control should be designed in terms of the available feedback information. A cascade-type guidance law is proposed, followed by consensus approach and flocking behavior. Since information flow over the network changes over time, cooperative control must react accordingly but ensure group cooperative behavior which is the major issue in analysis and synthesis. Connectivity and convergence of formations are also studied. Team approach is followed by deterministic decision making. Plans may be required for a team of aerial robots to plan for sensing, plan for action or plan for communication. Distributed receding horizon control as well as conflict resolution, artificial potentials and symbolic planning are thus analyzed. Then, association with limited communications is studied, followed by genetic algorithms and game theory reasoning. Next, multi-agent decision making under uncertainty is considered, formulating the Bayesian decentralized team decision problem, with and without explicit communication. Algorithms for optimal planning are then introduced as well as for task allocation and distributed chance constrained task allocation. Finally, some case studies are presented such as reconnaissance mission that can be defined as the road search problem or the general vehicle routing problem. Then, an approach is considered to coordinate a group of aerial robots without a central supervision, by using only local interactions between the robots. The third case is the optimization of perimeter patrol operation. If an aerial robot must be close from a location to monitor it correctly and the number of aerial robots does not allow covering each site simultaneously, a path planning problem arises. Finally stochastic strategies for surveillance are presented.


  1. 1.
    Ahuja RK, Magnanti TL, Orlin JB (1993) Network flows. Prentice-Hall, Englewood cliffsMATHGoogle Scholar
  2. 2.
    Alejo D, Diaz-Banez JM, Cobano JA, Perez-Lantero P, Ollero A (2013) The velocity assignment problem for conflict resolution with multiple UAV sharing airspace. J Intell Robot Syst 69(1–4): 331-346. doi: 10.1007/s10846-012-9768-4
  3. 3.
    Alighanbari M, Bertuccelli LF, How JP (2006) A robust approach to the UAV task assignment problem. In: IEEE conference on decision and control, San Diego, Ca, pp 5935–5940Google Scholar
  4. 4.
    Altshuler Y, Bruckstein AM (2011) Static and expanding grid coverage with ant robots: complexity results. Theorl Comput Sci 41:4661–4674Google Scholar
  5. 5.
    Aragues, R., Montijano, E., Sagues, C (2010) Consistency data association in multi-robot systems with limited communications. In: Matsuoka Y, Durrant-White H, Neira J (eds) Robotics science and systems. The MIT Press, Cambridge, pp 97–104Google Scholar
  6. 6.
    Asmare E, Gopalan A, Sloman M, Dulay N, Lupu E (2012) Self-management framework for mobile autonomous systems. J Network Syst Manag 20:244–275CrossRefGoogle Scholar
  7. 7.
    Ayanian N, Kallem V, Kumar V (2011) Synthesis of feedback controllers for multiple aerial robots with geometric constraints. In: IEEE/RSJ international conference on intelligent robots and systems, San Francisco, pp 3126–3131Google Scholar
  8. 8.
    Basilico N, Amigoni F (2011) Exploration strategies based on multi criteria decision making for searching environments in rescue operations. Auton Robots 31:401–417CrossRefGoogle Scholar
  9. 9.
    Belkhouche F, Vadhva S, Vaziri M (2011) Modeling and controlling 3D formations and flocking behavior of UAV. In: IEEE information reuse and integration conference, pp 449–454, 10.1109/IRI.2011.6009590Google Scholar
  10. 10.
    Bennet D, McInnes C, Suzuki M, Uchiyama K (2011) Autonomous Three-Dimensional Formation Flight for a swarm of unmanned aerial vehicles, AIAA J Guidance Control Dynamics 34:1899–1908 (2011)Google Scholar
  11. 11.
    Cao Y, Ren W (2010) Multi vehicle coordination for double integrator dynamics under fixed undirected/directed interaction with a sampled data setting. Int J Robust Nonlinear Control 20:987–1000MathSciNetGoogle Scholar
  12. 12.
    Cao Y, Yu W, Ren W, Chen G (2013) An overview of recent progress in the study of distributed multi-agent coordination. IEEE Trans Industr Inf 9:427–438CrossRefGoogle Scholar
  13. 13.
    Chavel I (ed) (1984) Eigenvalues in Riemannian geometry. Academic Press, New YorkGoogle Scholar
  14. 14.
    Dimarogonas D, Loizon SJ, Kyriakopoulos K, Zavlanos M (2006) A feedback stabilization and collision avoidance scheme for multiple independent non point agents. Automatica 42:229–243CrossRefMATHGoogle Scholar
  15. 15.
    Duan H, Zhang X, Wu J, Ma G (2009) Max-min adaptive ant colony optimization approach to multi UAV coordianates trajectory replanning in dynamic and uncertain environments. J Bionic Eng 6:161–173CrossRefGoogle Scholar
  16. 16.
    Edison E, Shima T (2011) Integrating task assignment and path optimization for cooperating UAV using genetic algorithms. Comput Oper Res 38:340–356CrossRefMATHMathSciNetGoogle Scholar
  17. 17.
    Faied M, Mostafa A, Girard A (2009) Dynamic optimal control of multiple depot routing problem with metric temporal logic. In: IEEE American control conference, pp 3268–3273Google Scholar
  18. 18.
    Franchi A, Stegagno P, Oriolo G (2013) Decentralized multi-robot target encirclement in 3D space, arXiv preprint arXiv:1307.7170, 2013 - arxiv.orgGoogle Scholar
  19. 19.
    Fraser C, Bertucelli L, Choi H, How J (2012) A hyperparameter consensus method for agreement under uncertainty. Automatica 48:374–380CrossRefMATHGoogle Scholar
  20. 20.
    Gandhi R, Yang LG (2007) Examination of planning under uncertainty algorithms for cooperative UAV, AIAA Infotech@Aerospace, paper AIAA-2007-2817Google Scholar
  21. 21.
    Gattani A, Benhardsson B, Rantzer A (2012) Robust team decision theory. IEEE Trans Autom Control 57:794–798CrossRefGoogle Scholar
  22. 22.
    Gazi V, Fidan B (2007) Coordination and control of multi-agent dynamic systems: modes and apporaches in Swarm Robotics. In: Sahin E (ed) LNCS, vol 4433. Springer, HeidelbregGoogle Scholar
  23. 23.
    Geramifard A, Redding J, Joseph J, Roy N, How J (2012) Model estimation within planning and learning. In: American control conference, Montreal, pp 793–799Google Scholar
  24. 24.
    Giardinu G, Kalman-Nagy T (2007) Genetic algorithms for multi agent space exploration. AIAA Infotech@Aerospace conference, paper AIAA2007-2824Google Scholar
  25. 25.
    Goel A, Gruhn V (2008) A general vehicle routing problem. Eur J Oper Res 191:650–660CrossRefMATHMathSciNetGoogle Scholar
  26. 26.
    Hantos P (2011) Systems engineering perspectives on technology, readiness assessment in software intensive system development. AIAA J aircraft 48:738–748Google Scholar
  27. 27.
    Holzapfel F, Theil S (eds) (2011) Advances in aerospace guidance, navigation and control. Springer, BerlinGoogle Scholar
  28. 28.
    Inigo-Blasco P, Diaz-del-Rio F, Romero M, Cargigas D, Vicente S (2012) Robotics software frameworks for multiagent robotic systems developement. Robotics Auton Syst 60:803–821CrossRefGoogle Scholar
  29. 29.
    Jorgensen, U, Skjetne, R (2012) Generating safe and equally long trajectories for multiple unmanned agents. In: IEEE mediterranean conference on control and automation, pp 1566–1572Google Scholar
  30. 30.
    Kamgarpour M, Dadok V, Tomlin c (2010) Trajectory generation for aircraft subject to dynamic weather uncertainty. In: 49th IEEE conference on decision and control, Atlanta, pp 2063–2068Google Scholar
  31. 31.
    Karahan I, Koksalan M (2010) A territory defining multiobjective evolutionary algorithms and preference incorporation. IEEE Trans Evol Comput 14:636–664CrossRefGoogle Scholar
  32. 32.
    Karaman S, Frazzoli E (2008) Complex mission optimization for multiple UAV using linear temporal logic. In: American control conference seattle, Wa, pp 2003–2009Google Scholar
  33. 33.
    Karaman S, Frazzoli E (2011) Linear Temporal logic vehicle routing with applications to multi-UAV mission planning, Int J Robust Nonlinear Control 21:1372–1395Google Scholar
  34. 34.
    Karimoddini A, Liu H, Chen B, Lee T (2011) Hybrid 3D formation control for unmanned helicopter. Technical report, NUS-ACT-11-005Google Scholar
  35. 35.
    Kloetzer M, Belta C (2007) Temporal logic planning and control of robotic swarms by hierarchical abstraction. IEEE Trans Robotics 23:320–330CrossRefGoogle Scholar
  36. 36.
    Kon Kang B, Kim KE (2012) Exploiting symmetries for single and multi-agent partially observable stochastic domains. Artif Intell 182:32–57Google Scholar
  37. 37.
    Krebsbach K (2009) Deliberative scheduling using GSMDP in stochastic asynchronous domains. Int J Approximate Reasoning 50:1347–1359CrossRefMATHMathSciNetGoogle Scholar
  38. 38.
    Kulkarani A, Tai K (2010) Probability collectives: a multi-agent approach for solving combinatorial optimization problems. Appl Soft Comput 37:759–771CrossRefGoogle Scholar
  39. 39.
    Lemaitre C, Reyes CA, Gonzalez JA (2004) Advances in artificial intelligence. Springer, BerlinGoogle Scholar
  40. 40.
    Liu L, Shell DA (2010) Assessing optimal assignment under uncertainty. In: Matsuoka Y, Durrant-White H, Neira J (eds) Robotics science and systems. The MIT Press, Cambrisdge, pp 121–128Google Scholar
  41. 41.
    Liu J, Wu J (2001) Multi-agent robotic system, CRC Press, FloridaGoogle Scholar
  42. 42.
    Low CB (2012) A rapid incremental motion planner for flexible formation control of fixed wing UAV. In: IEEE conference on decision and control, pp 2427–2432Google Scholar
  43. 43.
    Lyons D, Calliess JP, Hanebeck U (2011) Chance constrained model predictive control for multi-agent systems. arXiv preprint arXiv:1104.5384Google Scholar
  44. 44.
    Margellos K, Lygeros J (2011) Hamilton-Jacobi formulation for reach-avoid differential games. IEEE Trans Autom Control 56:1849–1861CrossRefMathSciNetGoogle Scholar
  45. 45.
    Marier JS, Besse C, Chaib-Draa B (2009) A Markov model for multiagent patrolling in continous time. ICONIP, vol 2, Springer, pp 648–656Google Scholar
  46. 46.
    Martin P, de la Croix, JP, Egerstedt M (2008) A motion description language for networked systems, In: 47th IEEE conference on decision and control, Mexico, pp 558–563Google Scholar
  47. 47.
    Martin P, Egerstedt M (2008) Optimal Timing control of interconnected, switched systems with applications to robotic marionettes. In: 9th international workshop on discrete event systems, Goteborg, Sweden, pp 156–161Google Scholar
  48. 48.
    Marvel J (2013) Performance metrics of speed and separation monitoring in shared workspaces. IEEE Trans Autom Sci Eng 10:405–414Google Scholar
  49. 49.
    Mesbahi M (2004) On state-dependent dynamic Graphs and their controllability properties. In: IEEE conference on decision and control, Bahamas, pp 2473–2478Google Scholar
  50. 50.
    Mesbahi M, Egerstedt M (2010) Graph Theoretic methods in multiagent networks, Princeton series in applied mathematicsGoogle Scholar
  51. 51.
    Moon J, Oh E, Shin DH (2013) An integral framework of task assignment and path planning for multiple UAV in dynamic environments. J Intell Robots Syst 70:303–313Google Scholar
  52. 52.
    Sathyaraj BM, Jain LC, Fuin A, Drake S (2008) Multiple UAV path planning algorithms: a comparative study. Fuzzy Optim Decis Making 7(3):257–267Google Scholar
  53. 53.
    No TS, Kim Y, Takh MJ, Jeon GE (2011) Cascade type guidance law design for multiple UAV formation keeping. Aerosp Sci Technol 15:431–439Google Scholar
  54. 54.
    Oberlin P, Rathinam S, Darbha S (2009) A transformation for a multiple depot, multiple traveling salesman problem. In: American control conference, pp 2636–2641Google Scholar
  55. 55.
    Ono M, Williams BC (2010) Decentralized chance constrained finite horizon optimal control for multi-agent systems. In: 49th IEEE control and decision conference, Atlanta, Ga, pp 138–145Google Scholar
  56. 56.
    Parlangeli G, Notarstefano G (2012) On the reachability and observability of path and cycle graphs. IEEE Trans Autom Control 57:743–748CrossRefMathSciNetGoogle Scholar
  57. 57.
    Pavone M, Frazzoli E, Bullo F (2011) Adaptive and distributive algorithms for Vehicle routing in a stochastic and dynamic environment. IEEE Trans Autom Control 56:1259–1274CrossRefMathSciNetGoogle Scholar
  58. 58.
    Peng R, Wang H, Wang Z, Lin Y (2010) Decision making of aircraft optimum configuration utilizing multi dimensional game theory. Chinese J Aeronaut 23:194–197Google Scholar
  59. 59.
    Ponda S, Johnson L, How J (2012) Distributed chance constrained task allocation for autonomous multi-agent teams. In: Proceedings of the 2012 American control conference, Montreal, Canada, pp 4528–4533Google Scholar
  60. 60.
    Rabbath CA, Lechevin N (2011) Safety and reliability in cooperating unmanned aerial systems. World Scientific, SingaporeGoogle Scholar
  61. 61.
    Rathinam S, Sengupta R, Darbha S (2007) A resource allocation algorithm for multivehicle system with nonholonomic constraints. IEEE Trans Autom Sci Eng 4:4027–4032Google Scholar
  62. 62.
    Rosaci D, Sarne M, Garruzzo S (2012) Integrating trust measuring in multiagent sytems. Int J Intell Syst 27:1–15CrossRefGoogle Scholar
  63. 63.
    Saget S, Legras F, Coppin G (2008) Cooperative interface for a swarm of UAV, - arXiv preprint arXiv:0811.0335 - arxiv.orgGoogle Scholar
  64. 64.
    Semsar-Kazerooni E, Khorasani K (2009) Multi-agent team cooperation: a game theory approach. Automatica 45:2205–2213Google Scholar
  65. 65.
    Sennott LI (2009) Stochastic dynamic programming and the control of queuing systems, Wiley, New YorkGoogle Scholar
  66. 66.
    Seuken S, Zilberstein S (2008) Formal models and algorithms for decentralized decision making under uncertainty. Autonom Agent Multi-Agent Syst doi: 10.1007/s10458-007-9026-5
  67. 67.
    Shamma JS (2007) Cooperative control Of distributed multi-agent system. Wiley, UKGoogle Scholar
  68. 68.
    Shanmugavel M, Tsourdos A, Zbikowski R, White BA, Rabbath CA, Lechevin N (2006) A solution to simultaneous arrival of multiple UAV using Pythagorean hodograph curves, In: American control conference, Minneapolis, MN, pp 2813–2818Google Scholar
  69. 69.
    Shi G, Hong Y, Johansson K (2012) Connectivity and set tracking of multi-agent systems guided by multiple moving leaders. IEEE Trans Autom Control 57:663–676CrossRefMathSciNetGoogle Scholar
  70. 70.
    Shima T, Rasmussen S (2009) UAV cooperative decision control: challenges and practical approaches, SIAM, Philadelphia, PAGoogle Scholar
  71. 71.
    Sirigineedi G, Tsourdos A, Zbikowski R, White B (2010) Modeling and verification of multiple UAV mission using SVM. In: Workshop on formal methods for aerospace, pp 22–33Google Scholar
  72. 72.
    Stachura M, Frew GW (2011) Cooperative target localization with a communication aware- unmanned aircraft system. AIAA J Guidance Control Dynamics 34:1352–1362Google Scholar
  73. 73.
    Surynek P (2010) An optimization variant of multi-robot path planning is intractable. In: 24th AAAI conference on artificial intelligenceGoogle Scholar
  74. 74.
    Turpin M, Michael N, Kumar V (2012) Decentralized formation control with variable shapes for aerial robots. In: IEEE international conference on robotics and automation, Saint Paul, pp 23–30Google Scholar
  75. 75.
    Turra D, Pollini L, Innocenti M (2004) Fast unmanned vehicles task allocation with moving targets. In: 43rd IEEE conference on decision and control, pp 4280–4285Google Scholar
  76. 76.
    Twu PY, Martin P, Egerstedtd M (2012) Graph process specifications for hybrid networked systems. Discrete Event Dyn Syst 22:541–577CrossRefMATHMathSciNetGoogle Scholar
  77. 77.
    Ulusoy, A Smith SL, Ding XC, Belta C, Rus D (2011) Optimal multi-robot path planning with temporal logic constraints. In: IROS IEEE/RSJ international conference on intelligent robots and systems, 3087–3092Google Scholar
  78. 78.
    Ulusoy A, Smith SL, Ding XC, Belta C (2012) Robust multi-robot optimal path planning with temporal logic constraints. In: IEEE international conference on robotics and automationGoogle Scholar
  79. 79.
    Vazirani V (2003) Approximation algorithms. Springer verlag, New YorkGoogle Scholar
  80. 80.
    Virtanen K, Hamalainen RP, Mattika V (2006) Team optimal signaling strategies in Air Combat. IEEE Trans Syst Man Cybern 36:643–660Google Scholar
  81. 81.
    Wen G, Duan Z, Yu W, Chen G (2012) Consensus of multi-agent systems with nonlinear dynamics and sampled data information: a delayed input approach. Int J Robust Nonlinear Control 23:602–619CrossRefMathSciNetGoogle Scholar
  82. 82.
    Wu F, Zilberstein S, Chen X (2011) On line planning for multi-agent systems with bounded communication. Artif Intell 175:487–511CrossRefMATHMathSciNetGoogle Scholar
  83. 83.
    Yadlapelli S, Malik W, Darbha M (2007) A lagrangian based algorithm for a multiple depot, multiple traveling salesmen. In: American control conference, pp 4027–4032Google Scholar
  84. 84.
    Zhang H, Zhai C, Chen Z (2011) A general alignment repulsion algorithm for flocking of multiagent systems. IEEE Trans Autom Control 56:430–435CrossRefMathSciNetGoogle Scholar
  85. 85.
    Zhi-Wei H, Jia-hong L, Ling C, Bing W (2012) A hierarchical architecture for formation control of multi-UAV. Procedia Eng 29:3846–3851CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  1. 1.UFR Sciences and TechnologiesUniversité d’Evry Val-D’EssoneEvryFrance

Personalised recommendations