Swarm Intelligence

, Volume 7, Issue 2–3, pp 173–199 | Cite as

Task partitioning in a robot swarm: a study on the effect of communication

  • Giovanni Pini
  • Matteo Gagliolo
  • Arne Brutschy
  • Marco Dorigo
  • Mauro Birattari
Article

Abstract

Task partitioning consists in dividing a task into sub-tasks that can be tackled separately. Partitioning a task might have both positive and negative effects: On the one hand, partitioning might reduce physical interference between workers, enhance exploitation of specialization, and increase efficiency. On the other hand, partitioning may introduce overheads due to coordination requirements. As a result, whether partitioning is advantageous or not has to be evaluated on a case-by-case basis. In this paper we consider the case in which a swarm of robots must decide whether to complete a given task as an unpartitioned task, or utilize task partitioning and tackle it as a sequence of two sub-tasks. We show that the problem of selecting between the two options can be formulated as a multi-armed bandit problem and tackled with algorithms that have been proposed in the reinforcement learning literature. Additionally, we study the implications of using explicit communication between the robots to tackle the studied task partitioning problem. We consider a foraging scenario as a testbed and we perform simulation-based experiments to evaluate the behavior of the system. The results confirm that existing multi-armed bandit algorithms can be employed in the context of task partitioning. The use of communication can result in better performance, but in may also hinder the flexibility of the system.

Keywords

Task partitioning Foraging Swarm robotics Self-organization Social learning 

References

  1. Agrawal, R. (1995). Sample mean based index policies with O(logn) regret for the multi-armed bandit problem. Advances in Applied Probability, 27, 1054–1078. MathSciNetMATHCrossRefGoogle Scholar
  2. Anderson, C., & Ratnieks, F. L. W. (1999). Task partitioning in insect societies I: effect of colony size on queueing delay and colony ergonomic efficiency. The American Naturalist, 154(5), 521–535. CrossRefGoogle Scholar
  3. Anderson, C., & Ratnieks, F. L. W. (2000). Task partitioning in insect societies: novel situations. Insectes Sociaux, 47, 198–199. CrossRefGoogle Scholar
  4. Arnan, X., Ferrandiz-Rovira, M., Pladevall, C., & Rodrigo, A. (2011). Worker size-related task partitioning in the foraging strategy of a seed-harvesting ant species. Behavioral Ecology and Sociobiology, 65(10), 1881–1890. CrossRefGoogle Scholar
  5. Auer, P., Cesa-Bianchi, N., & Fischer, P. (2002). Finite-time analysis of the multiarmed bandit problem. Machine Learning, 47(2), 235–256. MATHCrossRefGoogle Scholar
  6. Brutschy, A., Pini, G., Baiboun, N., Decugnière, A., & Birattari, M. (2010). The IRIDIA-TAM: A device for task abstraction for the E-puck robot. Technical Report TR/IRIDIA/2010-015, IRIDIA, ULB. Google Scholar
  7. Busoniu, L., Babuska, R., & De Schutter, B. (2008). A comprehensive survey of multiagent reinforcement learning. IEEE Transactions on Systems, Man and Cybernetics. Part C, Applications and Reviews, 38(2), 156–172. CrossRefGoogle Scholar
  8. Cesa-Bianchi, N., & Lugosi, G. (2006). Prediction, learning, and games. Cambridge: Cambridge University Press. MATHCrossRefGoogle Scholar
  9. Dorigo, M., Floreano, D., Gambardella, L. M., Mondada, F., Nolfi, S., Baaboura, T., Birattari, M., Bonani, M., Brambilla, M., Brutschy, A., Burnier, D., Campo, A., Christensen, A. L., Decugnière, A., Caro, G. D., Ducatelle, F., Ferrante, E., Förster, A., Gonzales, J. M., Guzzi, J., Longchamp, V., Magnenat, S., Mathews, N., de Oca, M. M., O’Grady, R., Pinciroli, C., Pini, G., Rétornaz, P., Roberts, J., Sperati, V., Stirling, T., Stranieri, A., Stützle, T., Trianni, V., Tuci, E., Turgut, A. E., & Vaussard, F. (2013, in press). Swarmanoid: a novel concept for the study of heterogeneous robotic swarms. IEEE Robotics & Automation Magazine. Google Scholar
  10. Drogoul, A., & Ferber, J. (1992). From tom thumb to the dockers: some experiments with foraging robots. In J.-A. Meyer, L. R. Herbert, & W. W. Stewart (Eds.), Proceedings of the second international conference on simulation of adaptive behavior (pp. 451–459). Cambridge: MIT Press. Google Scholar
  11. Fontan, M. S., & Matarić, M. J. (1996). A study of territoriality: the role of critical mass in adaptive task division. In P. Maes, M. J. Matarić, J.-A. Meyer, J. Pollack, & S. Wilson (Eds.), From animals to animats 4: proceedings of the fourth international conference of simulation of adaptive behavior (pp. 553–561). Cambridge: MIT Press. Google Scholar
  12. Fowler, H. G., & Robinson, S. W. (1979). Foraging by Atta sexdens (Formicidae: Attini): seasonal patterns, caste and efficiency. Ecological Entomology, 4(3), 239–247. CrossRefGoogle Scholar
  13. Frison, M., Tran, N.-L., Baiboun, N., Brutschy, A., Pini, G., Roli, A., Dorigo, M., & Birattari, M. (2010). Self-organized task partitioning in a swarm of robots. In M. Dorigo, M. Birattari, G. A. Di Caro, R. Doursat, A. P. Engelbrecht, D. Floreano, L. M. Gambardella, R. Groß, E. Sahin, H. Sayama, & T. Stützle (Eds.), LNCS: Vol. 6234. Swarm intelligence, 7th international conference, ANTS 2010 (pp. 287–298). Berlin/Heidelberg: Springer. Google Scholar
  14. Goldberg, D., & Matarić, M. J. (2002). Design and evaluation of robust behavior-based controllers for distributed multi-robot collection tasks. In T. Balch & L. E. Parker (Eds.), Robot teams: from diversity to polymorphism (pp. 315–344). Natick: AK Peters/CRC Press. Google Scholar
  15. Gutiérrez, Á., Campo, A., Dorigo, M., Donate, J., Monasterio-Huelin, F., & Magdalena, L. (2009). Open E-puck range & bearing miniaturized board for local communication in swarm robotics. In ICRA’09: proceedings of the 2009 IEEE international conference on robotics and automation (pp. 3111–3116). Piscataway: IEEE Press. CrossRefGoogle Scholar
  16. Hart, A. G., & Ratnieks, F. L. W. (2001). Task partitioning, division of labour and nest compartmentalisation collectively isolate hazardous waste in the leafcutting Atta cephalotes. Behavioral Ecology and Sociobiology, 49, 387–392. CrossRefGoogle Scholar
  17. Hubbell, S. P., Johnson, L. K., Stanislav, E., Wilson, B., & Fowler, H. (1980). Foraging by bucket-brigade in leaf-cutter ants. Biotropica, 12(3), 210–213. CrossRefGoogle Scholar
  18. Jeanne, R. L. (1986). The evolution of the organization of work in social insects. Monitore Zoologico Italiano, 20, 119–133). Google Scholar
  19. Lein, A., & Vaughan, R. T. (2008). Adaptive multi-robot bucket brigade foraging. In S. Bullock, J. Noble, R. Watson, & M. A. Bedau (Eds.), Artificial life XI: proceedings of the eleventh international conference on the simulation and synthesis of living systems (pp. 337–342). Cambridge: MIT Press. Google Scholar
  20. Lein, A., & Vaughan, R. T. (2009). Adapting to non-uniform resource distributions in robotic swarm foraging through work-site relocation. In 2009 IEEE/RSJ international conference on intelligent robots and systems (IROS’09) (pp. 601–606). Piscataway: IEEE Press. CrossRefGoogle Scholar
  21. Lerman, K., & Galstyan, A. (2002). Mathematical model of foraging in a group of robots: effect of interference. Autonomous Robots, 13, 127–141. MATHCrossRefGoogle Scholar
  22. Mondada, F., Bonani, M., Raemy, X., Pugh, J., Cianci, C., Klaptocz, A., Magnenat, S., Zufferey, J.-C., Floreano, D., & Martinoli, A. (2009). The e-puck, a robot designed for education in engineering. In Proceedings of the 9th conference on autonomous robot systems and competitions (pp. 59–65). IPCB-Instituto Politecnico de Castelo Branco. Google Scholar
  23. Nunes, L., & Oliveira, E. (2008). Communication during learning in heterogeneous teams of learning agents. Intelligent Decision Technologies, 2(3), 153–166. Google Scholar
  24. Østergaard, E. H., Sukhatme, G. S., & Matarić, M. J. (2001). Emergent bucket brigading: a simple mechanisms for improving performance in multi-robot constrained-space foraging tasks. In E. Andre, S. Sen, C. Frasson, & P. M. Jörg (Eds.), AGENTS’01: proceedings of the fifth international conference on autonomous agents (pp. 29–30). New York: ACM Press. CrossRefGoogle Scholar
  25. Panait, L., & Luke, S. (2005). Cooperative multi-agent learning: the state of the art. Autonomous Agents and Multi-Agent Systems, 11(3), 387–434. CrossRefGoogle Scholar
  26. Pinciroli, C., Trianni, V., O’Grady, R., Pini, G., Brutschy, A., Brambilla, M., Mathews, N., Ferrante, E., Di Caro, G., Ducatelle, F., Birattari, M., Gambardella, L. M., & Dorigo, M. (2012). ARGoS: a modular, parallel, multi-engine simulator for multi-robot systems. Swarm Intelligence, 6(4), 271–295 CrossRefGoogle Scholar
  27. Pini, G., Brutschy, A., Birattari, M., & Dorigo, M. (2009). Task partitioning in swarms of robots: reducing performance losses due to interference at shared resources. In J. A. Cetto, J. Filipe, & J.-L. Ferrier (Eds.), LNEE: Vol. 85. Informatics in control, automation and robotics (pp. 217–228). Berlin/Heidelberg: Springer. CrossRefGoogle Scholar
  28. Pini, G., Brutschy, A., Frison, M., Roli, A., Dorigo, M., & Birattari, M. (2011). Task partitioning in swarms of robots: an adaptive method for strategy selection. Swarm Intelligence, 5(3–4), 283–304. CrossRefGoogle Scholar
  29. Pini, G., Brutschy, A., Francesca, G., Dorigo, M., & Birattari, M. (2012a). Multi-armed bandit formulation of the task partitioning problem in swarm robotics. In M. Dorigo, M. Birattari, C. Blum, A. L. Christensen, A. P. Engelbrecht, R. Groß, & T. Stützle (Eds.), LNCS: Vol. 7461. Swarm intelligence, 8th international conference, ANTS 2012 (pp. 109–120). Berlin/Heidelberg: Springer. Google Scholar
  30. Pini, G., Brutschy, A., Scheidler, A., Dorigo, M., & Birattari, M. (2012b). Task partitioning in a robot swarm: Retrieving objects by transferring them directly between sequential sub-tasks. Technical Report TR/IRIDIA/2012-010, IRIDIA, Université Libre de Bruxelles, Brussels, Belgium. Google Scholar
  31. Pini, G., Gagliolo, M., Brutschy, A., Dorigo, M., & Birattari, M. (2012c). Task partitioning in a robot swarm: a study on the effect of communication—Online supplementary material. http://iridia.ulb.ac.be/supp/IridiaSupp2012-0015/.
  32. Pini, G., Brutschy, A., Pinciroli, C., Dorigo, M., & Birattari, M. (2013, in press). Autonomous task partitioning in robot foraging: an approach based on cost estimation. Adaptive behavior. Google Scholar
  33. Ratnieks, F. L. W., & Anderson, C. (1999). Task partitioning in insect societies. Insectes Sociaux, 46(2), 95–108. CrossRefGoogle Scholar
  34. Schlag, K. (1998). Why imitate, and if so, how? A boundedly rational approach to multi-armed bandits. Journal of Economic Theory, 78(1), 130–156. MathSciNetMATHCrossRefGoogle Scholar
  35. Shell, D. J., & Matarić, M. J. (2006). On foraging strategies for large-scale multi-robot systems. In Proceedings of the 19th IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 2717–2723). Piscataway: IEEE Press. Google Scholar
  36. Shoham, Y., Powers, R., & Grenager, T. (2007). If multi-agent learning is the answer, what is the question? Artificial Intelligence, 171(7), 365–377. MathSciNetMATHCrossRefGoogle Scholar
  37. Sutton, R., & Barto, A. (1998). Reinforcement learning, an introduction. Cambridge: MIT Press. Google Scholar
  38. Tan, M. (1993). Multi-agent reinforcement learning: independent vs. cooperative agents. In Proceedings of the tenth international conference on machine learning (pp. 330–337). Google Scholar
  39. Theraulaz, G., Bonabeau, E., Solé, R. V., Schatz, B., & Deneubourg, J.-L. (2002). Task partitioning in a ponerine ant. Journal of Theoretical Biology, 215, 481–489. CrossRefGoogle Scholar
  40. Weiss, G. (1999). Multiagent systems: a modern approach to distributed artificial intelligence. Cambridge: MIT Press. Google Scholar
  41. Whitehead, S. D. (1991). A complexity analysis of cooperative mechanisms in reinforcement learning. In T. L. Dean & K. McKeown (Eds.), Proceedings of the 9th national conference on artificial intelligence (Vol. 2, pp. 607–613). Menlo Park/Cambridge: AAAI Press/MIT Press. Google Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • Giovanni Pini
    • 1
  • Matteo Gagliolo
    • 2
  • Arne Brutschy
    • 1
  • Marco Dorigo
    • 1
  • Mauro Birattari
    • 1
  1. 1.IRIDIAUniversité Libre de BruxellesBruxellesBelgium
  2. 2.GERME and MLGUniversité Libre de BruxellesBruxellesBelgium

Personalised recommendations