Skip to main content
SpringerLink
Log in

Design of ant-inspired stochastic control policies for collective transport by robotic swarms

Swarm Intelligence volume 8, pages 303–327 (2014)Cite this article

Abstract

In this paper, we present an approach to designing decentralized robot control policies that mimic certain microscopic and macroscopic behaviors of ants performing collective transport tasks. In prior work, we used a stochastic hybrid system model to characterize the observed team dynamics of ant group retrieval of a rigid load. We have also used macroscopic population dynamic models to design enzyme-inspired stochastic control policies that allocate a robotic swarm around multiple boundaries in a way that is robust to environmental variations. Here, we build on this prior work to synthesize stochastic robot attachment–detachment policies for tasks in which a robotic swarm must achieve non-uniform spatial distributions around multiple loads and transport them at a constant velocity. Three methods are presented for designing robot control policies that replicate the steady-state distributions, transient dynamics, and fluxes between states that we have observed in ant populations during group retrieval. The equilibrium population matching method can be used to achieve a desired transport team composition as quickly as possible; the transient matching method can control the transient population dynamics of the team while driving it to the desired composition; and the rate matching method regulates the rates at which robots join and leave a load during transport. We validate our model predictions in an agent-based simulation, verify that each controller design method produces successful transport of a load at a regulated velocity, and compare the advantages and disadvantages of each method.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

References

  • Becker, A., Habibi, G., Werfel, J., Rubenstein, M., & McLurkin, J. (2013). Massive uniform manipulation: Controlling large populations of simple robots with a common input signal. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, Tokyo, Japan.

  • Berman, S., Halász, Á., Hsieh, M. A., & Kumar, V. (2009). Optimized stochastic policies for task allocation in swarms of robots. IEEE Transactions on Robotics, 25(4), 927–937. doi:10.1109/TRO.2009.2024997.

    Article  Google Scholar 

  • Berman, S., Lindsey, Q., Sakar, M. S., Kumar, V., & Pratt, S. C. (2011). Experimental study and modeling of group retrieval in ants as an approach to collective transport in swarm robotic systems. Proceeding of IEEE, 99(9), 1470–1481. doi:10.1109/JPROC.2011.2111450.

    Article  Google Scholar 

  • Chen, J., Gauci, M., & Groß, R. (2013a) A strategy for transporting tall objects with a swarm of miniature mobile robots. Proceedings of the 2013 International Conference on Robotics and Automation, Karlsruhe, Germany, pp 863–869, doi:10.1109/ICRA.2013.6630674.

  • Chen, Y. J., Dalchau, N., Srinivas, N., Phillips, A., Cardelli, L., Soloveichik, D., et al. (2013). Programmable chemical controllers made from DNA. Nature Nanotechnology, 8, 755–762. doi:10.1038/nnano.2013.189.

    Article  Google Scholar 

  • Correll, N. (2008). Parameter estimation and optimal control of swarm-robotic systems: A case study in distributed task allocation. Proceedings of the 2008 IEEE International Conference on Robotics and Automation, IEEE, Pasadena, CA, USA, pp 3302–3307, doi:10.1109/ROBOT.2008.4543714.

  • Correll, N., & Martinoli, A. (2004). Modeling and optimization of a swarm-intelligent inspection system. Proceedings of the Seventh International Symposium on Distributed Autonomous Robotics Systems (DARS 2004), Toulouse, France, pp 369–378, doi:10.1007/978-4-431-35873-2_36.

  • Czaczkes, T. J., & Ratnieks, F. L. W. (2013). Cooperative transport in ants (Hymenoptera: Formicidae) and elsewhere. Myrmecological News, 18, 1–11.

    Google Scholar 

  • Evans, J. W. (1993). Random and cooperative sequential adsorption. Reviews of Modern Physics, 65(4), 1281–1329. doi:10.1103/RevModPhys.65.1281.

    Article  Google Scholar 

  • Ferrante, E., Brambilla, M., Birattari, M., & Dorigo, M. (2013). Socially-mediated negotiation for obstacle avoidance in collective transport. Proceedings of International Symposium on Distributed Autonomous Robotic Systems (DARS), Springer, Naples, Italy, Springer Tracts in Advanced Robotics, vol 83, pp 571–583.

  • Finch SR (2003) Mathematical constants, encyclopedia of mathematics and its applications, Vol. 94. Cambridge: Cambridge University Press.

  • Grassé, P. P. (1959). La reconstruction du nid et les coordinations interindividuelles chez Bellicositermes natalensis et Cubitermes sp. la théorie de la stigmergie: essai d’interprétation du comportement des termites constructeurs. Insectes Sociaux, 6(1), 41–80. doi:10.1007/BF02223791.

    Article  MathSciNet  Google Scholar 

  • Groß, R., & Dorigo, M. (2009). Towards group transport by swarms of robots. International Journal of Bio-Inspired Computation, 1(1–2), 1–13.

    Article  Google Scholar 

  • Gurarie, E. (2008). Models and analysis of animal movements: From individual tracks to mass dispersal. PhD thesis, University of Washington.

  • Hutchinson, J. M. C., & Waser, P. M. (2007). Use, misuse and extensions of “ideal gas” models of animal encounter. Biological Review, 82(3), 335–359. doi:10.1111/j.1469-185X.2007.00014.x.

    Article  Google Scholar 

  • Kube, C. R., & Bonabeau, E. (2000). Cooperative transport by ants and robots. Robotics and Autonomous Systems, 30(1–2), 85–101. doi:10.1016/S0921-8890(99)00066-4.

    Article  Google Scholar 

  • Kumar, G. P., Buffin, A., Pavlic, T. P., Pratt, S. C., & Berman, S. M. (2013). A stochastic hybrid system model of collective transport in the desert ant Aphaenogaster cockerelli. Proceedings of the 16th ACM International Conference on Hybrid Systems: Computation and Control, Philadelphia, PA, pp. 119–124, doi:10.1145/2461328.2461349.

  • Labella, T. H., Dorigo, M., & Deneubourg, J. L. (2006). Division of labor in a group of robots inspired by ants’ foraging behavior. ACM Transactions on Autonomous and Adaptive Systems, 1(1), 4–25. doi:10.1145/1152934.1152936.

    Article  Google Scholar 

  • Lachmann, M., & Sella, G. (1995). The computationally complete ant colony: global coordination in a system with no hierarchy. Proceedings of the Third European Conference on Artificial Life (pp. 784–800). Spain: Granada.

  • Langmuir, I. (1918). The adsorption of gases on plane surfaces of glass, mica and platinum. Journal of the American Chemical Society, 40(9), 1361–1403. doi:10.1021/ja02242a004.

    Article  Google Scholar 

  • Liu, W., & Winfield, A. F. T. (2010). Modeling and optimization of adaptive foraging in swarm robotic systems. International Journal of Robotics Research, 29(14), 1743–1760. doi:10.1177/0278364910375139.

    Article  Google Scholar 

  • Martinoli, A., Easton, K., & Agassounon, W. (2004). Modeling swarm robotic systems: A case study in collaborative distributed manipulation. International Journal of Robotics Research, 23(4–5), 415–436. doi:10.1177/0278364904042197.

    Article  Google Scholar 

  • Mather, T. W., & Hsieh, M. A. (2011). Distributed robot ensemble control for deployment to multiple sites. Proceedings of Robotics: Science and Systems VII, Los Angeles, CA, USA.

  • Matthey, L., Berman, S., & Kumar, V. (2009). Stochastic strategies for a swarm robotic assembly system. Proceedings of the 2009 IEEE International Conference on Robotics and Automation (pp. 1953–1958). Japan: Kobe.

  • McCreery, H. F., & Breed, M. D. (2013). Cooperative transport in ants: a review of proximate mechanisms. Insectes Sociaux, 61(2), 99–110. doi:10.1007/s00040-013-0333-3.

    Article  Google Scholar 

  • Napp, N., Burden, S., & Klavins, E. (2009). Setpoint regulation for stochastically interacting robots. Proceedings of Robotics: Science and Systems V, Seattle, WA, USA.

  • Odhner, L. U., & Asada, H. (2010). Stochastic recruitment control of large ensemble systems with limited feedback. Journal of Dynamic Systems, Measurement, and Control, 132(4), 041008. doi:10.1115/1.4001706.

    Article  Google Scholar 

  • O’Grady, R., Pinciroli, C., Groß, R., Christensen, A. L., Mondada, F., Bonani, M., & Dorigo, M. (2009). Swarm-bots to the rescue. In: Proceedings of the 10th European Conference on Artificial Life, Springer, Budapest, Hungary, Lecture Notes in Computer Science, Vol. 5777, pp 165–172, doi:10.1007/978-3-642-21283-3_21.

  • Pavlic, T. P., Wilson, S., Kumar, G. P., & Berman, S. (2013). An enzyme-inspired approach to stochastic allocation of robotic swarms around boundaries. Proceedings of the 16th International Symposium on Robotics Research (ISRR 2013), Singapore.

  • Pavlic, T. P., Wilson, S., Kumar, G. P., Berman, S. (2014). Control of stochastic boundary coverage by multi-robot systems. ASME Journal of Dynamic Systems, Measurement and Control.

  • Rényi, A. (1958). On a one-dimensional problem concerning random space-filling. Mathematical Institute of the Hungarian Academy of Sciences, 3, 109–127.

    MATH  Google Scholar 

  • Rubenstein, M., Cabrera, A., Werfel, J., Habibi, G., McLurkin, J., & Nagpal, R. (2013). Collective transport of complex objects by simple robots: theory and experiments. Proceedings of the 2013 International Conference on Autonomous Agents and Multi-Agent Systems, Saint Paul, Minnesota, USA, http://dl.acm.org/citation.cfm?id=2484920.2484932. Accessed 16 Feb 2014.

  • Shapiro, E., & Ran, T. (2013). DNA computing: Molecules reach consensus. Nature Nanotechnology, 8, 703–705. doi:10.1038/nnano.2013.202.

    Article  Google Scholar 

  • Solomon, H., & Weiner, H. (1986). A review of the packing problem. Communications in Statistics: Theory and Methods, 15(9), 2571–2607. doi:10.1080/03610928608829274.

    Article  MATH  MathSciNet  Google Scholar 

  • Soloveichik, D., Cook, M., Winfree, E., & Bruck, J. (2008). Computation with finite stochastic chemical reaction networks. Nature Computing, 7, 615–633. doi:10.1007/s11047-008-9067-y.

    Article  MATH  MathSciNet  Google Scholar 

  • Soloveichik, D., Seelig, G., & Winfree, E. (2010). DNA as a universal substrate for chemical kinetics. Proceedings of the National Academy of Sciences of the United States of America, 107(12), 5393–5398. doi:10.1073/pnas.0909380107.

    Article  Google Scholar 

  • Stilwell, D., & Bay, J. (1993). Toward the development of a material transport system using swarms of ant-like robots. Proceedings of the International Conference on Robotics and Automation (ICRA), pp 766–771, doi:10.1109/ROBOT.1993.292070.

  • Sugawara, K., Reishus, D., & Correll, N. (2012) Object transportation by granular convection using swarm robots. Distributed autonomous robotic systems, Springer, Baltimore, MD, STAR, http://spot.colorado.edu/dure7259/papers/Sugawara12.pdf. Accessed 7 Jan 2014.

  • Talbot, J., Tarjus, G., Van Tassel, P. R., & Viot, P. (2000). From car parking to protein adsorption: An overview of sequential adsorption processes. Colloids Surfaces A: Physicochemical and Engineering Aspects, 165(1–3), 287–324. doi:10.1016/S0927-7757(99)00409-4.

  • Wang, S., & Dormidontova, E. E. (2012). Selectivity of ligand–receptor interactions between nanoparticle and cell surfaces. Physical Review Letters, 109(238), 102.

    Google Scholar 

  • Wilensky, U. (1999). NetLogo. Center for Connected Learning and Computer-Based Modeling, Northwestern University, Evanston, IL, USA, http://ccl.northwestern.edu/netlogo/. Accessed 29 July 2013.

  • Zhang, G., Fricke, G., & Garg, D. (2013). Spill detection and perimeter surveillance via distributed swarming agents. IEEE/ASME Transactions on Mechatronics, 18(1), 121–129. doi:10.1109/TMECH.2011.2164578.

    Article  Google Scholar 

Download references

Acknowledgments

Comments by Simon DeDeo regarding the philosophical implications of equilibria of irreversible processes have been helpful in framing our thoughts about this approach. Interaction with him was possible due to a workshop on Information, Complexity, and Life organized by the BEYOND Center for Fundamental Concepts in Science at Arizona State University. We are also grateful for the helpful comments of four anonymous referees. This work was supported in part by NSF Award no. CCF-1012029, NSF Award No. CMMI-1363499, and DARPA Young Faculty Award No. D14AP00054.

Author information

Authors and Affiliations

  1. School for Engineering of Matter, Transport and Energy, Arizona State University, Tempe, AZ, USA

    Sean Wilson & Spring Berman

  2. School of Life Sciences, Arizona State University, Tempe, AZ, USA

    Theodore P. Pavlic, Aurélie Buffin & Stephen C. Pratt

  3. School for Computing, Informatics, and Decision Systems Engineering, Arizona State University, Tempe, AZ, USA

    Ganesh P. Kumar

Authors
  1. Sean Wilson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Theodore P. Pavlic
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ganesh P. Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Aurélie Buffin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Stephen C. Pratt
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Spring Berman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Spring Berman.

Rights and permissions

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wilson, S., Pavlic, T.P., Kumar, G.P. et al. Design of ant-inspired stochastic control policies for collective transport by robotic swarms. Swarm Intell 8, 303–327 (2014). https://doi.org/10.1007/s11721-014-0100-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11721-014-0100-8

Keywords

search

Navigation