Advertisement

When is social computation better than the sum of its parts?

  • Vadas Gintautas
  • Aric Hagberg
  • Luís M. A.  Bettencourt
Conference paper

Social computation, whether in the form of searches performed by swarms of agents or collective predictions of markets, often supplies remarkably good solutions to complex problems. In many examples, individuals trying to solve a problem locally can aggregate their information and work together to arrive at a superior global solution. This suggests that there may be general principles of information aggregation and coordination that can transcend particular applications. Here we show that the general structure of this problemcan be cast in terms of information theory and derive mathematical conditions that lead to optimal multi-agent searches. Specifically, we illustrate the problem in terms of local search algorithms for autonomous agents looking for the spatial location of a stochastic source. We explore the types of search problems, defined in terms of the statistical properties of the source and the nature of measurements at each agent, for which coordination among multiple searchers yields an advantage beyond that gained by having the same number of independent searchers. We show that effective coordination corresponds to synergy and that ineffective coordination corresponds to independence as defined using information theory. We classify explicit types of sources in terms of their potential for synergy.We show that sources that emit uncorrelated signals provide no opportunity for synergetic coordination while sources that emit signals that are correlated in some way, do allow for strong synergy between searchers. These general considerations are crucial for designing optimal algorithms for particular search problems in real world settings.

Keywords

Joint Move Search Problem Local Search Algorithm Strong Synergy Spatial Search 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    F. Bourgault, T. Furukawa, and H.F. Durrant-Whyte. Coordinated decentralized search for a lost target in a Bayesian world. Intelligent Robots and Systems, 2003. (IROS 2003). Proceedings. 2003 IEEE/RSJ International Conference on, 1:48, Oct. 2003.Google Scholar
  2. 2.
    M. Vergassola, E. Villermaux, and B. I. Shraiman. “Infotaxis” as a strategy for searching without gradients. Nature, 445:406, 2007.CrossRefGoogle Scholar
  3. 3.
    R. S. Sulton and A. G. Barto. Reinforcement learning: an introduction. MIT Press, Cambrigde MA, 1998.Google Scholar
  4. 4.
    Iain D. Couzin, Jens Krause, Nigel R. Franks, and Simon A. Levin. Effective leadership and decision-making in animal groups on the move. Nature, 433:513, 2005.CrossRefGoogle Scholar
  5. 5.
    E. Bonabeau and G. Theraulaz. Swarm smarts. Scientific American, pages 72–79, Mar. 2000.Google Scholar
  6. 6.
    H. S. Seung, M. Opper, and H. Sompolinsky. Query by committee. In COLT '92: Proceedings of the fifth annual workshop on Computational learning theory, page 287, 1992.Google Scholar
  7. 7.
    Y. Freund, E. Shamir, and N. Tishby. Selective sampling using the query by committee algorithm. In Machine Learning, page 133, 1997.Google Scholar
  8. 8.
    S. Fine, R. Gilad-Bachrach, and E. Shamir. Query by committee, linear separation and random walks. Theor. Comput. Sci., 284(1):25, 2002.MATHCrossRefMathSciNetGoogle Scholar
  9. 9.
    Luis M. A. Bettencourt, Greg J. Stephens, Michael I. Ham, and Guenter W. Gross. Functional structure of cortical neuronal networks grown in vitro. Phys. Rev. E, 75:021915, 2007.CrossRefMathSciNetGoogle Scholar
  10. 10.
    L. M. A. Bettencourt, V. Gintautas, and M. I. Ham. Identification of functional information subgraphs in complex networks. Phys. Rev. Lett., 100:238701, 2008.CrossRefGoogle Scholar
  11. 11.
    T. M. Cover and J. A. Thomas. Elements of Information Theory. Wiley, New York, 1991.MATHCrossRefGoogle Scholar
  12. 12.
    E. Schneidman, W. Bialek, and M. J. Berry II. Synergy, redundancy, and independence in population codes. J. Neurosci., 23:11539, 2003.Google Scholar

Copyright information

© Springer-Verlag US 2009

Authors and Affiliations

  • Vadas Gintautas
    • 1
  • Aric Hagberg
    • 1
  • Luís M. A.  Bettencourt
    • 1
  1. 1.Theoretical Division, Los Alamos National LaboratoryCenter for Nonlinear Studies, and Applied Mathematics and Plasma PhysicsLos AlamosMexico

Personalised recommendations