Instrumental Properties of Social Testbeds

  • Javier Insa-CabreraEmail author
  • José Hernández-Orallo
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9205)


The evaluation of an ability or skill happens in some kind of testbed, and so does with social intelligence. Of course, not all testbeds are suitable for this matter. But, how can we be sure of their appropriateness? In this paper we identify the components that should be considered in order to measure social intelligence, and provide some instrumental properties in order to assess the suitability of a testbed.


Social intelligence Multi-Agent systems Cooperation Competition Game theory Rewards Universal psychometrics 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Horling, B., Lesser, V.: A Survey of Multi-Agent Organizational Paradigms. The Knowledge Engineering Review 19, 281–316 (2004)CrossRefGoogle Scholar
  2. 2.
    Simao, J., Demazeau, Y.: On Social Reasoning in Multi-Agent Systems. Inteligencia Artificial 5(13), 68–84 (2001)CrossRefGoogle Scholar
  3. 3.
    Roth, A.E.: The Shapley Value: Essays in Honor of Lloyd S. Shapley. Cambridge University Press (1988)Google Scholar
  4. 4.
    Insa-Cabrera, J., Hernández-Orallo, J.: Definition and properties to assess multi-agent environments as social intelligence tests. Technical report, CoRR (2014)Google Scholar
  5. 5.
    Legg, S., Hutter, M.: Universal Intelligence: A Definition of Machine Intelligence. Minds and Machines 17(4), 391–444 (2007)CrossRefGoogle Scholar
  6. 6.
    Hernández-Orallo, J., Dowe, D.L.: Measuring universal intelligence: Towards an anytime intelligence test. Artificial Intelligence 174(18), 1508–1539 (2010)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Hernández-Orallo, J.: A (hopefully) unbiased universal environment class for measuring intelligence of biological and artificial systems. In: 3rd Conference on Artificial General Intelligence, pp. 182–183 (2010)Google Scholar
  8. 8.
    Hernández-Orallo, J., Dowe, D.L., Hernández-Lloreda, M.V.: Universal psychometrics: Measuring cognitive abilities in the machine kingdom. Cognitive Systems Research 27, 50–74 (2014)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.DSICUniversitat Politècnica de ValènciaValenciaSpain

Personalised recommendations