Artificial Swarming Shown to Amplify Accuracy of Group Decisions in Subjective Judgment Tasks
Abstract
New technologies enable distributed human teams to form real-time systems modeled after natural swarms. Often referred to as Artificial Swarm Intelligence (ASI) or simply “human swarming”, these real-time systems have been shown to amplify group intelligence across a wide range of tasks, from handicapping sports to forecasting financial markets. While most prior research has studied human swarms with 20–100 members, the present study explores the ability of ASI to amplify accuracy in small teams of 3–6 members. The present study also explores if conducting multiple swarms and aggregating by taking a “vote of swarms” can further amplify the accuracy. A large set of 66 small teams were engaged in this study. Each team was given a standard subjective judgement test. Participants took the test both as individuals and real-time swarms. The average individual scored 69% correct, while the average swarm scored 84% correct (p < 0.001). In addition, aggregation of multiple swarms revealed additional amplifications of accuracy. For example, by randomly selecting sets of 3 swarms and aggregating by plurality vote, average accuracy increased to 91% (p < 0.001). These results suggest that when small teams make subjective judgements as real-time swarms, they can be significantly more accurate than individual members, and that their accuracy can be further amplified by aggregating the output across small sets of swarms.
Keywords
Swarm intelligence Collective intelligence Artificial intelligence Human swarming Wisdom of crowds Artificial swarm intelligence ASIReferences
- 1.Rosenberg, L.B.: Human swarms, a real-time method for collective intelligence. In: Proceedings of the European Conference on Artificial Life 2015, pp. 658–659Google Scholar
- 2.Rosenberg, L.: Artificial swarm intelligence vs human experts. In: 2016 International Joint Conference on Neural Networks (IJCNN). IEEEGoogle Scholar
- 3.Rosenberg, L., Baltaxe, D., Pescetelli, N.: Crowds vs swarms, a comparison of intelligence. In: IEEE 2016 Swarm/Human Blended Intelligence (SHBI), Cleveland, OH, pp. 1–4 (2016)Google Scholar
- 4.Baltaxe, D., Rosenberg, L., Pescetelli, N.: Amplifying prediction accuracy using human swarms. In: Collective Intelligence 2017, New York, NY (2017)Google Scholar
- 5.Rosenberg, L., Pescetelli, N., Willcox, G.: Human swarms amplify accuracy in financial predictions. In: IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON), New York, NY (2017)Google Scholar
- 6.Rosenberg, L., Willcox, G., Halabi, S., Lungren, M., Baltaxe, D., Lyons, M.: Artificial swarm intelligence employed to amplify diagnostic accuracy in radiology. In: 2018 IEEE 9th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON), Vancouver, BC, 2–4 Nov 2018Google Scholar
- 7.Rosenberg, L., Willcox, G.: Artificial swarms find social optima: (late breaking report). In: 2018 IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA), pp. 174–178, Boston, MA (2018)Google Scholar
- 8.Baron-Cohen, S., Wheelwright, S., Hill, J., Raste, Y., Plumb, I.: The “reading the mind in the eyes” test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. J. Child Psychol. Psychiatry 42, 241 (2001)CrossRefGoogle Scholar
- 9.Vellante, M., Baron-Cohen, S., Melis, M., Marrone, M., Petretto, D.R., Masala, C., Preti, A.: The “reading the mind in the eyes” test: systematic review of psychometric properties and a validation study in Italy. Cogn. Neuropsychiatry 18, 326–354 (2012)CrossRefGoogle Scholar
- 10.Fiske, S.T., Taylor, S.E.: Social Cognition: From Brains to Culture. Sage, London, UK (2013)CrossRefGoogle Scholar
- 11.Kunda, Z.: Social Cognition: Making Sense of People. The MIT Press, Cambridge, MA (1999)Google Scholar
- 12.Frith, C.D., Singer, T.: The role of social cognition in decision making. Philos. Trans. R. Soc. Lond. B Biol. Sci. 363, 3875–3886 (2008)CrossRefGoogle Scholar