Skip to main content

Artificial Swarming Shown to Amplify Accuracy of Group Decisions in Subjective Judgment Tasks

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 70))

Abstract

New technologies enable distributed human teams to form real-time systems modeled after natural swarms. Often referred to as Artificial Swarm Intelligence (ASI) or simply “human swarming”, these real-time systems have been shown to amplify group intelligence across a wide range of tasks, from handicapping sports to forecasting financial markets. While most prior research has studied human swarms with 20–100 members, the present study explores the ability of ASI to amplify accuracy in small teams of 3–6 members. The present study also explores if conducting multiple swarms and aggregating by taking a “vote of swarms” can further amplify the accuracy. A large set of 66 small teams were engaged in this study. Each team was given a standard subjective judgement test. Participants took the test both as individuals and real-time swarms. The average individual scored 69% correct, while the average swarm scored 84% correct (p < 0.001). In addition, aggregation of multiple swarms revealed additional amplifications of accuracy. For example, by randomly selecting sets of 3 swarms and aggregating by plurality vote, average accuracy increased to 91% (p < 0.001). These results suggest that when small teams make subjective judgements as real-time swarms, they can be significantly more accurate than individual members, and that their accuracy can be further amplified by aggregating the output across small sets of swarms.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Rosenberg, L.B.: Human swarms, a real-time method for collective intelligence. In: Proceedings of the European Conference on Artificial Life 2015, pp. 658–659

    Google Scholar 

  2. Rosenberg, L.: Artificial swarm intelligence vs human experts. In: 2016 International Joint Conference on Neural Networks (IJCNN). IEEE

    Google Scholar 

  3. Rosenberg, L., Baltaxe, D., Pescetelli, N.: Crowds vs swarms, a comparison of intelligence. In: IEEE 2016 Swarm/Human Blended Intelligence (SHBI), Cleveland, OH, pp. 1–4 (2016)

    Google Scholar 

  4. Baltaxe, D., Rosenberg, L., Pescetelli, N.: Amplifying prediction accuracy using human swarms. In: Collective Intelligence 2017, New York, NY (2017)

    Google Scholar 

  5. Rosenberg, L., Pescetelli, N., Willcox, G.: Human swarms amplify accuracy in financial predictions. In: IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON), New York, NY (2017)

    Google Scholar 

  6. Rosenberg, L., Willcox, G., Halabi, S., Lungren, M., Baltaxe, D., Lyons, M.: Artificial swarm intelligence employed to amplify diagnostic accuracy in radiology. In: 2018 IEEE 9th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON), Vancouver, BC, 2–4 Nov 2018

    Google Scholar 

  7. Rosenberg, L., Willcox, G.: Artificial swarms find social optima: (late breaking report). In: 2018 IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA), pp. 174–178, Boston, MA (2018)

    Google Scholar 

  8. Baron-Cohen, S., Wheelwright, S., Hill, J., Raste, Y., Plumb, I.: The “reading the mind in the eyes” test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. J. Child Psychol. Psychiatry 42, 241 (2001)

    Article  Google Scholar 

  9. Vellante, M., Baron-Cohen, S., Melis, M., Marrone, M., Petretto, D.R., Masala, C., Preti, A.: The “reading the mind in the eyes” test: systematic review of psychometric properties and a validation study in Italy. Cogn. Neuropsychiatry 18, 326–354 (2012)

    Article  Google Scholar 

  10. Fiske, S.T., Taylor, S.E.: Social Cognition: From Brains to Culture. Sage, London, UK (2013)

    Book  Google Scholar 

  11. Kunda, Z.: Social Cognition: Making Sense of People. The MIT Press, Cambridge, MA (1999)

    Google Scholar 

  12. Frith, C.D., Singer, T.: The role of social cognition in decision making. Philos. Trans. R. Soc. Lond. B Biol. Sci. 363, 3875–3886 (2008)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Louis Rosenberg .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Willcox, G., Rosenberg, L., Askay, D., Metcalf, L., Harris, E., Domnauer, C. (2020). Artificial Swarming Shown to Amplify Accuracy of Group Decisions in Subjective Judgment Tasks. In: Arai, K., Bhatia, R. (eds) Advances in Information and Communication. FICC 2019. Lecture Notes in Networks and Systems, vol 70. Springer, Cham. https://doi.org/10.1007/978-3-030-12385-7_29

Download citation

Publish with us

Policies and ethics