Skip to main content

Learned Monkeys: Emergent Properties of Deep Reinforcement Learning Generated Networks

  • Conference paper
  • First Online:
Complex Networks XIV (CompleNet 2023)

Part of the book series: Springer Proceedings in Complexity ((SPCOM))

Included in the following conference series:

Abstract

Graph generation methods used in the study of animal social networks suffer from the inability to fully explain individual agent behaviors and values. However, recent advancements in complex networks and machine learning offer a novel way of artificially simulating network formations. We use deep reinforcement learning (DRL) to model the proximity network of white-faced capuchin monkeys. This process of constructing a graph provides insight into the unique, individual social strategies of a network’s agents depending on the initial DRL parameters. We generated a network to closely match the characteristics of the proximity network constructed from an observational dataset. For example, our model-generated graph and the observed graph consistently showed a few members with significantly higher betweenness centrality than all other members despite each agent starting with the same parameters.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Crofoot, M., Rubenstein, D., Maiya, A., Berger-Wolf, T.: Aggression, grooming and group-level cooperation in white-faced capuchins (cebus capucinus): Insights from social networks. Am. J. Primatol. 73, 821–33 (2011). https://doi.org/10.1002/ajp.20959

  2. Hoegh, A., van Manen, F.T., Haroldson, M.: Agent-based models for collective animal movement: proximity-induced state switching. J. Agric. Biol. Environ. Stat. 26(4), 560–579 (2021). https://doi.org/10.1007/s13253-021-00456-0

    Article  MathSciNet  MATH  Google Scholar 

  3. Jacobs, A.Z., Clauset, A.: A unified view of generative models for networks: models, methods, opportunities, and challenges (2014). https://doi.org/10.48550/ARXIV.1411.4070. https://arxiv.org/abs/1411.4070

  4. Kajokaite, K.: Male dispersal decisions: an agent-based general model and suggested refinements for white-faced capuchin monkeys (cebus capucinus) (2014)

    Google Scholar 

  5. Perry, S., Godoy, I., Lammers, W.: The lomas barbudal monkey project: two decades of research on cebus capucinus, pp. 141–163 (2012). https://doi.org/10.1007/978-3-642-22514-7_7

  6. Perry, S., Smolla, M.: Capuchin monkey rituals: an interdisciplinary study of form and function (2020). https://doi.org/10.1101/2020.02.21.958223

  7. Perry, S.E., et al.: Social conventions in wild white-faced capuchin monkeys. Curr. Anthropol. 44, 241–268 (2003). https://doi.org/10.1086/345825

    Article  Google Scholar 

  8. Song, W., Sheng, W., Li, D., Wu, C., Ma, J.: Modeling complex networks based on deep reinforcement learning. Front. Phys. 9, 822581 (2022). https://doi.org/10.3389/fphy.2021.822581. https://www.frontiersin.org/articles/10.3389/fphy.2021.822581

  9. Sutton, R.S., Barto, A.G.: Reinforcement learning: an introduction, pp. 135–181. The MIT Press, second edn. (2018)

    Google Scholar 

  10. Wilson, A.D.M., Krause, J.: Personality and social network analysis in animals. In: Animal Social Networks. Oxford University Press (2015). https://doi.org/10.1093/acprof:oso/9780199679041.003.0006

Download references

Acknowledgements

We would like to express our deep gratitude to Dr. Susan Perry, for her enthusiasm in our work and dedication to studying white faced capuchin monkeys. We would also like to thank Colin Chun, Evan Diaz, Spencer Wong, and Allen Yu for their camaraderie during our initial exploration of animal networks. Lastly our greatest thanks for the support of Linda Anegawa and Robert Rounthwaite whose help propelled this paper to new heights.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Theresa Migler .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Anegawa, S., Ho, I., Ly, K., Rounthwaite, J., Migler, T. (2023). Learned Monkeys: Emergent Properties of Deep Reinforcement Learning Generated Networks. In: Teixeira, A.S., Botta, F., Mendes, J.F., Menezes, R., Mangioni, G. (eds) Complex Networks XIV. CompleNet 2023. Springer Proceedings in Complexity. Springer, Cham. https://doi.org/10.1007/978-3-031-28276-8_5

Download citation

Publish with us

Policies and ethics