Skip to main content

Pitfalls in the Development of Agent-Based Models in Social Sciences: Avoiding Them and Learning from Them

  • Chapter
  • First Online:
Human Simulation: Perspectives, Insights, and Applications

Part of the book series: New Approaches to the Scientific Study of Religion ((NASR,volume 7))

  • 321 Accesses

Abstract

The references on the principles and methodology for developing agent-based models of social phenomena usually describe general principles and illustrate the process using worked examples, but seldom focus on the pitfalls and errors that make practical model building a tortuous and difficult task. This chapter contains a discussion of the positive and negative aspects of my personal experience in a PhD work on simulation of large scale social conflict. The purpose will be to describe the process from the initial plan to the final dissertation, analyze the pitfalls and their overcoming in terms of principles of model development, and summarize the ideas that I found useful for practical development of agent-based models of social phenomena. The most serious pitfalls usually occur at the conception and design stages, when seemingly trivial points can be easily overlooked. These include starting with excessive ambition but unclear ideas on whether the purpose is understanding or prediction (i.e. what is the level of abstraction), poor knowledge of the relevant theories, and failure to identify which entities, variables and mechanisms must be considered. Several practical hints for avoiding these issues are presented, such as writing a reduced version of the “Overview, Design Concepts and Details” template that includes the bare minimum of items for a first working version, and devising efficient strategies for exploring the parameter space. This chapter will be of interest to MSc and PhD students working on social simulation, and to researchers developing projects on agent-based modeling of social phenomena, either individually or in teamwork.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The large protest of September 15th, 2011 forced the Government to step back in the application of a controversial decision about the “Taxa Social Única” (a charge of the companies to the Social Security System based on the workers’ monthly salaries).

  2. 2.

    Media coverage of protests by either TV stations or activists trying to catch hot spots of confrontation and posting videos on YouTube has a significant impact, and was thought to be essential for coupling the two models.

  3. 3.

    These subtypes had been well characterized in micro-situational theories of violence (Collins 2008; Wikström and Treiber 2009) and used in an ABM of clustering and fighting (Jager et al. 2001). They could also easily identified in many videos of real protests.

  4. 4.

    The motifs were related to subindices in the Fragile States Index indicator and included e.g. low salaries, bad governance, loss of independence and subordination to foreign interests, and illegitimacy of the government to impose austerity measures.

  5. 5.

    The “critical” level was introduced in an attempt to avoid respondents giving biased answers towards the top level. That attempt was not very successful, though!

  6. 6.

    This was far more realistic than the results reported by Torrens and McDaniel (2013), in which a large proportion of the virtual crowd ended up arrested.

  7. 7.

    The “combinatorial explosion problem” arises because the outcome of applying multiple rules depends on their sequence, which in turn may depend on the number of contexts. Therefore, programming the agents using exhaustive lists of rule sequences usually becomes unfeasible.

  8. 8.

    In Epstein’s model and in most ABM of “abstract” type based on spatial grids agents have random movement and the grid has torus geometry. This ensures that the probability of interactions between agents is the same for all grid cells.

  9. 9.

    In Epstein’s ABM “cops” have an extremely simple behavior, and it is in fact possible to implement an ABM with just “citizen” agents which has the same qualitative behavior as Epstein’s ABM. The improved “cop” behavior in “Protestlab” included implementing goal-directed movement, context rules to keep cordons and avoid encirclement, and in later stages the protection of specific cells according to orders by a “command” agent.

  10. 10.

    The model described in Epstein et al. (2001) and Epstein (2002) has two variants: rebellion against a central authority (Model I) and ethnic violence between two rival groups mediated by a central authority (Model II). Here only Model I will be considered.

  11. 11.

    If the level of repression is high and peacefully manifesting opposition to the government can lead to serious consequences, as occurs in authoritarian regimes, the decision to rebel or not can be described by the same basic mechanism of joining a riot, although the conditions (threshold and estimated arrest probability) may be different in both cases.

  12. 12.

    According to Epstein, bounding outcomes to plausible ranges and illuminating core uncertainties are two goals of modeling (Epstein 2008).

  13. 13.

    “Multi-role” and “offensive” cops tended to relinquish perimeter protection to pursue and arrest protesters; simulations with “cops” with these personalities (or mission profiles) resembled police charges to disperse protesters.

  14. 14.

    Mobilization is a complicated multi-stage process (Klandermans 1997), and it is very doubtful that it can be modeled as simple or complex contagion (see e.g. Dodds and Watts 2005 and Jackson 2010). It would also have been very difficult to determine the relative importance of each context (network layer) and come up with a plausible model for the agents’ decision of joining a protest.

  15. 15.

    The elements of the ODD protocol are summarized in Railsback and Grimm, Figure 3.1, page 37, and explained in pages 37–44 of Railsback and Grimm (2011). In pages 47–48 of the same reference, Railsback and Grimm present an example of a “summary ODD description” of a very simple ABM, with slightly different items than the ones suggested herein.

  16. 16.

    The need of modeling collectives even with ABMs of “abstract” type is one of the major differences between modeling ethnic conflict and conflict against a central authority. Also, since ethnic conflicts tend to be more violent, it is necessary to consider killing of agents, not just “jailing” them, and to introduce some form of population dynamics (Epstein 2002; Epstein et al. 2001).

  17. 17.

    In the development of “ProtestLab” this was provided by knowledge about the characteristics of the events to be simulated, and in the ABM described in the dissertation by the settings in several previous works. However, in many other situations it may not be possible to devise a “reference case.”

References

  • Barash, V. 2011. The dynamics of social contagion. PhD thesis, Faculty of the Graduate School.

    Google Scholar 

  • Bischof, D. 2012. Why arabs rebel – Relative deprivation revisited. Master’s thesis, Fakultät Sozial und Wirtschaftswissenschaften der Otto-Friedrich-Universität Bamberg.

    Google Scholar 

  • Cioffi-Revilla, C. 2017. Introduction to computational social science: Principles and applications, Texts in computer science, 2nd ed. Cham: Springer.

    Book  Google Scholar 

  • Collins, R. 2008. Violence. A micro-sociological theory. Princeton: Princeton University Press.

    Book  Google Scholar 

  • Collins, R. 2009. Micro and macro causes of violence. International Journal of Conflict and Violence 3(1): 9–22.

    Google Scholar 

  • Dodds, P., and D. Watts. 2005. A generalized model of social and biological contagion. Journal of Theoretical Biology 232: 587–604.

    Article  Google Scholar 

  • Dollard, J., L.W. Doob, N.E. Miller, O.H. Mowrer, and R.R. Sears. 1939. Frustration and aggression. New Haven: Yale University Press.

    Book  Google Scholar 

  • Doran, J. 2005. Iruba: An agent-based model of the Guerrilla war process. In Representing social reality, Volume pre-proceedings of the third conference of the European social simulation association (ESSA), Koblenz, ed. K.G. Troitzsch, 198–205. European Social Simulation Association. Koblenz: Germany.

    Google Scholar 

  • Epstein, J.M. 2002. Modeling civil violence: An agent-based computational approach. Proceedings of the National Academy of Sciences of the United States of America 99: 7243–7250.

    Article  Google Scholar 

  • Epstein, J.M. 2008. Why model? Journal of Artificial Societies and Social Simulation 11(4): 12. http://jasss.soc.surrey.ac.uk/11/4/12.html.

    Google Scholar 

  • Epstein, J.M. 2013. Agent_zero. Toward neurocognitive foundations for generative social science. Princeton: Princeton University Press.

    Google Scholar 

  • Epstein, J.M., J.D. Steinbruner, and M.T. Parker. 2001. Modeling civil violence: An agent-based computational approach. Center on Social and Economic Dynamics, Working Paper No. 20, Jan 2001.

    Google Scholar 

  • Fonoberova, M., V.A. Fonoberov, I. Mezic, J. Mezic, and P.J. Brantingham. 2012. Nonlinear dynamics of crime and violence in urban settings. Journal of Artificial Societies and Social Simulation 15(1): 2.

    Article  Google Scholar 

  • Freedom House. 2015. Freedom in the world, individual country ratings and status. https://freedomhouse.org/report-types/freedom-world. Accessed 13 July 2015.

    Google Scholar 

  • Gilbert, N. 2007. Agent-based models (Quantitative applications in the social sciences). Califormia: Thousand Oaks.

    Google Scholar 

  • Gilbert, N., and K.G. Troitzsch. 2005. Simulation for the social scientist, 2nd ed. New York: Open University Press.

    Google Scholar 

  • Gilley, B. 2006. The meaning and measure of state legitimacy: Results for 72 countries. European Journal of Political Science 45: 499–525.

    Article  Google Scholar 

  • Gilley, B. 2009. The right to rule. How states win and lose legitimacy. New York: Columbia University Press.

    Google Scholar 

  • Grimm, V., U. Bergern, D.L. DeAngelis, J.G. Polhill, J. Giskee, and S.F. Railsback. 2010. The ODD protocol: A review and first update. Ecological Modelling 221(221): 2760–2768.

    Article  Google Scholar 

  • Gurr, T.R. 1968. Psychological factors in civil violence. World Politics 20(2): 245–278.

    Article  Google Scholar 

  • Gurr, T.R. 2011. Why men rebel, Anniversary Edition. London: Paradigm Publishers.

    Google Scholar 

  • Hamill, J.T. 2012. Analysis of layered social networks. BiblioScholar. United States.

    Google Scholar 

  • Ilachinsky, A. 2004. Artificial war: Multiagent-based simulation of combat. River Edge: World Scientific Publishing Co. Pte. Ltd.

    Book  Google Scholar 

  • Jackson, M.O. 2010. Social and economic networks. Princeton: New Jersey.

    Book  Google Scholar 

  • Jager, W., R. Popping, and H. van de Sande. 2001. Clustering and fighting in two-party crowds: Simulating the approach-avoidance conflict. Journal of Artificial Societies and Social Simulation 4(3). http://jasss.soc.surrey.ac.uk/4/3/7.html.

  • Klandermans, B. 1997. The social psychology of protest. Cambridge: Massachusetts.

    Google Scholar 

  • Lemos, C.M. 2016. On agent-based modelling of large scale conflict against a central authority: From mechanisms to complex behaviour. PhD thesis, ISCTE – University Institute of Lisbon and Faculty of Sciences of the University of Lisbon.

    Google Scholar 

  • Lemos, C.M., H. Coelho, and R.J. Lopes. 2017. ProtestLab: A computational laboratory for studying street protests. In Advances in complex societal, environmental and engineered systems, Nonlinear systems and complexity, vol. 18, 3–29. Cham: Springer.

    Chapter  Google Scholar 

  • Lopes, Rui Jorge and Luis Antunes (Cord). 2017. International MSc and PhD Programs in Complexity Sciences. Accessed 2 Dec 2017.

    Google Scholar 

  • Lorenz, K. 2002. On aggression. London/New York: Routledge Classics.

    Google Scholar 

  • Macal, C.M., and M.J. North. 2010. Tutorial on agent-based modelling and simulation. Journal of Simulation 4(3): 151–162.

    Article  Google Scholar 

  • Milanovic, B. 2014. Description of “All the Ginis” Dataset Oct. 2014. The World Bank: Washington, DC.

    Google Scholar 

  • Miller, J.H., and S.L. Page. 2007. Complex adaptive systems. Princeton: Princeton University Press.

    Google Scholar 

  • Mobus, G.E., and M.C. Kalton. 2015. Principles of systems science. Springer: New York.

    Book  Google Scholar 

  • Moro, A. 2016. Understanding the dynamics of violent political revolutions in an agent-based framework. PLoS ONE 11(4): 1–17.

    Article  Google Scholar 

  • North, M.J., N.T. Collier, and J.R. Vos. 2006. Experiences creating three implementations of the repast agent modeling toolkit. ACM Transactions on Modeling and Computer Simulation 16(1): 1–25.

    Article  Google Scholar 

  • Reicher, S. 2001. The psychology of crowd dynamics. In Blackwell handbook of social psychology: Group processes, 182–208. Malden: Blackwell Publishing.

    Google Scholar 

  • Rummel, R.W. 1976. Understanding conflict and war volume 2: The conflict helix. Beverly Hills: SAGE Publications.

    Google Scholar 

  • Runciman, W.G. 1972. Relative deprivation and social justice. A study of attitudes to social inequality in twentieth century England. Harmondsworth: Penguin Books Ltd.

    Google Scholar 

  • Sayama, H. 2015. Introduction to the modeling and analysis of complex systems. Geneseo: New York.

    Google Scholar 

  • Sharp, G. 2010. From dictatorship to democracy, 4th ed. East Boston, MA: USA.

    Google Scholar 

  • Siegfried, R. 2014. Modeling and simulation of complex systems. A framework for efficient agent-based modeling and simulation. Wiesbaden: Springer.

    Google Scholar 

  • Squazzoni, F. 2012. Agent-based computational sociology. Hoboken: Wiley.

    Book  Google Scholar 

  • Railsback, Steven F., and Volker Grimm. 2011. Agent-based and individual-based modeling: A practical introduction. Princeton: Princeton University Press.

    Google Scholar 

  • The Fund for Peace. 2015. Fragile states index. http://fsi.fundforpeace.org/data. Accessed 9 Nov 2015.

  • The Robert S. Strauss Center. 2015. Social conflict analysis database. https://www.strausscenter.org/scad.html. Accessed 25 July 2015.

  • Thiele, J.C. 2014. R Marries NetLogo: Introduction to the RNetLogo package. Journal of Statistical Software 58(2): 1–41.

    Article  Google Scholar 

  • Torrens, P.M., and A.W. McDaniel. 2013. Modeling geographic behavior in riotous crowds. Annals of the Association of American Geographers 103(1): 20–46.

    Article  Google Scholar 

  • Wilensky, Uri, and William Rand. 2015. An introduction to agent-based modeling. Modeling natural, social, and engineered complex systems with NetLogo. Cambridge: The MIT Press.

    Google Scholar 

  • Wikström, P.-O.H., and K.H. Treiber. 2009. Violence as situational action. International Journal of Conflict and Violence 3(1): 75–96.

    Google Scholar 

  • Wilensky, U. 1999. NetLogo. Technical report, Center for Connected Learning and Computer-Based Modeling. Evanston: Northwestern University.

    Google Scholar 

  • Wilensky, U. 2004. NetLogo rebellion model. Evanston: Northwestern University.

    Google Scholar 

Download references

Acknowledgements

Funding by the Research Council of Norway (grant #250449) is gratefully acknowledged. I also wish to acknowledge the comments of three reviewers, which contributed significantly to the improvement of the manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Carlos M. Lemos .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Lemos, C.M. (2019). Pitfalls in the Development of Agent-Based Models in Social Sciences: Avoiding Them and Learning from Them. In: Diallo, S., Wildman, W., Shults, F., Tolk, A. (eds) Human Simulation: Perspectives, Insights, and Applications. New Approaches to the Scientific Study of Religion , vol 7. Springer, Cham. https://doi.org/10.1007/978-3-030-17090-5_3

Download citation

Publish with us

Policies and ethics