Towards Validating Social Network Simulations

  • Syed Muhammad Ali Abbas
  • Shah Jamal Alam
  • Bruce Edmonds
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 229)


We consider the problem of finding suitable measures to validate simulated networks as outcome of (agent-based) social simulations. A number of techniques from computer science and social sciences are reviewed in this paper, which tries to compare and ‘fit’ various simulated networks to the available data by using network measures. We look at several social network analysis measures but then turn our focus to techniques that not only consider the position of the nodes but also their characteristics and their tendency to cluster with other nodes in the network – subgroup identification. We discuss how static and dynamic nature of networks may be compared. We conclude by urging a more comprehensive, transparent and rigorous approach to comparing simulation-generated networks against the available data.


networks validation measures ABM underdetermination 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Abbas, S.: An agent-based model of the development of friendship links within Facebook. In: Seventh European Social Simulation Association Conference (2011)Google Scholar
  2. 2.
    Abbas, S.: Homophily, Popularity and Randomness: Modelling Growth of Online Social Network. In: Proc. of the Twelfth International Joint Conference on Autonomous Agents and Multi-agent Systems, St. Paul, USA (2013)Google Scholar
  3. 3.
    Abbas, S.: An agent-based model of the development of friendship links within Facebook. J. of Computational and Mathematical Organization Theory, 1–21 (2013)Google Scholar
  4. 4.
    Alam, S.J., Edmonds, B., Meyer, R.: Identifying Structural Changes in Networks Generated from Agent-based Social Simulation Models. In: Ghose, A., Governatori, G., Sadananda, R. (eds.) PRIMA 2007. LNCS (LNAI), vol. 5044, pp. 298–307. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  5. 5.
    Alam, S.J., Geller, A.: Networks in agent-based social simulation. In: Heppenstall, A.J., et al. (eds.) Agent-Based Models of Geographical Systems, pp. 199–216. Springer (2012)Google Scholar
  6. 6.
    Amblard, F., Quattrociocchi, W.: Social Networks and Spatial Distribution. In: Edmonds, B., Meyer, R. (eds.) Simulating Social Complexity: Understanding Complex Systems 2013, pp. 401–430. Springer (2013)Google Scholar
  7. 7.
    Alt, J.K., Lieberman, S.: Representing Dynamic Social Networks in Discrete Event Social Simulation. In: Proc. 2010 Winter Simulation Conference, pp. 1478–1489 (2010)Google Scholar
  8. 8.
    Asur, S., Parthasarathy, S., Ucar, D.: An event-based framework for characterizing the evolutionary behavior of interaction graphs. In: Proc. of the Thirteenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 913–921 (2007)Google Scholar
  9. 9.
    Bagrow, J.P., Bollt, E.M., Skufca, J.D.: Portraits of complex networks. Europhysics Letters 81, 68004 (2008)CrossRefGoogle Scholar
  10. 10.
    Blondel, V., Guillaume, J.: Fast unfolding of communities in large networks. Journal of Statistical Mechanics: Theory and Experiment 10008 (2008)Google Scholar
  11. 11.
    Borgatti, S.P., Carley, K.M., Krackhardt, D.: On the Robustness of Centrality Measures under Conditions of Imperfect Data. Social Networks 28, 124–136 (2006)CrossRefGoogle Scholar
  12. 12.
    Bornholdt, S.: Statistical Mechanics of Community Detection. Physical Review E 74, 016110 (2008)Google Scholar
  13. 13.
    Burk, W.J., Steglich, C.E.G., Snijders, T.A.B.: Beyond dyadic interdependence: Actor-oriented models for co-evolving social networks and individual behaviors. International Journal of Behavioral Development 31 (2007)Google Scholar
  14. 14.
    Carley, K.M.: Dynamic Network Analysis. In: Dynamic Social Network Modeling and Analysis: Workshop Summary and Papers, Committee on Human Factors, pp. 133–145. National Research Council (2003)Google Scholar
  15. 15.
    deNooy, W., Mrvar, A., Batagelj, V.: Exploratory Social Network Analysis with Pajek, 2nd edn. Cambridge University Press, Cambridge (2012)Google Scholar
  16. 16.
    Epstein, J., Axtell, R.: Growing Artificial Societies: Social Science from the Bottom Up. The MIT Press, Boston (1996)Google Scholar
  17. 17.
    Faust, K.: Comparing Social Networks: Size, Density, and Local Structure. Metodološkizveski 3(2), 185–216 (2006)Google Scholar
  18. 18.
    Frantz, T.L., Carley, K.M.: Relating Network Topology to the Robustness of Centrality Measures. CASOS technical report CMU-ISRI-05-117 (2005),
  19. 19.
    Hales, D., Arteconi, S.: Motifs in Evolving Cooperative Networks Look Like Protein Structure Networks. Networks and Heterogeneous Media 3(2), 239–249 (2008)MathSciNetCrossRefzbMATHGoogle Scholar
  20. 20.
    Hamill, L., Gilbert, G.: A Simple but More Realistic Agent-based Model of a Social Network. In: Fifth European Social Simulation Association Conference, Brescia, Italy (2008)Google Scholar
  21. 21.
    Kermack, W.O., McKendrick, A.G.: Contributions to the mathematical theory of epidemics. part I. Proceedings of the Royal Society A 115, 700–721 (1927)CrossRefzbMATHGoogle Scholar
  22. 22.
    Krackhardt, D.: QAP Partialling as a Test of Spuriousness. Social Networks 9, 171–186 (1987)MathSciNetCrossRefGoogle Scholar
  23. 23.
    Krackhardt, D., Stern, R.N.: Informal Networks and Organizational Crises: An Experimental Simulation. Social Psychology 51(2), 123–140 (2011)Google Scholar
  24. 24.
    Legendi, R.O., Gulyas, L.: Effects of Time-Dependent Edge Dynamics on Properties of Cumulative Networks. In: Emergent Properties in Natural and Artificial Complex Systems, Vienna, Austria, pp. 29–36 (2011)Google Scholar
  25. 25.
    Macindoe, O., Richards, W.: Graph Comparison Using Fine Structure Analysis. In: IEEE Second International Conference on Social Computing, pp. 193–200 (2010)Google Scholar
  26. 26.
    McCulloh, I., Carely, K.M.: Detecting Change in Longitudinal Social Networks. Journal of Social Structure 12 (2009)Google Scholar
  27. 27.
    McCulloh, I., Norvell, J.A., Carley, K.M.: Spectral Analysis of Social Networks to Identify Periodicity. Journal of Mathematical Sociology 36(2), 80–96 (2012)MathSciNetCrossRefGoogle Scholar
  28. 28.
    Milo, R., Shen-Orr, S., Itzkovitz, S., et al.: Network Motifs: Simple Building Blocks of Complex Networks. Science 298, 824–827 (2002)CrossRefGoogle Scholar
  29. 29.
    Mislove, A., Marcon, M., Gummadi, K.P., et al.: Measurement and analysis of online social networks. In: Proc. of the Seventh ACM SIGCOMM Conference on Internet Measurement (IMC 2007), pp. 29–42. ACM, New York (2007)CrossRefGoogle Scholar
  30. 30.
    Moss, S., Edmonds, B.: Sociology and Simulation: Statistical and Qualitative Cross-Validation. American Journal of Sociology 110(4), 1095–1131 (2005)CrossRefGoogle Scholar
  31. 31.
    Newman, M.E.J.: Networks: An Introduction. Oxford University Press, USA (2010)CrossRefGoogle Scholar
  32. 32.
    Newman, M.E.J.: Networks: Assortative mixing in networks. Physics Review Letters 89, 208701 (2002)CrossRefGoogle Scholar
  33. 33.
    Newman, M.E.J., Girvan, M.: Finding and evaluating community structure in networks. Physics Review E 69(2), 026113 (2004)Google Scholar
  34. 34.
    Observable Universe. Wikipedia (n.d.), (retrieved on January 28, 2013)
  35. 35.
    Papadopoulos, F., Kitsak, M., Serrano, M.A., et al.: Popularity versus similarity in growing networks. Nature 2012, 537–540 (2012)Google Scholar
  36. 36.
    Snijders, T.A.B.: Longitudinal Methods of Network Analysis. In: Meyers, B. (ed.) Encyclopedia of Complexity and System Science, pp. 5998–6013. Springer (2008)Google Scholar
  37. 37.
    Wasserman, S., Faust, K.: Social Network Analysis: Methods and Applications. Cambridge University Press (1994)Google Scholar
  38. 38.
    Watts, D.J., Dodds, P.S., Newman, M.E.J.: Identity and search in social networks. Science 296, 1302–1305 (2002)CrossRefGoogle Scholar
  39. 39.
    Wellman, B., Potter, S.: The Elements of Personal Communities. In: Wellman, B. (ed.) Networks in the Global Village. Westview Press, Boulder Co. (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  • Syed Muhammad Ali Abbas
    • 1
  • Shah Jamal Alam
    • 2
  • Bruce Edmonds
    • 1
  1. 1.Centre for Policy ModellingManchester Metropolitan UniversityManchesterUK
  2. 2.School of GeosciencesUniversity of EdinburghEdinburghUK

Personalised recommendations