Data Driven Evaluation of Crowds

  • Alon Lerner
  • Yiorgos Chrysanthou
  • Ariel Shamir
  • Daniel Cohen-Or
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5884)


There are various techniques for simulating crowds, however, in most cases the quality of the simulation is measured by examining its “look-and-feel”. Even if the aggregate movement of the crowd looks natural from afar, the behaviors of individuals might look odd when examined more closely. In this paper we present a data-driven approach for evaluating the behaviors of individuals within a simulated crowd. Each decision of an individual agent is expressed as a state-action pair, which stores a representation of the characteristics being evaluated and the factors that influence it. Based on video footage of a real crowd, a database of state-action examples is generated. Using a similarity measure, the queries are matched with the database of examples. The degree of similarity can be interpreted as the level of “naturalness” of the behavior. Essentially, this sort of evaluation offers an objective answer to the question of how similar are the simulated behaviors compared to real ones. By changing the input video we can change the context of evaluation.


Multiagent System Computer Animation Input Video Trajectory Segment Dense Crowd 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Brand, M., Kettnaker, V.: Discovery and segmentation of activities in video. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(8), 844–851 (2000)CrossRefGoogle Scholar
  2. 2.
    Chenney, S.: Flow tiles. In: Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation, pp. 233–242. Eurographics Association Aire-la-Ville, Switzerland (2004)CrossRefGoogle Scholar
  3. 3.
    Ennis, C., Peters, C., O’Sullivan, C.: Perceptual evaluation of position and orientation context rules for pedestrian formations. In: Proceedings of the 5th symposium on Applied perception in graphics and visualization, USA, pp. 75–82. ACM New York, NY (2008)CrossRefGoogle Scholar
  4. 4.
    Hu, W., Xiao, X., Fu, Z., Xie, D., Tan, T., Maybank, S.: A system for learning statistical motion patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(9), 1450–1464 (2006)CrossRefGoogle Scholar
  5. 5.
    Hughes, R.L.: The Flow of Human Crowds. Annual Review of Fluid Mechanics 35, 169–182 (2003)CrossRefGoogle Scholar
  6. 6.
    Johnson, N., Hogg, D.: Learning the distribution of object trajectories for event recognition. In: BMVC 1995: Proceedings of the 6th British conference on Machine vision, Surrey, UK, vol. 2, pp. 583–592. BMVA Press (1995)Google Scholar
  7. 7.
    Lamarche, F., Donikian, S.: Crowd of virtual humans: a new approach for real time navigation in complex and structured environments. Comput. Graph. Forum 23(3), 509–518 (2004)CrossRefGoogle Scholar
  8. 8.
    Lee, K.H., Choi, M.G., Hong, Q., Lee, J.: Group behavior from video: a data-driven approach to crowd simulation. In: Proceedings of the 2007 ACM SIGGRAPH/Eurographics symposium on Computer animation, pp. 109–118 (2007)Google Scholar
  9. 9.
    Lerner, A., Chrysanthou, Y., Lischinski, D.: Crowds by Example. Computer Graphics Forum 26(3), 655–664 (2007)CrossRefGoogle Scholar
  10. 10.
    Paris, S., Pettre, J., Donikian, S.: Pedestrian Reactive Navigation for Crowd Simulation: a Predictive Approach. Computer Graphics Forum 26(3), 665–674 (2007)CrossRefGoogle Scholar
  11. 11.
    Pelechano, N., Allbeck, J., Badler, N.: Virtual Crowds: Methods, Simulation, and Control. Synthesis Lectures on Computer Graphics and Animation. Morgan & Claypool Publishers, San Francisco (2008)Google Scholar
  12. 12.
    Pelechano, N., Stocker, C., Allbeck, J., Badler, N.: Being a part of the crowd: towards validating VR crowds using presence. In: Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems, International Foundation for Autonomous Agents and Multiagent Systems Richland, SC, vol. 1, pp. 136–142 (2008)Google Scholar
  13. 13.
    Porikli, F.: Trajectory distance metric using hidden markov model based representation. In: IEEE European Conference on Computer Vision, PETS Workshop (2004)Google Scholar
  14. 14.
    Porikli, F., Haga, T.: Event detection by eigenvector decomposition using object and frame features. In: CVPRW 2004: Proceedings of the, Conference on Computer Vision and Pattern Recognition Workshop (CVPRW 2004), vol. 7, p. 114. IEEE Computer Society Press, Los Alamitos (2004)CrossRefGoogle Scholar
  15. 15.
    Reitsma, P.S.A., Pollard, N.S.: Evaluating motion graphs for character navigation. In: Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation, pp. 89–98. Eurographics Association Aire-la-Ville, Switzerland (2004)CrossRefGoogle Scholar
  16. 16.
    Singh, S., Naik, M., Kapadia, M., Faloutsos, P., Reinman, G.: Watch Out! A Framework for Evaluating Steering Behaviors. In: Egges, A., Kamphuis, A., Overmars, M. (eds.) MIG 2008. LNCS, vol. 5277, p. 200. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  17. 17.
    Sud, A., Andersen, E., Curtis, S., Lin, M., Manocha, D.: Realtime path planning for virtual agents in dynamic environments. In: Proc. of IEEE VR (2007)Google Scholar
  18. 18.
    Thalmann, D., Musse, S.R.: Crowd Simulation. Springer, Heidelberg (2007)Google Scholar
  19. 19.
    Treuille, A., Cooper, S., Popovic, Z.: Continuum crowds. ACM Trans. Graph. 25(3), 1160–1168 (2006)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Alon Lerner
    • 1
  • Yiorgos Chrysanthou
    • 2
  • Ariel Shamir
    • 3
  • Daniel Cohen-Or
    • 1
  1. 1.Tel Aviv UniversityIsrael
  2. 2.University of CyprusCyprus
  3. 3.The Interdisciplinary CenterIsrael

Personalised recommendations