Viewing the Viewers: A Novel Challenge for Automated Crowd Analysis

  • Davide Conigliaro
  • Francesco Setti
  • Chiara Bassetti
  • Roberta Ferrario
  • Marco Cristani
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8158)


We focus on the automated analysis of spectator crowd, that is, people watching sport contests alive (in stadiums, amphitheaters etc.), or, more generally, people “watching the activities of an event […] interested in watching something specific that they came to see” [2]. This scenario differs substantially from the typical crowd analysis setting (e.g. pedestrians): here the dynamics of humans is more constrained, due to the architectural environments in which they are situated; people are expected to stay in a fixed location most of the time, limiting their activities to applaud, support/heckle the players or discuss with the neighbors. In this paper, we start facing this challenge by following a social signal processing approach, which grounds computer vision techniques in social theories. More specifically, leveraging on social theories describing expressive bodily conduct, we will show how, by using computer vision techniques, it is possible to distinguish fan groups belonging to different teams by automatically detecting their liveliness in different moments of the match, even when they are merged in the stands. Moreover, we will show how, only by automatically detecting crowd’s motions on the stands, it is possible to single out the most salient events of the match, like goals, fouls or shots on goal.


spectator crowd crowd analysis spatio-temporal clustering 


  1. 1.
    Andrade, E.L., Blunsden, S., Fisher, R.B.: Modelling crowd scenes for event detection. In: ICPR, pp. 175–178 (2006),
  2. 2.
    Berlonghi, A.: Undestanding and planning for different spectator crowds. Safety Science 18, 239–247 (1995)CrossRefGoogle Scholar
  3. 3.
    Chan, A.B., Vasconcelos, N.: Bayesian poisson regression for crowd counting. In: ICCV, pp. 545–551 (2009)Google Scholar
  4. 4.
    Cristani, M., Murino, V., Vinciarelli, A.: Socially intelligent surveillance and monitoring: Analysing social dimensions of physical space. In: CVPRW, pp. 51–58 (2010)Google Scholar
  5. 5.
    Cristani, M., Pesarin, A., Vinciarelli, A., Crocco, M., Murino, V.: Look at who’s talking: Voice activity detection by automated gesture analysis. In: AML Workshops, pp. 72–80 (2011)Google Scholar
  6. 6.
    Figueiredo, M., Jain, A.: Unsupervised learning of finite mixture models. PAMI 24(3), 381–396 (2002)CrossRefGoogle Scholar
  7. 7.
    Goffman, E.: Behaviour in Public Places. Free Press of Glencloe. Notes on the Social Organization of Gatherings (1963)Google Scholar
  8. 8.
    Goldstein, J., Arms, R.: Effects of observing athletic contests on ostility. Sociometry 34(1), 83–90 (1971)CrossRefGoogle Scholar
  9. 9.
    Guyot, G.W., Byrd, G.R., Caudle, R.: Classroom setting: An expression of situational territoriality in humans. Small Group Behavior 11, 120–128 (1980)CrossRefGoogle Scholar
  10. 10.
    Heath, C., Hindmarsh, J., Luff, P.: Video in Qualitative Research. Analysing Social Interaction in Everyday Life. Sage, London (2010)Google Scholar
  11. 11.
    Kaya, N., Burgess, B.: Territoriality: Seat preferences in different types of classroom arrangements. Environment and Behavior 39(6), 859–876 (2007)CrossRefGoogle Scholar
  12. 12.
    Kratz, L., Nishino, K.: Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models. In: CVPR, pp. 1446–1453 (2009)Google Scholar
  13. 13.
    Kratz, L., Nishino, K.: Tracking with local spatio-temporal motion patterns in extremely crowded scenes. In: CVPR, pp. 693–700 (2010)Google Scholar
  14. 14.
    Laptev, I.: On space-time interest points. Int. J. Comput. Vision 64(2-3), 107–123 (2005), CrossRefGoogle Scholar
  15. 15.
    Mahadevan, V., Li, W., Bhalodia, V., Vasconcelos, N.: Anomaly detection in crowded scenes. In: CVPR, pp. 1975–1981 (2010)Google Scholar
  16. 16.
    Raghavendra, R., Del Bue, A., Cristani, M., Murino, V.: Abnormal crowd behavior detection by social force optimization. In: HBU, pp. 134–145 (2011),
  17. 17.
    Roadburg, A.: Factors precipitating fan violence: a comparison of professional soccer in britain and north america. The British Journal of Sociology 31(2), 265–276 (1980)CrossRefGoogle Scholar
  18. 18.
    Sand, P., Teller, S.: Particle video: Long-range motion estimation using point trajectories. Int. J. Comput. Vision 80(1), 72–91 (2008), CrossRefGoogle Scholar
  19. 19.
    Zhan, B., Monekosso, D., Remagnino, P., Velastin, S., Xu, L.Q.: Crowd analysis: A survey. Machine Vision Applications 19(5-6), 345–357 (2008), CrossRefzbMATHGoogle Scholar
  20. 20.
    Zhong, H., Shi, J., Visontai, M.: Detecting unusual activity in video. In: CVPR, pp. 819–826 (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Davide Conigliaro
    • 1
    • 2
  • Francesco Setti
    • 2
  • Chiara Bassetti
    • 2
  • Roberta Ferrario
    • 2
  • Marco Cristani
    • 1
    • 3
  1. 1.Università degli Studi di VeronaVeronaItaly
  2. 2.ISTC–CNRPovoItaly
  3. 3.Istituto Italiano di Tecnologia (IIT)GenovaItaly

Personalised recommendations