ATTENTO: ATTENTion Observed for Automated Spectator Crowd Analysis

  • Davide Conigliaro
  • Francesco Setti
  • Chiara Bassetti
  • Roberta Ferrario
  • Marco Cristani
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8212)


We propose a new type of crowd analysis, focused on the spectator crowd, that is, people “interested in watching something specific that they came to see” [1]. This scenario applies on stadiums, amphitheaters etc., and shares some aspects with classical crowd monitoring: actually, many people are simultaneously observed, so that per-person analysis is hard; however, here the dynamics of humans is more constrained, due to the architectural environment in which they are situated; specifically, people are expected to stay in a fixed location most of the time, limiting their activities to applaud, support/heckle the players or discuss with the neighbors. In this paper, we start facing this challenge by considering hockey matches, locating a videocamera 25-30 meters far from the bleachers, pointing at the crowd: in this scenario, aggregations of spectators that exhibit similar behavior are detected, and the behavior is classified into a set of predefined classes, highlighting the overall excitement. To these aims, in a first step we focus on individual frames, clustering local flow measures into spatial regions. The clustering is then extended by adding the temporal axis into the analysis, looking for non-randomic spatio-temporal clusters; for this purpose, the Lempel-Ziv complexity is considered. This way, choral activities can emerge, indicating for example fan groups belonging to different teams. After this, with the adoption of entropic measures, the degree of excitement of such groups can be quantified.


spectator crowd Lempel-Ziv complexity spatio-temporal clustering 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Berlonghi, A.: Undestanding and planning for different spectator crowds. Safety Science 18, 239–247 (1995)CrossRefGoogle Scholar
  2. 2.
    Mehran, R., Oyama, A., Shah, M.: Abnormal crowd behavior detection using social force model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 935–942 (2009)Google Scholar
  3. 3.
    Raghavendra, R., Del Bue, A., Cristani, M., Murino, V.: Abnormal crowd behavior detection by social force optimization. In: Salah, A.A., Lepri, B. (eds.) HBU 2011. LNCS, vol. 7065, pp. 134–145. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  4. 4.
    Zhong, H., Shi, J., Visontai, M.: Detecting unusual activity in video. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 819–826 (2004)Google Scholar
  5. 5.
    Kratz, L., Nishino, K.: Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1446–1453 (2009)Google Scholar
  6. 6.
    Andrade, E.L., Blunsden, S., Fisher, R.B.: Modelling crowd scenes for event detection. In: Proceedings of the 18th International Conference on Pattern Recognition (ICPR), vol. 1, pp. 175–178. IEEE Computer Society, Washington, DC (2006)CrossRefGoogle Scholar
  7. 7.
    Laptev, I.: On space-time interest points. International Journal of Computer Vision (IJCV) 64(2-3), 107–123 (2005)CrossRefGoogle Scholar
  8. 8.
    Mahadevan, V., Li, W., Bhalodia, V., Vasconcelos, N.: Anomaly detection in crowded scenes. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1975–1981 (2010)Google Scholar
  9. 9.
    Guyot, G.W., Byrd, G.R., Caudle, R.: Classroom setting: An expression of situational territoriality in humans. Small Group Research 11, 120–128 (1980)CrossRefGoogle Scholar
  10. 10.
    Kaya, N., Burgess, B.: Territoriality. seat preferences in different types of classroom arrangements. Environment and Behavior (EAB) 39(6), 859–876 (2007)CrossRefGoogle Scholar
  11. 11.
    Goffman, E.: Behaviour in Public Places. Notes on the Social Organization of Gatherings. Free Press of Glencloe., New York (1963)Google Scholar
  12. 12.
    Roadburg, A.: Factors precipitating fan violence: a comparison of professional soccer in britain and north america. The British Journal of Sociology (BJS) 31(2), 265–276 (1980)CrossRefGoogle Scholar
  13. 13.
    Goldstein, J.H., Arms, R.L.: Effects of observing athletic contests on ostility. Sociometry 34(1), 83–90 (1971)CrossRefGoogle Scholar
  14. 14.
    Vinciarelli, A., Pantic, M., Bourlard, H.: Social Signal Processing: Survey of an emerging domain. Image and Vision Computing 27(12), 1743–1759 (2009)CrossRefGoogle Scholar
  15. 15.
    Cristani, M., Murino, V., Vinciarelli, A.: Socially intelligent surveillance and monitoring: Analysing social dimensions of physical space. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 51–58 (2010)Google Scholar
  16. 16.
    Cristani, M., Raghavendra, R., Del Bue, A., Murino, V.: Human behavior analysis in video surveillance: A social signal processing perspective. Neurocomputing 100, 86–97 (2013)CrossRefGoogle Scholar
  17. 17.
    Figueiredo, M.A.T., Jain, A.: Unsupervised learning of finite mixture models. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 24(3), 381–396 (2002)CrossRefGoogle Scholar
  18. 18.
    Kaspar, F., Schuster, H.G.: Easily calculable measure for the complexity of spatiotemporal patterns. Physical Review A 36, 842–848 (1987)MathSciNetCrossRefGoogle Scholar
  19. 19.
    Schweingruber, D., MacPheil, C.: A method for systematically observing and recording collective action. Sociological Methods Research (SMR) 27(4), 451–498 (1999)CrossRefGoogle Scholar
  20. 20.
    McPhail, C.: From clusters to arcs and rings: Elementary forms of sociation in temporary gatherings. Research in Community Sociology (suppl. 1), 35–57 (1994)Google Scholar
  21. 21.
    Atkinson, J.M.: Public speaking and audience responses: some techniques for inviting audience applause. In: Maxwell Atkinson, J., J.H., (eds.) Structures of Social Action: Studies in Conversation Analysis, pp. 370–407. Cambridge University Press, Cambridge (1984)Google Scholar
  22. 22.
    McDonald, M.A., Milne, G.R., Hong, J.: Motivational factors for evaluating sport spectator and participant markets. Sport Marketing Quarterly (SMQ) 11(2), 100–113 (2002)Google Scholar
  23. 23.
    Bowker, A., Boekhoven, B., Nolan, A., Bauhaus, S., Glover, P., Powell, T., Taylor, S.: Naturalistic observations of spectator behavior at youth hockey games. The Sport Psychologist (TSP) 23, 301–316 (2009)Google Scholar
  24. 24.
    Halkidi, M., Batistakis, Y., Vazirgiannis, M.: On clustering validation techniques. Journal of Intelligent Information Systems (JIIS) 17(2-3), 107–145 (2001)CrossRefzbMATHGoogle Scholar
  25. 25.
    Wang, K., Wang, B., Peng, L.: Cvap: Validation for cluster analyses. Data Science Journal 8, 88–93 (2009)MathSciNetCrossRefGoogle Scholar
  26. 26.
    Hall, E.T.: Handbook for proxemic research. Anthropology News 36(2), 40–40 (1995)CrossRefGoogle Scholar
  27. 27.
    Cristani, M., Paggetti, G., Vinciarelli, A., Bazzani, L., Menegaz, G., Murino, V.: Towards computational proxemics: Inferring social relations from interpersonal distances. In: SocialCom/PASSAT, pp. 290–297 (2011)Google Scholar
  28. 28.
    Heath, C., Hindmarsh, J., Luff, P.: Video in Qualitative Research. Analysing Social Interaction in Everyday Life. Sage, London (2010)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2013

Authors and Affiliations

  • Davide Conigliaro
    • 1
    • 2
  • Francesco Setti
    • 2
  • Chiara Bassetti
    • 2
  • Roberta Ferrario
    • 2
  • Marco Cristani
    • 1
    • 3
  1. 1.Verona UniversityItaly
  2. 2.Institute of Cognitive Sciences and Technologies, CNRItaly
  3. 3.Italian Institute of Technology, IITItaly

Personalised recommendations