, Volume 23, Issue 4, pp 501–531 | Cite as

A versatile computational framework for group pattern mining of pedestrian trajectories

  • Abdullah SawasEmail author
  • Abdullah Abuolaim
  • Mahmoud Afifi
  • Manos Papagelis


Mining patterns of large-scale trajectory data streams has been of increase research interest. In this paper, we are interested in mining group patterns of moving objects. Group pattern mining describes a special type of trajectory mining task that requires to efficiently discover trajectories of objects that are found in close proximity to each other for a period of time. In particular, we focus on trajectories of pedestrians coming from motion video analysis and we are interested in interactive analysis and exploration of group dynamics, including various definitions of group gathering and dispersion. Traditional approaches to solve the problem adhere to strict definition of group semantics. That restricts their application to specific problems and renders them inadequate for many real-world scenarios. To address this limitation, we propose a novel versatile method, timeWgroups, for efficient discovery of pedestrian groups that can adhere to different pattern semantics. First, the method efficiently discovers pairs of pedestrians that move together over time, under varying conditions of space and time. Subsequently, pairs of pedestrians are used as a building block for effectively discovering groups of pedestrians that can satisfy versatile group pattern semantics. As such, the proposed method can accommodate many different scenarios and application requirements. In addition, we introduce a new group pattern, individual perspective grouping that focuses on how individuals perceive groups. Based on the new group pattern we define the concept of dominant groups, a global metric for defining important groups that respects the individual perspective group pattern. Through experiments on real data, we demonstrate the effectiveness of our methods on discovering group patterns of pedestrian trajectories against sensible baselines, for a varying range of conditions. Furthermore, a query-based search method is provided that allows for interactive exploration and analysis of group dynamics over time and space. In addition, a visual testing is performed on real motion video to assert the group dynamics discovered by our methods.


Trajectory mining Group pattern mining Pedestrian behavior 



This research has been partially supported by a Natural Sciences and Engineering Research Council of Canada (NSERC) Discovery Grant (#RGPIN-2017-05680).


  1. 1.
    Abuolaim A, Leow WK, Varadarajan J, Ahuja N (2017) On the essence of unsupervised detection of anomalous motion in surveillance videos. In: International Conference on Computer Analysis of Images and Patterns, pp 160–171CrossRefGoogle Scholar
  2. 2.
    Andriluka M, Roth S, Schiele B (2008) People-tracking-by-detection and people-detection-by-tracking. In: Computer vision and Pattern Recognition (CVPR), pp 1–8Google Scholar
  3. 3.
    Bae SH, Yoon KJ (2014) Robust online multiobject tracking with data association and track management. IEEE Trans Image Process 23(7):2820–2833CrossRefGoogle Scholar
  4. 4.
    Bastani V, Campo D, Marcenaro L, Regazzoni C (2015) Online pedestrian group walking event detection using spectral analysis of motion similarity graph. In: International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp 1–5Google Scholar
  5. 5.
    Benkert M, Gudmundsson J, Hübner F, Wolle T (2008) Reporting flock patterns. Comput Geom 41(3):111–125CrossRefGoogle Scholar
  6. 6.
    Brščić D, Zanlungo F, Kanda T (2017) Modelling of pedestrian groups and application to group recognition. In: International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), pp 564–569Google Scholar
  7. 7.
    Cartwritht D, Zander A (1960) Group dynamics. Harper and Row, New YorkGoogle Scholar
  8. 8.
    Dollar P, Wojek C, Schiele B, Perona P (2012) Pedestrian detection: an evaluation of the state of the art. IEEE Trans Pattern Anal Mach Intell 34(4):743–761CrossRefGoogle Scholar
  9. 9.
    Ester M, Kriegel HP, Sander J, Xu X, et al. (1996) A density-based algorithm for discovering clusters in large spatial databases with noise. In: KDD, vol 96, pp 226–231Google Scholar
  10. 10.
    Fan Q, Zhang D, Wu H, Tan KL (2016) A general and parallel platform for mining co-movement patterns over large-scale trajectories. Proceed VLDB Endowment 10(4):313–324CrossRefGoogle Scholar
  11. 11.
    Faugeras O (1993) Three-dimensional computer vision: a geometric viewpoint. MIT Press, CambridgeGoogle Scholar
  12. 12.
    Gaffney S, Smyth P (1999) Trajectory clustering with mixtures of regression models. In: Knowledge Discovery and Data Mining (SIGKDD), pp 63–72Google Scholar
  13. 13.
    Guo D, Liu S, Jin H (2010) A graph-based approach to vehicle trajectory analysis. J Locat Based Serv 4(3-4):183–199CrossRefGoogle Scholar
  14. 14.
    Hwang S, Park J, Kim N, Choi Y, So Kweon I (2015) Multispectral pedestrian detection: Benchmark dataset and baseline. In: Computer Vision and Pattern Recognition (CVPR), pp 1037–1045Google Scholar
  15. 15.
    Jeung H, Shen HT, Zhou X (2008) Convoy queries in spatio-temporal databases. In: International Conference on Data Engineering (ICDE), pp 1457–1459Google Scholar
  16. 16.
    Jeung H, Yiu ML, Zhou X, Jensen CS, Shen HT (2008) Discovery of convoys in trajectory databases. Proc VLDB Endowment 1(1):1068–1080CrossRefGoogle Scholar
  17. 17.
    Kalnis P, Mamoulis N, Bakiras S (2005) On discovering moving clusters in spatio-temporal data. In: Spatial and Temporal Databases (SSTD), pp 364–381Google Scholar
  18. 18.
    Lan R, Yu Y, Cao L, Song P, Wang Y (2017) Discovering evolving moving object groups from massive-scale trajectory streams. In: Mobile Data Management (MDM), pp 256–265Google Scholar
  19. 19.
    Le Bon G (1921) The Crowd: A study of the popular mind. Macmillan New York, New YorkGoogle Scholar
  20. 20.
    Lee JG, Han J, Whang KY (2007) Trajectory clustering: a partition-and-group framework. In: Proceedings of the international conference on Management of data (SIGMOD). ACM, pp 593–604Google Scholar
  21. 21.
    Lerner A, Chrysanthou Y, Lischinski D (2007) Crowds by example. In: Computer Graphics Forum, vol 26, pp 655–664CrossRefGoogle Scholar
  22. 22.
    Moussaïd M, Perozo N, Garnier S, Helbing D, Theraulaz G (2010) The walking behaviour of pedestrian social groups and its impact on crowd dynamics. PloS one 5(4):e10047CrossRefGoogle Scholar
  23. 23.
    Nanopoulos A, Theodoridis Y, Manolopoulos Y (2001) C2p: clustering based on closest pairs. In: VLDB, pp 331–340Google Scholar
  24. 24.
    Pelekis N, Tampakis P, Vodas M, Doulkeridis C, Theodoridis Y (2017) On temporal-constrained sub-trajectory cluster analysis. Data Min Knowl Disc 31:1294–1330CrossRefGoogle Scholar
  25. 25.
    Rupasinghe R, Senanayake S, Padmasiri D, Ekanayake M, Godaliyadda G, Wijayakulasooriya J (2016) Modes of clustering for motion pattern analysis in video surveillance. In: Information and Automation for Sustainability (ICIAfs), pp 1–6Google Scholar
  26. 26.
    Sakr MA, Güting RH (2014) Group spatiotemporal pattern queries. GeoInformatica 18(4):699–746CrossRefGoogle Scholar
  27. 27.
    Sawas A, Abuolaim A, Afifi M, Papagelis M (2018) Tensor methods for group pattern discovery of pedestrian trajectories. In: 2018 19Th IEEE International Conference on Mobile Data Management (MDM), pp 76–85. IEEEGoogle Scholar
  28. 28.
    Sawas A, Abuolaim A, Afifi M, Papagelis M (2018) Trajectolizer: Interactive analysis and exploration of trajectory group dynamics. In: Mobile Data Management (MDM), pp 286–287Google Scholar
  29. 29.
    Shu G, Dehghan A, Oreifej O, Hand E, Shah M (2012) Part-based multiple-person tracking with partial occlusion handling. In: Computer Vision and Pattern Recognition (CVPR), pp 1815–1821Google Scholar
  30. 30.
    Siła-Nowicka K, Vandrol J, Oshan T, Long JA, Demšar U, Fotheringham AS (2016) Analysis of human mobility patterns from gps trajectories and contextual information. Int J Geogr Inf Sci 30(5):881–906CrossRefGoogle Scholar
  31. 31.
    Solera F, Calderara S, Cucchiara R (2016) Socially constrained structural learning for groups detection in crowd. IEEE Trans Pattern Anal Mach Intell 38 (5):995–1008CrossRefGoogle Scholar
  32. 32.
    Vilain M, Burger J, Aberdeen J, Connolly D, Hirschman L (1995) A model-theoretic coreference scoring scheme. In: Proceedings of the 6th Conference on Message Understanding. Association for Computational Linguistics, pp 45–52Google Scholar
  33. 33.
    Volkhardt M, Schneemann F, Gross HM (2013) Fallen person detection for mobile robots using 3d depth data. In: International Conference on Systems, Man, and Cybernetics (SMC), pp 3573–3578Google Scholar
  34. 34.
    Wakuda Y, Asano S, Koshizuka N, Sakamura K (2012) An adaptive map-matching based on dynamic time warping for pedestrian positioning using network map. In: Proceedings of the 2012 IEEE/ION Position, Location and Navigation Symposium, pp 590–597Google Scholar
  35. 35.
    Wu S, Wong HS, Yu Z (2014) A bayesian model for crowd escape behavior detection. IEEE Trans Circ Syst Video Technol 24(1):85–98CrossRefGoogle Scholar
  36. 36.
    Yi S, Li H, Wang X (2015) Understanding pedestrian behaviors from stationary crowd groups. In: Computer Vision and Pattern Recognition (CVPR), pp 3488–3496Google Scholar
  37. 37.
    Yuan G, Sun P, Zhao J, Li D, Wang C (2017) A review of moving object trajectory clustering algorithms. Artif Intell Rev 47(1):123–144CrossRefGoogle Scholar
  38. 38.
    Zanlungo F, Ikeda T, Kanda T (2014) Potential for the dynamics of pedestrians in a socially interacting group. Phys Rev E 89(1):012811CrossRefGoogle Scholar
  39. 39.
    Zanlungo F, Kanda T (2013) Do walking pedestrians stabily interact inside a large group? analysis of group and sub-group spatial structure. In: CogsciGoogle Scholar
  40. 40.
    Zhang T, Soh SH, Fu X, Lee KK, Wong L, Ma S, Xiao G, Kwoh CK (2009) Hpcgen a fast generator of contact networks of large urban cities for epidemiological studies. In: Computational Intelligence, Modelling and Simulation (CSSim), pp 198–203Google Scholar
  41. 41.
    Zheng K, Zheng Y, Yuan NJ, Shang S (2013) On discovery of gathering patterns from trajectories. In: International Conference on Data Engineering (ICDE), pp 242–253Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.York UniversityTorontoCanada

Personalised recommendations