A General Framework For Event Detection From Social Media

  • Khatereh PolousEmail author
  • André Freitag
  • Jukka Krisp
  • Liqiu Meng
  • Smita Singh
Part of the Advances in Geographic Information Science book series (AGIS)


The availability of accurate and/or up-to-date mass data can stimulate the development of innovative approaches for the assessment of spatio-temporal processes. However, extracting meaningful information from these collections of user-generated data is a challenge. Event detection is an interesting concept in the era of Web 2.0 and ubiquitous Internet. Various existing event-detection algorithms share a very simple, yet powerful architecture model; pipes-&-filters. Using this model, the authors in this study developed a generic and extensible programming framework to find meaningful patterns out of heterogeneous and unstructured online data streams. The framework supports researchers with adapters to different social media platforms, optional preprocessing steps. Its graphical user interface supports users with an interactive graphical environment for setting up parameters and evaluating the results through maps, 3D visualization, and various charts. The framework has been successfully tested on Flicker and Instagram platforms for different time periods and locations to detect latent events.


Event detection Knowledge discovery Flicker Instagram Social media Datastream mining 



The authors gratefully acknowledge the support by the International Graduate School of Science and Engineering (IGSSE), Technische Universität München, under project 7.07.


  1. Ahlqvist T, Bäck A, Halonen M, Heinonen S (2008) Social media road maps: exploring the futures triggered by social media. Technical report, VTT Technical Research Center of Finland, FinlandGoogle Scholar
  2. Allan J, Papka R, Lavrenko V (1998) On-line new event detection and tracking. In: 21st annual international ACM SIGIR conference on research and development on information retrieval. ACM, New York, pp 37–45Google Scholar
  3. Bao BK, Min W, Lu K., Xu C (2013) Social event detection with robust high-order co-clustering. In: 3rd ACM international conference on multimedia retrieval. ACM, New York, pp 135–142Google Scholar
  4. Becker H, Naaman M, Gravano L (2010) Learning similarity metrics for event identification in social media. In: 3rd ACM international conference on web search and data mining. ACM, New York, pp 291–300Google Scholar
  5. Buschmann F, Meunier R, Rohnert H, Sommerlad P, Stal M (1996) Pattern-oriented software architecture: a system of patterns. Wiley, New YorkGoogle Scholar
  6. Dou W, Wang K, Ribarsky W, Zhou M (2012) Event detection in social media data. In: 2nd IEEE workshop on interactive visual text analytics: task-driven analysis of social media content. IEEE Press, New York, pp 971–980Google Scholar
  7. Ester M, Kriegel HP, Sander J, Xu X (1996) A density-based algorithm for discovering clusters in large spatial databases with noise. In: 2nd international conference on knowledge discovery and data mining. AAAI Press, Palo Alto, pp 226–231Google Scholar
  8. Gao X, Cao J, He Q, Li J (2013) A novel method for geographical social event detection in social media. In: 5th ACM international conference on internet multimedia computing and service. ACM, New York, pp 305–308Google Scholar
  9. Geetha S, Shyla M (2014) An efficient divergence and distribution based similarity measure for clustering of uncertain data. Int J Sci Res 3(3):333–339Google Scholar
  10. Ilina E, Hauff C, Celik I, Abel F, Houben GJ (2012) Social event detection on twitter. In: 12th international conference on web engineering. Springer, Berlin, pp 169–176Google Scholar
  11. jQuery (2014) jQuery Foundation HTTP, Accessed 30 January 2014
  12. Kaplan AM, Haenlein M (2010) Users of the world, unite! the challenges and opportunities of social media. Bus Horiz 53:59–68CrossRefGoogle Scholar
  13. Li R, Lei KH, Khadiwala R, Chang KC (2012) Tedas: a twitter-based event detection and analysis system. In: 28th IEEE international conference on data engineering. IEEE Press, New York, pp 1273–1276Google Scholar
  14. Li Z, Wang B, Li M, Ma WY (2005) A probabilistic model for retrospective news event detection. In: 28th annual international ACM SIGIR conference on research and development on information retrieval. ACM, New York, pp 106–113Google Scholar
  15. Mourya M, Prasad P (2013) An effective execution of diabetes dataset using WEKA. Inter J Comput Sci Inf Technol 4(5):681–682Google Scholar
  16. Nielsen (2012) State of the media: The Social Media Report 2012. Technical report, Nielsen Holdings N.VGoogle Scholar
  17. NumPy (2014) NumPy Developers HTTP, Accessed 30 January 2014
  18. Papadopoulos S, Schinas E, Mezaris V, Troncy R, Kompatsiaris I (2012) Social event detection at mediaeval 2012: challenges, dataset and evaluation. In: Multimedia benchmark workshop 2012. CEUR-WS, AachenGoogle Scholar
  19. Parikh R, Karlapalem K (2013) ET: events from tweets. In: 22nd international conference on world wide web companion. IW3C2, Geneva, pp 613–620Google Scholar
  20. Petkos G, Papadopoulos S, Kompatsiaris Y (2012) Social event detection using multimodal clustering and integrating supervisory signals. In: 2nd ACM international conference on multimedia retrieval. ACM, New York, p 23Google Scholar
  21. Rabbath M, Sandhaus P, Boll S (2011) Automatic creation of photo books from stories in social media. In: TOMCCAP, pp 27–27Google Scholar
  22. Reuter T, Cimiano P, Drumond L, Buza K, Schmidt-Thieme L (2011) Scalable event-based clustering of social media via record linkage techniques. In: 5th international AAAI conference on weblogs and social medi. AAAI Press, Palo Alto, pp 172–202Google Scholar
  23. Sakaki T, Okazaki M, Matsuo Y (2010) Earthquake shakes twitter users: real-time event detection by social sensors. In: 19th ACM international conference on World Wide Web. ACM, New York, pp 951–860Google Scholar
  24. SciPy (2014) SciPy Developers HTTP, www. Accessed 30 January 2014Google Scholar
  25. SQLite (2014) SQLite HTTP, Accessed 30 January 2014
  26. Tamura K, Ichimura T (2013) Density-based spatiotemporal clustering algorithm for extracting bursty areas from georeferenced documents. In: 2013 IEEE international conference on systems, man, and cybernetics. IEEE Press, New York, pp 2079–2084Google Scholar
  27. Travis E (2007) Python for scientific computing. Comput Sci Eng 9(3):10CrossRefGoogle Scholar
  28. van der Maaten LJP, Hinton GE (2008) Visualizing high-dimensional data using t-SNE. J Mach Learn Res 9:2579–2605Google Scholar
  29. Weng J, Lee BS (2011) Event detection in twitter. In: 5th international AAAI conference on weblogs and social media. AAAI Press, Palo Alto, pp 401–408Google Scholar
  30. Xu S (2011) Discovering and tracking events from news, blogs and microblogs on the web. In: 10th international conference on spatial information theory. Springer, Berlin, pp 20–23Google Scholar
  31. Yang Y, Pierce T, Carbonell J (1998) A study of retrospective and on-line event detection. In: 21st annual international ACM SIGIR conference on research and development on information retrieval. ACM, New York, pp 28–36Google Scholar
  32. Zhou X, Chen L (2013) Event detection over twitter social media streams. VLDB J 23(3):381–400CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Khatereh Polous
    • 1
    Email author
  • André Freitag
    • 2
  • Jukka Krisp
    • 3
  • Liqiu Meng
    • 1
  • Smita Singh
    • 1
  1. 1.Department of CartographyTechnical University MunichMunichGermany
  2. 2.Department of InformaticsTechnical University MunichMunichGermany
  3. 3.Department of GeographyAugsburg UniversityAugsburgGermany

Personalised recommendations