Abstract
Event detection has been proved important in various applications, such as route selection to avoid the congestion an event causes or deciding whether to join an event that one is interested in. While geotagged tweets are popular sources of information for event detection, they are usually insufficient for accurate detection when scarce. On the other hand, non-geotagged tweets are more abundant, but include much noise that also deters accurate event detection. In this work, we aimed to enhance detection performance by combining aggregated smartphone GPS data and non-geotagged tweets. We propose a novel method to detect events based on deviations from inferred normal human mobility, selecting event-related topics that correlated with human mobility, and extracting event-relevant tweets by scoring each tweet according to its relevance to an event. The relevance of each tweet is gauged from the tweet’s meaning and posting time. We conducted empirical evaluations using data that include multiple events, such as baseball game and airport congestion. Our proposed method detected 9 out of 10 events regardless of the type and scale of the events, which attests improvement over the geotag-based method. We also confirmed that our model was able to extract the essential event-relevant tweets with an average accuracy of over 90%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
We cannot disclose the number of tweets and the number of people in each experiment due to the agreed terms of use.
- 2.
- 3.
References
Ahmed, M.F., Vanajakshi, L., Suriyanarayanan, R.: Real-time traffic congestion information from tweets using supervised and unsupervised machine learning techniques. Transp. Dev. Econ. 5(2), 1–11 (2019). https://doi.org/10.1007/s40890-019-0088-2
Akahori, T., Dohsaka, K., Ishii, M., Ito, H.: Efficient creation of Japanese tweet emotion dataset using sentence-final expressions. In: 2021 IEEE 3rd Global Conference on Life Sciences and Technologies, pp. 501–505 (2021)
Allan, J.: Introduction to Topic detection and Tracking. In: Allan, J. (eds) Topic Detection and Tracking. The Information Retrieval Series, vol. 12, pp. 1–16. Springer, Boston, (2002). https://doi.org/10.1007/978-1-4615-0933-2_1
Alsaedi, N., Burnap, P., Rana, O.: Can we predict a riot? disruptive event detection using twitter. ACM Trans. Internet Technol. 17(2), 1–26 (2017)
Bhuvaneswari, A., Valliyammai, C.: Identifying event bursts using log-normal distribution of tweet arrival rate in twitter stream. In: Proceedings of the 10th International Conference on Advanced Computing, pp. 339–343 (2018)
Bennani-Smires, K., Musat, C., Hossmann, A., Baeriswyl, M., Jaggi, M.: Simple unsupervised keyphrase extraction using sentence embeddings. In: Proceedings of the 22nd Conference on Computational Natural Language Learning, pp. 221–229 (2018)
de Bruijn, J.A., de Moel, H., Jongman, B., Wagemaker, J., Aerts, J.C.J.H.: TAGGS: grouping tweets to improve global geoparsing for disaster response. J. Geovisualization Spat. Anal. 2(1), 1–14 (2017). https://doi.org/10.1007/s41651-017-0010-6
Calabrese, F., Ferrari, L., Blondel, V.D.: Urban sensing using mobile phone network data: a survey of research. ACM Comput. Surv. 47(2), 25-1-25-20 (2014)
Chen, Y., Lv, Y., Wang, X., Li, L., Wang, F.Y.: Detecting traffic information from social media texts with deep learning approaches. IEEE Trans. Intell. Transp. Syst. 20(8), 3049–3058 (2019)
Comito, C., Forestiero, A., Pizzuti, C.: Bursty event detection in twitter streams. ACM Trans. Knowl. Discov. Data 13(4), 1–28 (2019)
Cordeiro, M.: Twitter event detection: combining wavelet analysis and topic inference summarization. In: Proceedings of the 7th Doctoral Symposium in Informatics Engineering, pp. 123–138 (2012)
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1, pp. 4171–4186 (2019)
Fleiss, J.L.: Measuring nominal scale agreement among many raters. Psychol. Bull. 76(5), 378–382 (1971)
Fuse, T., Kamiya, K.: Statistical anomaly detection in human dynamics monitoring using a hierarchical dirichlet process hidden markov model. IEEE Trans. Intell. Transp. Syst. 18(11), 3083–3092 (2017)
Gutiérrez, C., Figuerias, P., Oliveira, P., Costa, R., Jardim-Goncalves, R.: Twitter mining for traffic events detection. In: Proceedings of the 2015 Science and Information Conference, pp. 371–378 (2015)
Han, Y., Karunasekera, S., Leckie, C., Harwood, A.: Multi-spatial scale event detection from geo-tagged tweet streams via power-law verification. In: Proceedings of the 2019 IEEE International Conference on Big Data, pp. 1131–1136 (2019)
Hu, Y., Wang, R.Q.: Understanding the removal of precise geotagging in tweets. Nat. Human Behav. 4, 1219–1221 (2020)
Kaiser, M.S., et al.: Advances in crowd analysis for urban applications through urban event detection. IEEE Trans. Intell. Transp. Syst. 19(10), 3092–3112 (2018)
Kaviani, M., Rahmani, H.: EmHash: hashtag recommendation using neural network based on BERT embedding. In: 2020 6th International Conference on Web Research, pp. 113–118 (2020)
Kong, X., et al.: Big trajectory data: a survey of applications and services. IEEE Access 6, 58295–58306 (2018)
Kong, X., Song, X., Xia, F., Guo, H., Wang, J., Tolba, A.: LoTAD: long-term traffic anomaly detection based on crowdsourced bus trajectory data. World Wide Web 21(3), 825–847 (2018)
Lam, C.T., Gao, H., Ng, B.: A real-time traffic congestion detection system using on-line images. In: Proceedings of the 2017 IEEE 17th International Conference on Communication Technology, pp. 1548–1552 (2017)
Lee, K., Ganti, R., Srivatsa, M., Mohapatra, P.: Spatio-temporal provenance: identifying location information from unstructured text. In: Proceedings of the 2013 IEEE International Conference on Pervasive Computing and Communications Workshops, pp. 499–504 (2013)
Mele, I., Crestani, F.: A Multi-source collection of event-labeled news documents. In: Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval, pp. 205–208 (2019)
Metzler, D., Cai, C., Hovy, E.: Structured event retrieval over microblog archives. In: Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 646–655 (2012)
Miller, D.: Leveraging BERT for extractive text summarization on lectures. arXiv preprint, arXiv:1906.04165 (2019)
Mishima, Y., Minamikawa, A.: Anomaly detection of urban dynamics in an extreme weather with mobile GPS data. In: Proceedings of NetMob 2019 (2019)
Neumann, J., Zao, M., Karatzoglou, A., Oliver, N.: Event detection in communication and transportation data. In: Pattern Recognition and Image Analysis, pp. 827–838 (2013)
Ren, H., et al.: Time-series anomaly detection service at Microsoft. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 3009–3017 (2019)
Silveira Jacques Junior, J.C., Musse, S.R., Jung, C.R.: Crowd analysis using computer vision techniques. IEEE Sig. Process. Mag. 27(5), 66–77 (2010)
Wei, H., Zhou, H., Sankaranarayanan, J., Sengupta, S., Samet, H.: Detecting latest local events from geotagged tweet streams. In: Proceedings of the 26th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 520–523 (2018)
Weng, J., Lee, B.S.: Event detection in twitter. In: Proceedings of the 5th International AAAI Conference on Weblogs and Social Media (2011)
Xu, Z., et al.: Crowdsourcing based description of urban emergency events using social media big data. IEEE Trans. Cloud Comput. 8(2), 387–397 (2020)
Yabe, T., Tsubouchi, K., Sudo, A.: A framework for evacuation hotspot detection after large scale disasters using location data from smartphones: case study of Kumamoto earthquake. In: Proceedings of the 24th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 1–10 (2016)
Yamaki, S., Lin, S.D., Kameyama, W.: Detection of anomaly state caused by unexpected accident using data of smart card for public transportation. In: Proceedings of the 2019 IEEE International Conference on Big Data, pp. 1693–1698 (2019)
Yamamoto, K., Shimada, K.: Acquisition of periodic events with person attributes. In: 2020 International Conference on Asian Language Processing, pp. 229–234 (2020)
Zhang, C., et al.: TrioVecEvent: embedding-based online local event detection in geo-tagged tweet streams. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 595–604 (2017)
Zhang, C., et al.: GeoBurst: real-time local event detection in geo-tagged tweet streams. In: Proceedings 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 513–522 (2016)
Zhang, Q., Chan, A.B.: Wide-area crowd counting via ground-plane density maps and multi-view fusion CNNs. In: Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 8289–8298 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Takeda, N., Kamisaka, D., Legaspi, R., Mishima, Y., Minamikawa, A. (2022). Event Detection and Event-Relevant Tweet Extraction with Human Mobility. In: Hara, T., Yamaguchi, H. (eds) Mobile and Ubiquitous Systems: Computing, Networking and Services. MobiQuitous 2021. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 419. Springer, Cham. https://doi.org/10.1007/978-3-030-94822-1_1
Download citation
DOI: https://doi.org/10.1007/978-3-030-94822-1_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-94821-4
Online ISBN: 978-3-030-94822-1
eBook Packages: Computer ScienceComputer Science (R0)