Abstract
With the development of Web 2.0, ubiquitous computing, and corresponding technologies, social media has the ability to provide the concepts of information contribution, diffusion, and exchange. Different from the permitting the general public to issue the user-generated information, social media has enabled them to avoid the need to use centralized, authoritative agencies. One of the important functions of Weibo is to monitor real time urban emergency events, such as fire, explosion, traffic jam, etc. Weibo user can be seen as social sensors and Weibo can be seen as the sensor platform. In this paper, the proposed method focuses on the step for storytelling of urban emergency events: given the Weibo posts related to a detected urban emergency event, the proposed method targets at mining the multi-modal information (e.g., images, videos, and texts), as well as storytelling the event precisely and concisely. To sum up, we propose a novel urban emergency event storytelling method to generate multi-modal summary from Weibo. Specifically, the proposed method consists of three stages: irrelevant Weibo post filtering, mining multi-modal information and storytelling generation. We conduct extensive case studies on real-world microblog datasets to demonstrate the superiority of the proposed framework.
Similar content being viewed by others
Notes
A road in Shanghai, China
The biggest city with about 23 million people in China
References
Chua T-S, Luan H, Sun M, Yang S (2012) Next: nus-Tsinghua center for extreme search of user-generated content. IEEE MultiMedia Mag 19(3):81–87
Ma H (2011) Internet of things: objectives and scientific challenges. J Computer Science and Tech 26(6):919–924
Guo B et al (2013) Opportunistic IoT: exploring the harmonious interaction between human and the internet of things. J Network and Computer Applications 36(6):1531–1539
Ganti RK, Ye F, Lei H (2011) Mobile crowdsensing: current state and future challenges. IEEE Commun Mag 49(11):32–39
Guo B et al. (2014) From participatory sensing to mobile crowd sensing. IEEE PerCom Workshops
Lane N et al. (2008) Urban sensing systems: opportunistic or participatory?, Proc Hot Mobile pp. 11–16
Chakrabarti D, Punera K (2011) Event summarization using tweets. In: Proc. ICWSM, pp. 66–73
Ma H, Zhao D, Yuan P (2014) Opportunities in mobile crowd sensing. IEEE Commun Mag 52(8):29–35
Guo B, Chen H, Yu Z, Xie X, Huangfu S, Zhang D (2015) FlierMeet: a mobile crowdsensing system for cross-space public information reposting, tagging, and sharing. IEEE Trans Mob Comput 14(10):2020–2033
Guo B, Yu Z, Zhang D, Zhou X (2014) From participatory sensing to mobile crowd sensing. In: Proc. IEEE Pervasive Comput. Commun. Workshops, pp. 593–598
Zhou P, Zheng Y, Li M (2012) How long to wait?: Predicting bus arrival time with mobile phone based participatory sensing. In: Proc 10th Int Conf Mobile Syst Appl Serv, pp. 379–392
Rana RK, Chou CT, Kanhere SS, Bulusu N, Hu W (2010) Earphone: an end-to-end participatory urban noise mapping system. In: Proc 9th ACM/IEEE Int Conf Inf Process Sensor Netw, pp. 105–116
Zheng Y, Liu F, Hsieh HP (2013) U-Air: when urban air quality inference meets big data. In: Proc. 19th ACM SIGKDD Int Conf Knowl Discovery Data Mining, pp. 1436–1444
Koukoumidis E, Peh LS, Martonosi MR (2011) SignalGuru: leveraging mobile phones for collaborative traffic signal schedule advisory. In: Proc 9th Int Conf Mobile Syst Appl Serv, pp. 127–140
Xu C, Li S, Liu G, Zhang Y, Miluzzo E, Chen YF, Li J, Firner B (2013) Crowdþþ: unsupervised speaker count with smartphones. In: Proc ACM Int Joint Conf. Pervasive Ubiquitous Comput, pp. 43–52
Chon Y, Lane ND, Li F, Cha H, Zhao F (2012) Automatically characterizing places with opportunistic crowdsensing using smartphones. In: Proc 14th Int Conf Ubiquitous Comput, pp. 481–490
Faulkner M, Olson M, Chandy R, Krause J, Chandy KM, Krause A (2011) The next big one: Detecting earthquakes and other rare events from community-based sensors. In: Proc 10th Int Conf Inf Process. Sensor Netw, pp. 13–24
Bao X, Choudhury R (2010) Movi: Mobile phone based video highlights via collaborative sensing. In: Proc 8th Int Conf Mobile Syst Appl Serv, pp. 357–370
Xie L, Natsev A, He X, Kender JR, Hill ML, Smith JR (2013) Tracking large-scale video remix in real-world events. IEEE Trans Multimedia 15(6):1244–1254
Chen Y, Cheng A, Hsu WH (2013) Travel recommendation by mining people attributes and travel group types from community-contributed photos. IEEE Trans. Multimedia 15(6):1283–1295
Zhang D, Wang L, Xiong H, Guo B (2014) 4W1H in mobile crowd sensing. IEEE Commun Mag 52(8):42–48
Pankratius V, Lind F, Coster A, Erickson P, Semeter J (2014) Mobile crowd sensing in space weather monitoring: the mahali project. IEEE Commun Mag 52(8):22–28
Rosen S, Lee S, Lee J, Congdon P, Mao Z, Burden K (2014) MCNet. Crowdsourcing wireless performance measurements through the eyes of mobile devices. IEEE Commun Mag 52(10):86–91
Hong L, Ahmed A, Gurumurthy S et al. (2012) Discovering geographical topics in the twitter stream. In: WWW 2012, pp. 769–778
Cataldi M, Di Caro L, Schifanella C (2010) Emerging topic detection on twitter based on temporal and social terms evaluation. In: International Workshop on Multimedia Data Mining, pp. 4:1–4:10
Lehmann J, Goncalves B, Ramasco JJ, Cattuto C (2012) Dynamical classes of collective attention in twitter. In: WWW 2012, pp. 251–260
Sakaki T, Okazaki M, Matsuo Y (2010) Earthquake shakes twitter users: Real-time event detection by social sensors. In: WWW 2010, pp. 851–860
Sankaranarayanan J, Samet H, Teitler BE, Lieberman MD, Sperling J (2009) Twitterstand: News in tweets. In: ACM SIGSPATIAL, pp. 42–51
Becker H, Naaman M, Gravano L (2011) Beyond trending topics: Real-world event identification on twitter. In: International Conference on Weblogs and Social Media, Barcelona, Catalonia, Spain
Walther M, Kaisser M (2013) Geo-spatial event detection in the twitter stream. In: European Conference on Advances in Information Retrieval, pp. 356–367
Sheth A, Jadhav A, Kapanipathi P et al. (2014) Twitris: a system for collective social intelligence. In: Encyclopedia of Social Network Analysis and Mining, pp. 2240–2253
Crooks A, Croitoru A, Stefanidis A, Radzikowski J (2012) Earthquake: twitter as a distributed sensor system. Transaction in GIS, pp. 1–26
Longueville B, Smith R, Luraschi G (2009) OMG, from here I can see the flames, a use case of mining location based social networks to acquire spatio-temporal data on forest fires. In: Proceedings of the International Workshop on Location-Based Social Networks, pp. 73–80
Liu Y, Alexandrova T, Nakajima T (2013) Using Stranger as Sensors: Temporal and Geo-sensitive Question Answering via Social Media. In: Proceedings of the 22th international World Wide Web conference, pp. 803–813
Qu Y, Zhang J (2013) Trade area analysis using user generated mobile location data. In: Proceedings of the 22th international World Wide Web conference, pp. 1053–1063
Sharifi B, Hutton M-A, Kalita J (2010) Summarizing microblogs automatically. In: Proc. NAACL HLT, pp. 685–688
Inouye D, Kalita JK (2011) Comparing Twitter summarization algorithms for multiple post summaries. In: Proc Social Com, pp. 298–306
Lin C, Lin C, Li J, Wang D, Chen Y, Li T (2012) Generating event storylines from microblogs. In: Proc. CIKM, pp. 175–184
Xu Z et al (2016) Crowdsourcing based description of urban emergency events using social media big data. IEEE Transactions on Cloud Computing. doi:10.1109/TCC.2016.2517638
Xu Z, Zhang H, Sugumaran V, Choo R, Mei L, Zhu Y (2016) Participatory sensing-based semantic and spatial analysis of urban emergency events using mobile social media. EURASIP J Wirel Commun Netw 2016:44
Xu Z, Zhang H, Sugumaran V, Choo R, Mei L, Zhu Y (2016) Building knowledge base of urban emergency events based on crowdsourcing of social media. Concurrency and Computation: Practice and Experience. doi:10.1002/cpe.3780
Xu Z et al. (2015) Crowd Sensing of Urban Emergency Events based on Social Media Big Data. The 2014 I.E. International Conference on Big Data Science and Engineering, pp. 605–610
Xuan J, Luo X, Zhang G, Lu J, Xu Z (2016) Uncertainty analysis for the keyword system of web events. IEEE Transactions on Systems, Man, and Cybernetics: Systems. doi:10.1109/TSMC.2015.2470645
Liu W, Luo X, Gong Z, Xuan J, Kou NM, Xu Z (2016) Discovering the core semantics of event from social media. Futur Gener Comput Syst. doi:10.1016/j.future.2015.11.023
Xu Z et al (2015) Crowdsourcing based social media data analysis of urban emergency events. Multimedia tools and applications. doi:10.1007/s11042-015-2731-1
Acknowledgement
This work was supported in part by the National Science and Technology Major Project under Grant 2013ZX01033002-003, in part by the National Natural Science Foundation of China under Grant 61300202, and in part by the Science Foundation of Shanghai under Grant 13ZR1452900.
Author information
Authors and Affiliations
Corresponding author
Additional information
This paper is the extended version (about 50% new content) accepted by 9th EAI International Conference on Mobile Multimedia Communications (MobiMedia 2016).
Rights and permissions
About this article
Cite this article
Xu, Z., Liu, Y., Zhang, H. et al. Building the Multi-Modal Storytelling of Urban Emergency Events Based on Crowdsensing of Social Media Analytics. Mobile Netw Appl 22, 218–227 (2017). https://doi.org/10.1007/s11036-016-0789-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11036-016-0789-2