Skip to main content

Social Media Mining for Disaster Management and Community Resilience

  • Chapter
  • First Online:
Big Data in Emergency Management: Exploitation Techniques for Social and Mobile Data

Abstract

Social media, mobile technologies, and Internet have become an integral part of our daily life. This chapter describes the role of social media during disasters as how platforms like Twitter and Facebook facilitate communication for both the public and response agencies during the time-critical events. Specifically, we introduce the concepts of social media mining for disaster events, provide the use-cases to mine social media for helping public and emergency services, and describe various methods of user, content, network, context, and visual analytics to process and analyze social media data for disaster management and community resilience.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Overview of Emergency Support Functions: https://www.phe.gov/Preparedness/support/esf8/Pages/default.aspx.

  2. 2.

    Twitter API: https://developer.twitter.com/en/docs/tweets/filter-realtime/api-reference/post-statuses-filter.html.

References

  1. Abbasi, M.A., Liu, H.: Measuring user credibility in social media. In: International Conference on Social Computing, Behavioral-Cultural Modeling, and Prediction, pp. 441–448. Springer, Berlin (2013)

    Google Scholar 

  2. Abel, F., Hauff, C., Houben, G.J., Stronkman, R., Tao, K.: Twitcident: fighting fire with information from social web streams. In: Proceedings of the 21st International Conference on World Wide Web, pp. 305–308. ACM, New York (2012)

    Google Scholar 

  3. Akkaya, C., Federowicz, J., Krcmar, H.: Use of social media by the German police: the case of munich. In: Proceedings of the 19th Annual International Conference on Digital Government Research: Governance in the Data Age, p. 116. ACM, New York (2018)

    Google Scholar 

  4. Al-Olimat, H., Thirunarayan, K., Shalin, V., Sheth, A.: Location name extraction from targeted text streams using gazetteer-based statistical language models. In: Proceedings of the 27th International Conference on Computational Linguistics, pp. 1986–1997 (2018)

    Google Scholar 

  5. Bennett, K.J., Olsen, J.M., Harris, S., Mekaru, S., Livinski, A.A., Brownstein, J.S.: The perfect storm of information: combining traditional and non-traditional data sources for public health situational awareness during hurricane response. PLoS Curr. 5 (2013). https://doi.org/10.1371/currents.dis.d2800aa4e536b9d6849e966e91488003

  6. Castillo, C.: Big Crisis Data: Social Media in Disasters and Time-critical Situations. Cambridge University Press, Cambridge (2016)

    Book  Google Scholar 

  7. Castillo, C., Mendoza, M., Poblete, B.: Information credibility on twitter. In: Proceedings of the 20th International Conference on World Wide Web, pp. 675–684. ACM, New York (2011)

    Google Scholar 

  8. Chae, J., Thom, D., Jang, Y., Kim, S., Ertl, T., Ebert, D.S.: Public behavior response analysis in disaster events utilizing visual analytics of microblog data. Comput. Graph. 38, 51–60 (2014)

    Article  Google Scholar 

  9. Crooks, A., Croitoru, A., Stefanidis, A., Radzikowski, J.: # earthquake: Twitter as a distributed sensor system. Trans. GIS 17(1), 124–147 (2013)

    Google Scholar 

  10. Glasgow, K., Vitak, J., Tausczik, Y., Fink, C.: “with your help… we begin to heal”: Social media expressions of gratitude in the aftermath of disaster. In: Social, Cultural, and Behavioral Modeling: 9th International Conference, SBP-BRiMS 2016, Washington, DC, June 28–July 1, 2016, Proceedings 9, pp. 226–236. Springer, Cham (2016)

    Google Scholar 

  11. Gupta, A., Lamba, H., Kumaraguru, P., Joshi, A.: Faking sandy: characterizing and identifying fake images on twitter during hurricane sandy. In: Proceedings of the 22nd International Conference on World Wide Web, pp. 729–736. ACM, New York (2013)

    Google Scholar 

  12. Hui, C., Tyshchuk, Y., Wallace, W.A., Magdon-Ismail, M., Goldberg, M.: Information cascades in social media in response to a crisis: a preliminary model and a case study. In: Proceedings of the 21st International Conference on World Wide Web, pp. 653–656. ACM, New York (2012)

    Google Scholar 

  13. Imran, M., Castillo, C., Lucas, J., Meier, P., Vieweg, S.: Aidr: Artificial intelligence for disaster response. In: Proceedings of the 23rd International Conference on World Wide Web, pp. 159–162. ACM, New York (2014)

    Google Scholar 

  14. Imran, M., Castillo, C., Diaz, F., Vieweg, S.: Processing social media messages in mass emergency: a survey. ACM Comput. Surv. (CSUR) 47(4), 67 (2015)

    Google Scholar 

  15. Kumar, S., Barbier, G., Abbasi, M.A., Liu, H.: Tweettracker: an analysis tool for humanitarian and disaster relief. In: ICWSM, pp. 661–662 (2011)

    Google Scholar 

  16. Kumar, S., Morstatter, F., Zafarani, R., Liu, H.: Whom should I follow?: identifying relevant users during crises. In: Proceedings of the 24th ACM Conference on Hypertext and Social Media, pp. 139–147. ACM, New York (2013)

    Google Scholar 

  17. Li, X., Caragea, D., Zhang, H., Imran, M.: Localizing and quantifying infrastructure damage using class activation mapping approaches. Soc. Netw. Anal. Min. 9(1), 44:1–44:15 (2019). https://doi.org/10.1007/s13278-019-0588-4

  18. Lingad, J., Karimi, S., Yin, J.: Location extraction from disaster-related microblogs. In: Proceedings of the 22nd International Conference on World Wide Web, pp. 1017–1020. ACM, New York (2013)

    Google Scholar 

  19. Lu, X., Brelsford, C.: Network structure and community evolution on twitter: human behavior change in response to the 2011 Japanese earthquake and tsunami. Sci. Rep. 4, 6773 (2014)

    Google Scholar 

  20. Meier, P.: Crisis mapping in action: How open source software and global volunteer networks are changing the world, one map at a time. J. Map Geogr. Libr. 8(2), 89–100 (2012)

    Article  Google Scholar 

  21. Middleton, S.E., Middleton, L., Modafferi, S.: Real-time crisis mapping of natural disasters using social media. IEEE Intell. Syst. 29(2), 9–17 (2014)

    Article  Google Scholar 

  22. Mirbabaie, M., Bunker, D., Deubel, A., Stieglitz, S.: Examining convergence behaviour during crisis situations in social media-a case study on the Manchester bombing 2017. In: International Working Conference on Transfer and Diffusion of IT, pp. 60–75. Springer, Cham (2018)

    Google Scholar 

  23. Nazer, T.H., Xue, G., Ji, Y., Liu, H.: Intelligent disaster response via social media analysis a survey. ACM SIGKDD Explor. Newsl. 19(1), 46–59 (2017)

    Article  Google Scholar 

  24. NBC News: Social media becomes a savior in Hurricane Harvey relief (2017). https://www.nbcnews.com/tech/social-media/social-media-becomes-savior-hurricane-harvey-relief-n796701. Accessed 12 Nov 2019

  25. Olteanu, A., Castillo, C., Diaz, F., Vieweg, S.: Crisislex: a lexicon for collecting and filtering microblogged communications in crises. In: ICWSM, pp. 376–385 (2014)

    Google Scholar 

  26. Olteanu, A., Vieweg, S., Castillo, C.: What to expect when the unexpected happens: social media communications across crises. In: Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, pp. 994–1009. ACM, New York (2015)

    Google Scholar 

  27. Olteanu, A., Castillo, C., Diaz, F., Kiciman, E.: Social data: biases, methodological pitfalls, and ethical boundaries. Front. Big Data 2, 13 (2019)

    Article  Google Scholar 

  28. Opdyke, A., Javernick-Will, A.: Building coordination capacity: post-disaster organizational twitter networks. In: IEEE Global Humanitarian Technology Conference (GHTC 2014), pp. 86–92 (2014)

    Google Scholar 

  29. Palen, L., Anderson, K.M., Mark, G., Martin, J., Sicker, D., Palmer, M., Grunwald, D.: A vision for technology-mediated support for public participation & assistance in mass emergencies & disasters. In: Proceedings of the 2010 ACM-BCS Visions of Computer Science Conference, pp. 8:1–8:12. ACM-BCS ’10. British Computer Society, Swinton (2010)

    Google Scholar 

  30. Palen, L., Starbird, K., Vieweg, S., Hughes, A.: Twitter-based information distribution during the 2009 red river valley flood threat. Bull. Am. Soc. Inf. Sci. Technol. 36(5), 13–17 (2010)

    Article  Google Scholar 

  31. Panagiotopoulos, P., Barnett, J., Bigdeli, A.Z., Sams, S.: Social media in emergency management: Twitter as a tool for communicating risks to the public. Technol. Forecast. Soc. Change 111, 86–96 (2016)

    Article  Google Scholar 

  32. Pandey, R., Purohit, H.: Citizenhelper-adaptive: expert-augmented streaming analytics system for emergency services and humanitarian organizations. In: 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), pp. 630–633. IEEE, Piscataway (2018)

    Google Scholar 

  33. Pedrood, B., Purohit, H.: Mining help intent on twitter during disasters via transfer learning with sparse coding. In: International Conference on Social Computing, Behavioral-Cultural Modeling and Prediction and Behavior Representation in Modeling and Simulation, pp. 141–153. Springer, Cham (2018)

    Google Scholar 

  34. Peterson, S.: Social media resources for emergency management. Int. Assoc. Emerg. Manag. Bull. 32(6), 34–36 (2015)

    Google Scholar 

  35. Petersen, L., Fallou, L., Havarneanu, G., Reilly, P., Serafinelli, E., Bossu, R.: November 2015 Paris terrorist attacks and social media use: preliminary findings from authorities, critical infrastructure operators and journalists. In: ISCRAM, pp. 629–638 (2018)

    Google Scholar 

  36. Pew Research Center: Twitter responds to the Japanese disaster (2011, March). http://www.journalism.org/2011/03/17/twitter-responds-japanese-disaster/. Accessed 12 Nov 2019

  37. Pew Research Center: News use across social media platforms 2018 (2018, Sept). http://www.journalism.org/2018/09/10/news-use-across-social-media-platforms-2018/. Accessed 12 Nov 2019

  38. Pew Research Center: Social media fact sheet (2019). http://www.pewinternet.org/fact-sheet/social-media. Accessed 12 Nov 2019

  39. Preece, J.: Online Communities: Designing Usability and Supporting Sociability, 1st edn. Wiley, New York (2000)

    Google Scholar 

  40. Purohit, H., Chan, J.: Classifying user types on social media to inform who-what-where coordination during crisis response. In: ISCRAM, pp. 656–665 (2017)

    Google Scholar 

  41. Purohit, H., Pandey, R.: Intent Mining for the Good, Bad, and Ugly Use of Social Web: Concepts, Methods, and Challenges, pp. 3–18. Springer International Publishing, Cham (2019)

    Google Scholar 

  42. Purohit, H., Castillo, C., Diaz, F., Sheth, A., Meier, P.: Emergency-relief coordination on social media: automatically matching resource requests and offers. First Monday 19(1) (2013). https://doi.org/10.5210/fm.v19i1.4848

  43. Purohit, H., Bhatt, S., Hampton, A., Shalin, V.L., Sheth, A.P., Flach, J.M.: With whom to coordinate, why and how in ad-hoc social media communications during crisis response. In: ISCRAM, pp. 787–791 (2014)

    Google Scholar 

  44. Purohit, H., Hampton, A., Bhatt, S., Shalin, V.L., Sheth, A.P., Flach, J.M.: Identifying seekers and suppliers in social media communities to support crisis coordination. Comput. Supported Coop. Work (CSCW) 23(4–6), 513–545 (2014)

    Google Scholar 

  45. Purohit, H., Ruan, Y., Fuhry, D., Parthasarathy, S., Sheth, A.P.: On understanding the divergence of online social group discussion. In: Proceedings of the Eighth International AAAI Conference on Weblogs and Social Media, pp. 396–405. AAAI, Menlo Park (2014)

    Google Scholar 

  46. Purohit, H., Dong, G., Shalin, V., Thirunarayan, K., Sheth, A.: Intent classification of short-text on social media. In: 2015 IEEE International Conference on Smart City/SocialCom/SustainCom (SmartCity), pp. 222–228. IEEE, Piscataway (2015)

    Google Scholar 

  47. Purohit, H., Dalal, M., Singh, P., Nissima, B., Moorthy, V., Vemuri, A., Krishnan, V., Khursheed, R., Balachandran, S., Kushwah, H., et al.: Empowering crisis response-led citizen communities: lessons learned from jkfloodrelief.org initiative. In: Strategic Management and Leadership for Systems Development in Virtual Spaces, pp. 270–292. IGI Global, Pennsylvania (2016)

    Google Scholar 

  48. Purohit, H., Castillo, C., Imran, M., Pandey, R.: Social-eoc: serviceability model to rank social media requests for emergency operation centers. In: 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), pp. 119–126. IEEE, Piscataway (2018)

    Google Scholar 

  49. Rand, W., Herrmann, J., Schein, B., Vodopivec, N.: An agent-based model of urgent diffusion in social media. J. Artif. Soc. Soc. Simul. 18(2), 1 (2015)

    Article  Google Scholar 

  50. Reuter, C., Heger, O., Pipek, V.: Combining real and virtual volunteers through social media. In: Proceedings of 10th International Conference on Information Systems for Crisis Response and Management (2013)

    Google Scholar 

  51. Reuter, C., Hughes, A.L., Kaufhold, M.A.: Social media in crisis management: an evaluation and analysis of crisis informatics research. Int. J. Hum. Comput. Interact. 34(4), 280–294 (2018)

    Article  Google Scholar 

  52. Rogstadius, J., Vukovic, M., Teixeira, C., Kostakos, V., Karapanos, E., Laredo, J.A.: Crisistracker: crowdsourced social media curation for disaster awareness. IBM J. Res. Devel. 57(5), 4–1 (2013)

    Article  Google Scholar 

  53. Sakaki, T., Okazaki, M., Matsuo, Y.: Earthquake shakes twitter users: real-time event detection by social sensors. In: Proceedings of the 19th International Conference on World Wide Web, pp. 851–860. ACM, New York (2010)

    Google Scholar 

  54. Schnebele, E., Cervone, G., Waters, N.: Road assessment after flood events using non-authoritative data. Nat. Hazards Earth Syst. Sci. 14(4), 1007–1015 (2014)

    Article  Google Scholar 

  55. Schneider, S.K.: Governmental response to disasters: the conflict between bureaucratic procedures and emergent norms. Public Adm. Rev. 52(2), 135–145 (1992)

    Article  Google Scholar 

  56. Serrano, E., Iglesias, C.A., Garijo, M.: A survey of twitter rumor spreading simulations. In: Computational Collective Intelligence, pp. 113–122. Springer, Cham (2015)

    Google Scholar 

  57. Sheth, A.: Citizen sensing, social signals, and enriching human experience. IEEE Internet Comput. 13(4), 87–92 (2009)

    Article  Google Scholar 

  58. Sheth, A., Purohit, H., Smith, G.A., Brunn, J., Jadhav, A., Kapanipathi, P., Lu, C., Wang, W.: Twitris: A System for Collective Social Intelligence, pp. 1–23. Springer, New York (2017)

    Google Scholar 

  59. Simon, T., Goldberg, A., Aharonson-Daniel, L., Leykin, D., Adini, B.: Twitter in the cross fire – the use of social media in the westgate mall terror attack in kenya. PloS One 9(8), e104136 (2014)

    Article  Google Scholar 

  60. Smith, W.R., Robertson, B.W., Murthy, D., Stephens, K.K., Li, J.: Social media in citizen-led disaster response: rescuer roles, coordination challenges, and untapped potential. In: ISCRAM, pp. 639–648 (2018)

    Google Scholar 

  61. Sorensen, J.H., Sorensen, B.V.: Community processes: warning and evacuation. In: Handbook of Disaster Research, pp. 183–199. Springer, New York (2007)

    Google Scholar 

  62. Stallings, R.A., Quarantelli, E.L.: Emergent citizen groups and emergency management. Public Adm. Rev. 45, 93–100 (1985)

    Article  Google Scholar 

  63. Starbird, K., Muzny, G., Palen, L.: Learning from the crowd: collaborative filtering techniques for identifying on-the-ground Twitterers during mass disruptions. In: ISCRAM (2012)

    Google Scholar 

  64. Starbird, K., Maddock, J., Orand, M., Achterman, P., Mason, R.M.: Rumors, false flags, and digital vigilantes: misinformation on twitter after the 2013 Boston marathon bombing. In: iConference 2014 Proceedings (2014)

    Google Scholar 

  65. Stokes, C., Senkbeil, J.C.: Facebook and Twitter, communication and shelter, and the 2011 Tuscaloosa tornado. Disasters 41(1), 194–208 (2017)

    Article  Google Scholar 

  66. Student Volunteer Army: New Zealanders to give back to their communities (Nd). https://sva.org.nz/our-story/. Accessed 12 Nov 2019

  67. Sutton, J.N., Palen, L., Shklovski, I.: Backchannels on the front lines: emergency uses of social media in the 2007 southern California wildfires. In: ISCRAM, pp. 624–632 (2008)

    Google Scholar 

  68. Taylor, J.G., Gillette, S.C., Hodgson, R.W., Downing, J.L.: Communicating with wildland interface communities during wildfire. Technical report, US Geological Survey (2005)

    Google Scholar 

  69. Temnikova, I.P., Castillo, C., Vieweg, S.: Emterms 1.0: a terminological resource for crisis tweets. In: ISCRAM, pp. 147–157 (2015)

    Google Scholar 

  70. The Japan Times: Recent flooding highlights power of social media in a disaster (2018, July). https://www.japantimes.co.jp/news/2018/07/14/national/media-national/recent-flooding-highlights-power-social-media-disaster/#.XGFnbBlKhTY. Accessed 12 Nov 2019

  71. Thomson, R., Ito, N., Suda, H., Lin, F., Liu, Y., Hayasaka, R., Isochi, R., Wang, Z.: Trusting tweets: the Fukushima disaster and information source credibility on twitter. In: ISCRAM (2012)

    Google Scholar 

  72. U.S. Homeland Security: Using social media for enhanced situational awareness and decision support (2014). https://www.dhs.gov/publication/using-social-media-enhanced-situational-awareness-decision-support. Accessed 12 Nov 2019

  73. U.S. Homeland Security: Digital volunteer program guide (2018). https://www.dhs.gov/sites/default/files/publications/1025_IAS_HSHQDC-17-C-B0013_Digital-Volunteer-Program-Guide_180814-508.pdf. Accessed 12 Nov 2019

  74. Varga, I., Sano, M., Torisawa, K., Hashimoto, C., Ohtake, K., Kawai, T., Oh, J.H., De Saeger, S.: Aid is out there: looking for help from tweets during a large scale disaster. In: ACL, vol. 1, pp. 1619–1629 (2013)

    Google Scholar 

  75. Vieweg, S.E.: Situational awareness in mass emergency: a behavioral and linguistic analysis of microblogged communications. Ph.D. thesis, University of Colorado at Boulder (2012)

    Google Scholar 

  76. Yee San, S., Wardell III, C., Thorkildsen, Z.: Social media in the emergency management field: 2012 survey results (2013). CNA Analysis and Solutions. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.357.3121&rep=rep1&type=pdf. Accessed 12 Nov 2019

  77. Yin, J., Lampert, A., Cameron, M., Robinson, B., Power, R.: Using social media to enhance emergency situation awareness. IEEE Intell. Syst. 27(6), 52–59 (2012)

    Article  Google Scholar 

  78. Zafarani, R., Abbasi, M.A., Liu, H.: Social Media Mining: An Introduction. Cambridge University Press, Cambridge (2014)

    Book  Google Scholar 

Download references

Acknowledgements

Purohit acknowledges U.S. National Science Foundation for partially supporting the related research on disaster informatics through grants IIS-1657379 and IIS-1815459.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hemant Purohit .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Purohit, H., Peterson, S. (2020). Social Media Mining for Disaster Management and Community Resilience. In: Akerkar, R. (eds) Big Data in Emergency Management: Exploitation Techniques for Social and Mobile Data. Springer, Cham. https://doi.org/10.1007/978-3-030-48099-8_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-48099-8_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-48098-1

  • Online ISBN: 978-3-030-48099-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics