The limits of crisis data: analytical and ethical challenges of using social and mobile data to understand disasters
- 2.6k Downloads
Social media platforms and mobile phone data are commonly mined to produce accounts of how people are responding in the aftermath of crisis events. Yet social and mobile datasets have limitations that, if not sufficiently understood and accounted for, can produce specific kinds of analytical and ethical oversights. In this paper, we analyze some of the problems that emerge from the reliance on particular forms of crisis data, and we suggest ways forward through a deeper engagement with ethical frameworks and a more critical questioning of what crisis data actually represents. In particular, the use of Twitter data and crowdsourced text messages during crisis events such as Hurricane Sandy and the Haiti Earthquake raised questions about the ways in which crisis data act as a system of knowledge. We analyze these events from ontological, epistemological, and ethical perspectives and assess the challenges of data collection, analysis and deployment. While privacy concerns are often dismissed when data is scraped from public-facing platforms such as Twitter, we suggest that the kinds of personal information shared during a crisis—often as a way to find assistance and support—present ongoing risks. We argue for a deeper integration of critical data studies into crisis research, and for researchers to acknowledge their role in shaping norms of privacy and consent in data use.
KeywordsCritical data studies Crisis informatics Privacy Ethics Disasters
Kate Miltner gave invaluable assistance in the preparation of this article. The authors also thank the journal editors and reviewers for insightful comments on the paper.
- Brenner, J. & Smith A. (2013a). 72% of online adults are social networking site users. Pew Research Center’s Internet and American Life Project. http://pewinternet.org/~/media//Files/Reports/2013/PIP_Social_networking_sites_update_PDF. Accessed August 5, 2013.
- Burns, R. (2014b). Rethinking big data in digital humanitarianism: Practices, epistemologies, and social relations. Geojournal Online First,. http://link.springer.com/article/10.1007/s10708-014-9599-x. Accessed October 27, 2014.
- Button, G. V. (2002). Popular media reframing of man-made disasters. In S. M. Hoffman & A. Oliver-Smith (Eds.), Catastrophe and culture: The anthropology of disaster (pp. 143–158). Santa Fe: School of American Research Press.Google Scholar
- Button, G. V. (2010). Disaster culture: Knowledge and uncertainty in the wake of human and environmental catastrophe. Walnut Creek, CA: Left Coast Press Inc.Google Scholar
- Clémenzo, J.Y. (2011) Ushahidi project and Mission 4636 in Haiti: Participation, representation and political economy (Thesis). http://jeanyvesclemenzo.ch/Nouveausite/Recherches/DFA24093-B92E-4A34-9746-564DE2E4BC0A_files/ResearchUshahidi.pdf. Accessed October 27, 2014.
- Cohen, J. (2012). Configuring the Networked Self: Law, Code, and the Play of Everyday Practice. New Haven, CT: Yale University Press.Google Scholar
- Crawford, K. (2010). Whispering news: From word of mouth to the ambient news network. In G. Meikle & G. Redden (Eds.), News online: Transformations and continuities. London: Palgrave Macmillan.Google Scholar
- Crawford, K. (2013). Hidden biases in big data. Harvard Business Review. April 1. http://blogs.hbr.org/cs/2013/04/the_hidden_biases_in_big_data.html. Accessed April 2, 2013.
- Crawford, K., Meier, P., Perlich, C., Luers, A., Falieros, G., & Thorp, J. (2013). Big data, communities and ethical resilience: A framework for action. Bellagio white paper. Rockefeller Foundation. http://poptech.org/system/uploaded_files/66/original/BellagioFramework.pdf. Accessed November 21, 2013.
- Crawford, K., & Schultz, J. M. (2014). Big data and due process: Toward a framework to redress predictive privacy harms. Boston College Law Review, 55(1), 93–128.Google Scholar
- De Micheli, C. & Stroppa, A. (2013). Twitter and the underground market. 11th Nexa lunch seminar, Turin, Italy. http://nexa.polito.it/nexacenterfiles/lunch-11-de_micheli-stroppa.pdf. Accessed July 22, 2013.
- Dixon, D. (2012). Analysis tool or research methodology? Is there an epistemology for patterns? In D. Berry (Ed.), Understanding digital humanities. London: Palgrave Macmillan.Google Scholar
- Dugdale, J., Van de Walle, B., & Koeppinghoff C. (2012). Social media and SMS in the Haiti Earthquake. In Proceedings of the 21st international conference companion on world wide web. ACM.Google Scholar
- Earle, P. S., Bowden, D. C., & Guy, M. (2011). Twitter earthquake detection: Earthquake monitoring in a social world. Annals of Geophysics, 54(6), 708–715.Google Scholar
- Erikson, K. (1976). Everything in its path: Destruction of community in the Buffalo Creek Flood. New York: Simon & Schuster.Google Scholar
- Geiger, R. S. (2011). Lives of bots. In G. Lovink, & N. Tkacz, (Eds.), Critical point of view: A Wikipedia reader (pp. 78–89). Amsterdam: Institute of Network Cultures. Google Scholar
- Geiger, R. S. (2014). Bots, bespoke, code and the materiality of software platforms. New Media and Society, 17(3), 342–356.Google Scholar
- Geiger, R. S. & Ribes, D. (2010). The work of sustaining order in Wikipedia: The banning of a vandal. In Proceedings of the 2010 ACM conference on computer supported cooperative work (CSCW). New York: ACM.Google Scholar
- Gillespie, T. (2014). The relevance of algorithms. In T. Gillespie, P. J. Boczkowski, & K. Foot (Eds.), Media technologies: Essays on communication, materiality and society (pp. 167–194). Cambridge, MA: MIT Press.Google Scholar
- Grinberg, N., Naaman, M., Shaw, B. & Lotan, G. (2013) Extracting diurnal patterns of real world activity from social media. In Proceedings of the seventh international AAAI conference on weblogs and social media (ICWSM–13). http://sm.rutgers.edu/pubs/Grinberg-SMPatterns-ICWSM2013.pdf. Accessed June 16, 2013.
- Johns, A. (1999). Introduction. In A. Johns (Ed.), Dreadful visitations: Confronting natural catastrophe in the age of enlightenment. New York: Routledge.Google Scholar
- Lotan, G. (2012) #Sandy: Social media mapping. Social flow. http://giladlotan.com/?p=7120245759. Accessed July 11, 2014.
- Lotan, G., Graeff, E., Ananny, M., Gaffney, D., Pearce, I., & boyd, d. (2011). The revolutions were tweeted: Information flows during the 2011 Tunisian and Egyptian revolutions. International Journal of Communications, 5(1), 1375–1405.Google Scholar
- Marwick, Alice, & Danah, B. (2011). To see and be seen: Celebrity practice on Twitter. Convergence, 17(2), 139–158.Google Scholar
- Meier, P. (2011). What is crisis mapping? An update on the field and looking ahead, iRevolution Blog, January 20, 2011. http://irevolution.net/2011/01/20/what-is-crisis-mapping/. Accessed May 5, 2014.
- Meier, P. (2013a). Early results of MicroMappers response to Typhoon Yolanda (updated). IRevolution. http://irevolution.net/2013/11/13/early-results-micromappers-yolanda/.
- Meier, P. (2013b). Digital humanitarians: From Haiti earthquake to Typhoon Yolanda. IRevolution. http://irevolution.net/2013/11/11/humanitarian-technology-haiti-to-yolanda/.
- Morrow, N., Mock, N., Papendieck, A. & Kocmich, N. (2011). Independent evaluation of the Ushahidi Haiti Project. http://community.ushahidi.com/research/relevant-literature/. Accessed March 11, 2013.
- Nissenbaum, H. (2010). Privacy in context: Technology, policy and the integrity of social life. Stanford, CA: Stanford University Press.Google Scholar
- O’Connor, M. R. (2012). Two years later, Haitian earthquake death toll in dispute, Columbia Journalism Review. www.cjr.org/behind_the_news/one_year_later_haitian_earthqu.php. Accessed October 5, 2012.
- Oliver-Smith, A. (1986). Introduction. Disaster context and causation: An overview of changing perspectives in disaster research, in natural disasters and cultural responses. In A. Oliver-Smith (Ed.), Studies in third world Societies (Vol. 36). Williamsburg, VA: College of William Mary.Google Scholar
- Oliver-Smith, A, & Hoffman, S., (Eds.). (2002) Introduction. In Catastrophe and culture: The anthropology of disaster. Santa Fe, NM: School of American Research Press.Google Scholar
- Palen, L., Anderson, K. M., Mark, G., Martin, J., Sicker, D., Palmer, M., & Grunwald, D. (2010). A vision for technology-mediated support for public participation and assistance in mass emergencies and disasters. In Proceedings of the 2010 ACM-BCS visions of computer science conference. British Computer Society.Google Scholar
- Papacharissi, Z. (2012). Without You I’m nothing: Performances of the self on Twitter. International Journal of Communications, 6(1), 1989–2006.Google Scholar
- Price, M., & Ball, P. (2014). Big data, selection bias, and the statistical patterns of mortality in conflict. SAIS Review, XXXVI(1), 9–20.Google Scholar
- Puschmann, C. & Burgess, J. (2013). The politics of Twitter data. In K. Weller, A. Bruns, J. Burgess, M. Mahrt & C. Puschmann (Eds.) Twitter and society. New York: Peter Lang. http://eprints.qut.edu.au/56737/. Accessed June 6, 2013.
- Rainie, L. (2012). Smartphone ownership update: 2012. http://www.pewinternet.com/Reports/2012/Smartphone-Update-Sept-2012.aspx. Accessed September 5, 2013.
- Sangari, K. (2009) Conjunction and flow: The gendered temporalities of (media) disaster. E-Media Studies 2(1). http://journals.dartmouth.edu/cgi-bin/WebObjects/Journals.woa/2/xmlpage/4/article/335. Accessed June 21, 2013.
- Shanley, L., Burns, R., Bastian, Z., & Robson, F. (2013). Tweeting up a storm: The promise and perils of crisis mapping. Photogrammetric Engineering & Remote Sensing, 79(10), 865–879.Google Scholar
- Shaw, F., Burgess, J., Crawford, K., & Bruns, A. (2013). Sharing news, making sense, saying thanks: Patterns of talk on Twitter during the Queensland floods. Australian Journal of Communication, 40(1), 23–40.Google Scholar
- Shih, G. (2012). Over 20 million tweets sent as Sandy struck. Reuters. http://in.reuters.com/article/2012/11/02/storm-sandy-twitter-idINDEE8A10AX20121102. Accessed November 3, 2013.
- Solove, D. J. (2012). Privacy self-management and the consent dilemma. The George Washington University Law School. Public Law and Legal Theory Paper & Legal Studies Research Paper No. 2012-141. http://ssrn.com/abstract=2171018. Accessed January 9, 2013.
- Tanaka, Y., Sakamoto, Y., & Matsuka, T. (2012). Transmission of rumor and criticism in Twitter after the great Japan earthquake. In Proceedings of the Annual Meeting of the Cognitive Science Society, 2387–2392.Google Scholar
- Tene, O., & Polonetsky, J. (2012). Privacy in the age of big data: A time for big decisions. Stanford Law Review Online, 64(63), 63–69.Google Scholar
- Tufekci, Z. (2014). Big Questions for social media big data: Representativeness, validity and other methodological pitfalls, In Proceedings of the international AAAI conference on weblogs and social media. Google Scholar
- Verma, S., Vieweg, S., Corvey, W., Palen, L., Martin, J., Palmer, M., Schram, A., & Anderson, K. (2011). Natural language processing to the rescue?: Extracting "situational awareness" tweets during mass emergency. In Proceedings of the Fifth International AAAI Conference on Weblogs and Social Media, (pp. 385–392).Google Scholar
- Vis, F. (2013b). A critical reflection on Big Data: Considering APIs, researchers and tools as data markers. First Monday, 18(10). http://firstmonday.org/ojs/index.php/fm/rt/printerFriendly/4878/3755. Accessed October 22, 2013.
- Watts, M. (1983). On the poverty of theory: Natural hazards research in context. In K. Hewitt (Ed.), Interpretations of calamity from the viewpoint of human ecology. Boston, MA: Allen & Unwin Inc.Google Scholar
- World Bank. (2010). Internet users (per 100 people). http://data.worldbank.org/indicator/IT.NET.USER.P2. Accessed December 11, 2013.
- Zickuhr, K. (2013b). Location-based services. Pew Research Center’s Internet and American Life Project. http://pewinternet.org/~/media//Files/Reports/2013/PIP_Location-based%20services%202013.pdf. Accessed September 12, 2013.