Skip to main content

Advertisement

SpringerLink
Log in

Situational awareness in smart environments: socio-mobile and sensor data fusion for emergency response to disasters

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Traditional situational awareness services in disaster management are mainly focused on the institutional warning response and not fully exploit the active participation of citizens involved. This paper presents an advanced system for emergency management (ASyEM) which fuses the potentiality offered by mobile social data and bottom-up communication with smart sensors. The proposed architecture model is organized into four different layers: (1) sensor, (2) local transmission, (3) network and (4) management. ASyEM is able to capture and aggregate two different kind of data: (a) user generated content produced by citizens during or immediately after the disaster and shared online through socio-mobile applications and (b) data acquired by smart sensors distributed on the environment (i.e., intelligent cameras, microphones, acoustic arrays, etc.). Data are selected, analysed, processed and integrated in order to increase the reliability and the efficiency of whole situational awareness services, localize the critical areas and obtain in this way some relevant information for emergency response and completion of search and rescue operations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  • Abad P, Puente V, Gregorio JA (2012) Balancing performance and cost in CMP interconnection networks. IEEE Trans Parallel Distrib Syst 23(3):452–459

    Article  Google Scholar 

  • Abel F, Hauff C, Houben G, Tao K, Stronkman R (2012) Twitcident: fighting fire with information from social web streams. In: Proceedings of International Conference on World Wide Web (WWW), Lyon, France

  • Baudry M (2008) The geoweb and hyper-local internet markets. Commun Strat 72(4):179–184

    Google Scholar 

  • Bortree DS, Seltzer T (2009) Dialogic strategies and outcomes: an analysis of environmental advocacy groups’ Facebook profiles. Public Relat Rev 35(3):317–319

    Article  Google Scholar 

  • Boyd DM, Ellison NB (2007) Social network sites: definition, history, and scholarship. J Computer Med Commun 13(1):210–230. doi:10.1111/j.1083-6101.2007.00393.x

    Google Scholar 

  • Brunner D, Lemoine G, Thoorens FX, Bruzzone L (2009) Distributed geospatial data processing functionality to support collaborative and rapid emergency response. IEEE J Sel Topics Appl Earth Obs Remote Sens 2(1):33–46

    Article  Google Scholar 

  • Bruns A, Burgess J, Crawford K, Shaw F (2012) #qldfloods and @QPSMedia: crisis communication on Twitter in the 2011 South East Queensland Floods. ARC Centre of Excellence for Creative Industries and Innovation, Brisbane

    Google Scholar 

  • Cai R, Lu L, Zhang HJ, Cai LH (2003) Highlight sound effects detection in audio stream. In: Proceedings of IEEE International Conference on Multimedia Expo

  • Caplan SE, Perse EM, Gennaria JE (2007) Computer-mediated technology and social interaction. In: Lin CA, Atkin DJ (eds) Communication technology and social change: theory and implication. Lawrence Erlbaum, Mahwah, pp 39–57

    Google Scholar 

  • Conklin WA, Dietrich G (2010) Emergency communications using the web: matching media richness to the situation. In: 43rd Hawaii International Conference on system sciences, Honolulu, pp 1–9. http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=5428284

  • Earle P, Guy M, Buckmaster R, Ostrum C, Horvath S, Vaughan A (2010) OMG earthquake! Can Twitter improve earthquake response? Seismol Res Lett 81(2):246–251

    Article  Google Scholar 

  • Endsley MR (1995) Toward a theory of situation awareness in dynamic systems. Human Factors: J Hum Factors Ergon Soc 37:32–64

    Article  Google Scholar 

  • Farinosi M, Micalizzi A (2013) NetQuake. Media Digitali e Disastri Naturali. Dieci ricerche empiriche sul ruolo della Rete nel terremoto dell’Aquila. FrancoAngeli, Milano

  • Farinosi M, Treré E (2010) Inside the “People of the Wheelbarrows”: participation between online and offline dimension in the post-quake social movement. J Commun Inf 6(3). http://www.ci-journal.net/index.php/ciej/article/view/761/639

  • Ferrin G, Snidaro L, Foresti GL (2011) Contexts, co-texts and situations in fusion domain. In: 14th International Conference on Information Fusion, Chicago, USA, July 5–8, 2011

  • Foresti GL, Micheloni C (2002) Generalized neural trees for pattern recognition. IEEE Trans Neural Netw 13(6):1540–1547

    Article  Google Scholar 

  • Foresti GL, Regazzoni CS, Visvanathan R (2001) Video communications, processing and understanding for third generation surveillance systems. In: Proceedings of IEEE, 89(10)

  • Fraustino JD, Brooke L, Jin Y (2013) Social media use during disasters: a review of the knowledge base and gaps. In: Final report to Human Factors/Behavioral Sciences Division, Science and Technology Directorate, US Department of Homeland Security. College Park, MD: START, Jen. 2013

  • Gilbert C (1998) Studying disaster: changes in the main conceptual tools. In: Quarantelli EL (ed) What is a disaster? Routledge, London, New York, pp 11–18

    Google Scholar 

  • Goodchild MF (2007) Citizens as sensors: the world of volunteered geography (online). http://www.ncgia.ucsb.edu/projects/vgi/docs/position/goodchild_vgi2007.pdf

  • Goolsby R (2010) Social media as crisis platform: the future of community maps/crisis maps. ACM Trans Intell Syst Technol 1(1). doi:10.1145/1858948.1858955

  • Guy M, Earle P, Ostrum C, Gruchalla K, Horvath S (2010) Integration and dissemination of citizen reported and seismically derived earthquake information via social network technologies. In: Advances in intelligent data analysis IX. Springer, Berlin, pp 42–53. doi:10.1007/978-3-642-13062-5_6

  • Heinzelman J, Waters C (2010) Crowdsourcing crisis information in disaster-affected Haiti. United States Institute of Peace, Washington, DC

    Google Scholar 

  • Hofstee H (2005) Power efficient processor architecture and the cell processor. In: Proceedings 11th Int. Symposium on high-performance computer architecture (HPCA), San Francisco, USA, February 12–16, 2005

  • Jang HC, Lien YN, Tsai TC (2009) Rescue information system for earthquake disasters based on MANET emergency communication platform. In: Proceedings of the 2009 International Conference on Wireless Communications and Mobile Computing: Connecting the World Wirelessly, Leipzig, Germany, June 21–24, 2009, pp 623–627

  • Kanchanasut K, Tunpan A, Awal MA, Kumar Das D, Wongsaardsakul T, Tsuchimoto Y (2007) DUMBONET: a multimedia communication system for collaborative emergency response operations in disaster-affected areas. Int J Emerg Manag 4(4):670–681

    Article  Google Scholar 

  • Kavanaugh A, Fox EA, Sheetz S, Yang S, Li LT, Whalen T, Shoemaker D, Natsev P, Xie L (2011) Social media use by government: from the routine to the critical. In: Proceedings of the 12th Annual International Conference on Digital Government Research, College Park, MD, June, 2011

  • Kim J (2009) Low-cost router microarchitecture for on-chip networks. In: Proceedings IEEE/ACM 42nd Int. Symposium on microarchitecture, New York, USA, December 12–16, 2009

  • Kinsella S, Murdock V, O’Hare N (2011) “I’m eating a sandwich in Glasgow”: modelling locations with tweets. In: SMUC 11 Proceedings of the 3rd international workshop on Search and mining user-generated contents

  • Kodrich K, Laituri MN (2011) Making a connection: social media’s key role in the Haiti earthquake. J Commun Computer 8:624–627

    Google Scholar 

  • Li L, Tang S (2008) An artificial emergency-logistics-planning system for severe disasters. IEEE Intell Syst 23(4):86–88

    Article  Google Scholar 

  • Littlefield RS, Quenette AM (2007) Crisis leadership and Hurricane Katrina: the portrayal of authority by the media in natural disasters. J Appl Commun Res 35(1):26–47

    Article  Google Scholar 

  • Liu H, Yu Z, Zha H, Zou Y, Zhang L (2009) Robust human tracking based on multi-cue integration and mean-shift. Pattern Recogn Lett 30(9):827–837

    Article  Google Scholar 

  • Llinas J, Bowman CL, Rogova GL, Steinberg AN, Waltz EL, White FE (2004) Revisiting the JDL data fusion model II. In: Proceedings of the Seventh International Conference on Information Fusion, Stockholm, Sweden, June 2004, pp 1218–1230

  • Martinel N, Micheloni C, Piciarelli C (2012) Distributed signature fusion for person re-identification. In: International conference on distributed smart cameras. Hong Kong, pp 1–6

  • Martinel N, Micheloni C, Piciarelli C, Foresti GL (2013) Camera selection for adaptivehuman—computer interface. IEEE Trans Syst Man Cybernet: Syst 1–1. doi:10.1109/TSMC.2013.2279661

  • Meier P (2013) How to create resilience through big data (online). http://irevolution.net/2013/01/11/disaster-resilience-2-0/

  • Micheloni C, Foresti GL (2009) Automatic tuning of intrinsic camera parameters. IEEE Trans Autom Sci Eng 6(4):577–587

    Article  Google Scholar 

  • Micheloni C, Snidaro L, Foresti GL (2009) Exploiting temporal statistics for events analysis and understanding. Image Vis Comput 27(10):1459–1469

    Article  Google Scholar 

  • Micheloni C, Rinner B, Foresti GL (2010) Low-level processing in PTZ camera networks. IEEE Signal Process Mag 27(5):78–90

    Article  Google Scholar 

  • Micheloni C, Rani A, Kumar S, Foresti GL (2012) A balanced neural tree for pattern classification. Neural Netw 27:81–90

    Article  Google Scholar 

  • Monekosso D, Remagnino P (2007) Monitoring behaviour with an array of sensors. Comput Intell 23(4):420–438

    Article  MathSciNet  Google Scholar 

  • Neuvel JMM, Scholten HJ, Van Den Brink A (2012) From spatial data to synchronised actions: the network-centric organisation of spatial decision support for risk and emergency management. Appl Spatial Anal Policy 5(1):51–72

    Article  Google Scholar 

  • Pande P, Grecu C, Jones M, Ivanov A, Saleh RA (2005) Performance evaluation and design trade-offs for network-on-chip interconnect architectures. Computers 54(8):1025–1040

    Google Scholar 

  • Park SH, Jung K, Hea KJ, Kim HJ (1999) Vision-based traffic surveillance system on the Internet. In: Proceedings of 3rd International Conference on Computational intelligence and multimedia applications (ICCIMA), 1999, pp 201–205

  • Paulheim H, Döweling S, Tso-Sutter K, Probst F, Ziegert T (2009) Improving usability of integrated emergency response systems: the SoKNOS approach. In: Proceedings of Informatik 2009 Conference, Lübeck, Germany, September 28-October 2, 2009, pp 1435–1449

  • Pringle C (2009) From curiosity to collaboration: leveraging technology to improve situational awareness. Safeguarding Homeland Security. Governors and Mayors Speak Out, pp 159–176. doi:10.1007/978-1-4419-0371-6_14

  • Rinner B, Wolf W (2008) An introduction to distributed smart cameras. Proc IEEE 96(10):1565–1575

    Article  Google Scholar 

  • Ross A, Jain A (2004) Multimodal biometrics: an overview. In: Proceedings of the XII European Signal Processing Conference, 2004, pp 1221–1224

  • Schade S, Luraschi G, De Longueville B, Cox S, Díaz L (2010) Citizens as sensors for crisis events: sensor web enablement for volunteered geographic information. In: Webmgs 2010 (online). http://www.isprs.org/proceedings/xxxviii/4-w13/id_02.pdf

  • Singh VK, Gao M, Jain R (2012) Situation recognition: an evolving problem for heterogeneous dynamic big multimedia data. Proceedings of the 20th ACM international conference on Multimedia (MM ‘12). ACM, New York, pp 1209–1218

    Chapter  Google Scholar 

  • Snidaro L, Foresti GL (2003) Real-time thresholding with Euler number. Pattern Recogn Lett 24(9–10):1533–1544

    Article  MATH  Google Scholar 

  • Snidaro L, Foresti GL (2007) MISS EU project : video application to improve public transport efficiency. In: 6th European Congress on Intelligent Transport Systems, Aalborg, Denmark, June, 18–20, 2007

  • Spiro ES, Sutton J, Greczek M, Fitzhugh S, Pierski N, Butts C (2012) Rumoring during extreme events: A case study of Deepwater Horizon 2010. In: International Conference on WebSci 2012, Evanston, IL, June, 2012

  • Starbird K, Palen L (2010) Pass it on?: Retweeting in mass emergency. In: Proceedings of the 7th International ISCRAM Conference—Seattle, USA, May 2010

  • Starbird K, Palen L (2011) Voluntweeters: self-organizing by digital volunteers in times of crisis. In: Proceedings of the ACM 2011 Conference on Computer Human Interaction, Vancouver, BC, Canada, May 2011

  • Starbird K, Palen L (2012) (How) will the revolution be retweeted? In: Information diffusion and the 2011 Egyptian Uprising CSCW’12, February 11–15, 2012, Seattle, Washington, USA

  • Stephens KK, Malone P (2009) If the organizations won’t give us information…: the use of multiple new media for crisis technical translations and dialogue. J Public Relat Res 21(2):229–239

    Article  Google Scholar 

  • Sutton J, Palen L, Shklovski I (2008) Backchannels on the front lines: emergent uses of social media in the 2007 Southern California wildfires. In: Proceedings of the 5th International ISCRAM, Washington, DC, May, 2008

  • Sweetser KD, Metzgar E (2007) Communicating during crisis: use of blogs as a relationship management tool. Public Relat Rev 33:340–342

    Article  Google Scholar 

  • Waharte S, Trigoni N (2010) Supporting search and rescue operations with UAVs. In: International Conference on emerging security technologies (EST), September 6–7, Canterbury, UK, 2010, pp 142–147

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics and Computer Science, University of Udine, Via delle Scienze, 208, 33100, Udine, Italy

    Gian Luca Foresti & Marco Vernier

  2. Department of Human Sciences, University of Udine, Via Margreth 3, 33100, Udine, Italy

    Manuela Farinosi

Authors
  1. Gian Luca Foresti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Manuela Farinosi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Marco Vernier
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gian Luca Foresti.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Foresti, G.L., Farinosi, M. & Vernier, M. Situational awareness in smart environments: socio-mobile and sensor data fusion for emergency response to disasters. J Ambient Intell Human Comput 6, 239–257 (2015). https://doi.org/10.1007/s12652-014-0227-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-014-0227-x

Keywords

Search

Navigation