Skip to main content

An Explainable Multimodal Fusion Approach for Mass Casualty Incidents

  • Conference paper
  • First Online:
Database and Expert Systems Applications - DEXA 2022 Workshops (DEXA 2022)


During a Mass Casualty Incident, it is essential to make effective decisions to save lives and nursing the injured. This paper presents a work in progress on the design and development of an explainable decision support system, intended for the medical personnel and care givers, that capitalises on multiple modalities to achieve situational awareness and pre-hospital life support. Our novelty is two-fold: first, we use state-of-the-art techniques for combining static and time-series data in deep recurrent neural networks, and second we increase the trustworthiness of the system by enriching it with neurosymbolic explainable capabilities.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others


  1. 1.

  2. 2.

  3. 3.


  1. Abuhmed, T., El-Sappagh, S., Alonso, J.M.: Robust hybrid deep learning models for Alzheimer’s progression detection. Knowl.-Based Syst. 213, 106688 (2021)

    Google Scholar 

  2. Choi, E., Schuetz, A., Stewart, W., Sun, J.: Using recurrent neural network models for early detection of heart failure onset. Am. Med. Inform. Assoc. 24, 361–370 (2016)

    Article  Google Scholar 

  3. Futia, G., Vetró, A.: On the integration of knowledge graphs into deep learning models for a more comprehensible AI-three challenges for future research. Information 11(2), 122 (2020)

    Article  Google Scholar 

  4. Guillaume, A., Bengio, Y.: Understanding intermediate layers using linear classifier probes. In: ICLR (Workshop) (2017)

    Google Scholar 

  5. Lauritsen, S., et al.: Explainable artificial intelligence model to predict acute critical illness from electronic health records. Nature Commun. 11, 1–11 (2020)

    Article  Google Scholar 

  6. Liu, X., et al.: Top-Net: tachycardia onset early prediction using bi-directional LSTM in a medical-grade wearable multi-sensor system. Med. Inform. 9, e18803 (2020)

    Google Scholar 

  7. Muralitharan, S., et al.: Machine learning-based early warning systems for clinical deterioration: a systematic scoping review. J. Med. Internet Res. 23, e25187 (2020)

    Article  Google Scholar 

  8. World Health Organization: Mass casualty management systems. Strategies and guidelines for building health sector capacity, Geneva, Switzerland (2007)

    Google Scholar 

  9. de Sousa Ribeiro, M., Leite, J.: Aligning artificial neural networks and ontologies towards explainable AI. Artif. Intell. 35(6), 4932–4940 (2021)

    Google Scholar 

  10. Tonekaboni, S., Joshi, S., McCradden, M., Goldenberg, A.: What clinicians want: contextualizing explainable machine learning for clinical end use. In: Machine Learning for Healthcare Conference, MLHC, vol. 106, pp. 359–380. PMLR (2019)

    Google Scholar 

  11. Xie, F., et al.: Deep learning for temporal data representation in electronic health records: a systematic review of challenges and methodologies. J. Biomed. Inform. 126, 103980 (2022)

    Article  Google Scholar 

  12. Yang, M., et al.: An explainable artificial intelligence predictor for early detection of sepsis. Crit. Care Med. 48(11), e1096 (2020)

    Article  Google Scholar 

Download references


This work has received funding from the European Union’s H2020 RIA projects NIGHTINGALE (101021957) and INGENIOUS (833435). Content reflects only the authors’ view and the Research Executive Agency (REA) and the European Commission are not responsible for any use that may be made of the information it contains.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Zoe Vasileiou .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Vasileiou, Z., Meditskos, G., Vrochidis, S., Bassiliades, N. (2022). An Explainable Multimodal Fusion Approach for Mass Casualty Incidents. In: Kotsis, G., et al. Database and Expert Systems Applications - DEXA 2022 Workshops. DEXA 2022. Communications in Computer and Information Science, vol 1633. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-14342-7

  • Online ISBN: 978-3-031-14343-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics