Skip to main content

Improving Emergency Vehicles’ Response Times with the Use of Augmented Reality and Artificial Intelligence

  • Conference paper
  • First Online:
HCI International 2020 – Late Breaking Papers: Digital Human Modeling and Ergonomics, Mobility and Intelligent Environments (HCII 2020)

Abstract

The rapid mobilization of Emergency Services (ES) could be particularly challenging for ES drivers and staff that have to navigate and manoeuvre through various traffic and weather conditions. Driving, in high speeds through dense traffic is a particularly demanding psychomotor task for the ES drivers and could result in collisions and even fatalities. Current attempts to support the driver and reduce the potential driving hazards had limited success. The paper presents the design rationale of a prototype system that utilises Augmented Reality (AR) in the form of a Head-Up Display (HUD) to superimpose guidance information in the real-life environment. The paper will discuss also the requirements for an Artificial Intelligence (AI) system that could analyse the driving conditions and present the best manoeuvring options whilst maintain the road users’ safety. Finally, the paper presents the requirements’ framework for the development of the proposed AR/AI system based on the feedback and suggestions of ten ES drivers. Their feedback will be presented and discussed in detail as it provided essential insight into the everyday challenges of ES operations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Hsiao, H., Chang, J., Simeonov, P.: Preventing emergency vehicle crashes: status and challenges of human factors issues. Hum. Factors 60(7), 1048–1072 (2018). https://doi.org/10.1177/0018720818786132

    Article  Google Scholar 

  2. Lagoo, R., Charissis, V., Harrison, D.K.: Mitigating driver’s distraction: automotive head-up display and gesture recognition system. IEEE Consum. Electron. Mag. 8(5), 79–85 (2019). https://doi.org/10.1109/mce.2019.2923896

    Article  Google Scholar 

  3. Charissis, V., Papanastasiou, S.: Human–machine collaboration through vehicle head up display interface. Cogn. Technol. Work 12(1), 41–50 (2010). https://doi.org/10.1007/s10111-008-0117-0

    Article  Google Scholar 

  4. Frank, M., Drikakis, D., Charissis, V.: Machine learning methods for computational science and engineering. Computation 8(1), 15 (2020). https://doi.org/10.3390/computation8010015. ISSN 2079-3197

    Article  Google Scholar 

  5. Fire (Scotland) Act 2005 - Scottish Parliament Bill, Legislation.gov.uk (2005)

    Google Scholar 

  6. Albertsson, P., Sundström, A.: Evaluation of insight training of ambulance drivers in Sweden using DART, a new e-learning tool. Traffic Injury Prev. 12(6), 621–629 (2011)

    Article  Google Scholar 

  7. Smith, N.: A National Perspective on Ambulance Crashes and Safety: Guidance from the National Highway Traffic Safety Administration on ambulance safety for patients and providers, NHTSA Report, EMS World, pp. 91–94 (2015)

    Google Scholar 

  8. Charissis, V., Papanastasiou, S., Vlachos, G.: Interface development for early notification warning system: full windshield head-up display case study. In: Jacko, J.A. (ed.) HCI 2009. LNCS, vol. 5613, pp. 683–692. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-02583-9_74

    Chapter  Google Scholar 

  9. Kahn, C.A., Pirrallo, R.G., Kuhn, E.M.: Characteristics of fatal ambulance crashes in the United States: an 11-year retrospective study. Prehosp. Emerg. Care 5, 261–269 (2001)

    Article  Google Scholar 

  10. Maguire, B.J., Huntin, K.L., Smith, G.S., Levick, N.R.: Occupational fatalities in emergency medical services: a hidden crisis. Ann. Emerg. Med. 40(6), 625–632 (2002)

    Article  Google Scholar 

  11. Clawson, J.J., Martin, R.L., Cady, G.A., Maio, R.F.: The wake-effect—emergency vehicle-related collisions. Prehospital Disaster Med. 12(4), 274–277 (1997)

    Article  Google Scholar 

  12. Petzäll, K.: Trafiksäkerhet vid ambulanstransporter (Traffic Safety at Emergency Vehicle Transportation). Report 2005/94/90. The Department of Health and Social Sciences, Dalarna University, Falun, Sweden (2006)

    Google Scholar 

  13. Ho, J., Lindquist, M.: Time saved with use of emergency warning lights and siren while responding to requests for emergency medical aid in a rural environment. Prehosp. Emerg. Care 5, 159–162 (2001)

    Article  Google Scholar 

  14. Boslem, S., Moore, J.D., Charissis, V.: Investigating the improvement of the localisation propensity and impact of the emergency vehicle sirens. In: Proceedings of the Society of Automotive Engineers (SAE) World Congress 2011, 12–14 April, Detroit, Michigan, USA (2011)

    Google Scholar 

  15. Charissis, V., Papanastasiou, S., Mackenzie, L., Arafat, S.: Evaluation of collision avoidance prototype head-up display interface for older drivers. In: Jacko, J.A. (ed.) HCI 2011. LNCS, vol. 6763, pp. 367–375. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21616-9_41

    Chapter  Google Scholar 

  16. Wang, S., Charissis, V., Harrison, D.K.: Augmented reality prototype HUD for passenger infotainment in a vehicular environment. Adv. Sci. Technol. Eng. Syst. J. 2(3), 634–641 (2017)

    Article  Google Scholar 

  17. Wang, S., Charissis, V., Campbell, J., Chan, W., Moore, D.J., Harrison, D.K.: An investigation into the use of Virtual Reality technology for passenger infotainment in a vehicular environment. In: International Conference on Advanced Materials for Science and Engineering (IEEE - ICAMSE), Beijing, China, pp. 404–407 (2016). https://doi.org/10.1109/icamse.2016.7840359

  18. Kianfar, R., et al.: Design and experimental validation of a cooperative driving system in the grand cooperative driving challenge. IEEE Trans. Intell. Transp. Syst. 13(3), 994–1007 (2012). https://doi.org/10.1109/tits.2012.2186513

    Article  Google Scholar 

  19. Flanagan, S.K., He, J., Peng, X.: Improving emergency collision avoidance with vehicle to vehicle communications. In: 2018 IEEE 20th International Conference on High-Performance Computing and Communications; IEEE 16th International Conference on Smart City; IEEE 4th International Conference on Data Science and Systems (HPCC/SmartCity/DSS), Exeter, United Kingdom, pp. 1322–1329 (2018). https://doi.org/10.1109/hpcc/smartcity/dss.2018.00220

  20. Charissis, V., Papanastasiou, S., Chan, W., Peytchev, E.: Evolution of a full-windshield HUD designed for current VANET communication standards. In: IEEE Intelligent Transportation Systems International Conference (IEEE ITS), The Hague, Netherlands, pp. 1637–1643 (2013). https://doi.org/10.1109/itsc.2013.6728464

  21. Lagoo, R., Charissis, V., Chan, W., Khan, S., Harrison, D.: Prototype gesture recognition interface for vehicular head-up display system. In: IEEE International Conference on Consumer Electronics, Las Vegas, USA, pp. 1–6 (2018)

    Google Scholar 

  22. Grane, C., Bengtsson, P.: Driving performance during visual and haptic menu selection with the in-vehicle rotary device. Transp. Res. Part F: Traffic Psychol. Behav. 18, 123–135 (2013)

    Article  Google Scholar 

  23. Hui, C., Xianghui, W., Xiqiang, Z., Shaoli, Z.: The evaluation of chinese urban traffic management system application based on intelligent traffic control technology. In: 2014 7th International Conference on Intelligent Computation Technology and Automation, Changsha, pp. 791–795 (2014). https://doi.org/10.1109/icicta.2014.191

  24. Li, N., Zhao, G.: Adaptive signal control for urban traffic network gridlock. In: 2016 UKACC 11th International Conference on Control (CONTROL), Belfast, pp. 1–6 (2016). https://doi.org/10.1109/control.2016.7737520

  25. Bram-Larbi, K.F., Charissis, V., Khan, S., Lagoo, R., Harrison, D.K., Drikakis, D.: Collision avoidance head-up display: design considerations for emergency services’ vehicles. In: IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, USA (2020)

    Google Scholar 

  26. Charissis, V., Naef, M.: Evaluation of prototype automotive head-up display interface: testing driver’s focusing ability through a VR simulation. In: IEEE Intelligent Vehicle Symposium, (IV 2007), Istanbul, Turkey (2007)

    Google Scholar 

  27. Charissis, V., Papanastasiou, S.: Artificial intelligence rationale for autonomous vehicle agents behaviour in driving simulation environment. In: Aramburo, J., Trevino, A.R. (eds.) Robotics, Automation and Control, pp. 314–332. I-Tech Education and Publishing KG, Vienna (2008). ISBN 953761916-8I

    Google Scholar 

  28. Aehlert, B.: Paramedic Practice Today: Above and Beyond, ECC Guidelines (2010)

    Google Scholar 

  29. Okumura, H., Hotta, A., Sasaki, T., Horiuchi, K., Okada, N.: Wide field of view optical combiner for augmented reality head-up displays. In: 2018 IEEE International Conference on Consumer Electronics (IEEE ICCE) (2018)

    Google Scholar 

  30. Li, J., Cheng, H., Guo, H., Qiu, S.: Survey on artificial intelligence for vehicles. Autom. Innov. 1(1), 2–14 (2018). https://doi.org/10.1007/s42154-018-0009-9

    Article  Google Scholar 

  31. Jing, P., Xu, G., Chen, Y., Shi, Y., Zhan, F.: The determinants behind the acceptance of autonomous vehicles: a systematic review. Sustainability 12, 1719 (2020)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to V. Charissis .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bram-Larbi, K.F., Charissis, V., Khan, S., Harrison, D.K., Drikakis, D. (2020). Improving Emergency Vehicles’ Response Times with the Use of Augmented Reality and Artificial Intelligence. In: Stephanidis, C., Duffy, V.G., Streitz, N., Konomi, S., Krömker, H. (eds) HCI International 2020 – Late Breaking Papers: Digital Human Modeling and Ergonomics, Mobility and Intelligent Environments. HCII 2020. Lecture Notes in Computer Science(), vol 12429. Springer, Cham. https://doi.org/10.1007/978-3-030-59987-4_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-59987-4_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-59986-7

  • Online ISBN: 978-3-030-59987-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics