Skip to main content

EEG-Engagement Index and Auditory Alarm Misperception: An Inattentional Deafness Study in Actual Flight Condition

Part of the Advances in Intelligent Systems and Computing book series (AISC,volume 586)

Abstract

The inability to detect auditory alarms is a critical issue in many domains such as aviation. An interesting prospect for flight safety is to understand the neural mechanisms underpinning auditory alarm misperception under actual flight condition. We conducted an experiment in which four pilots were to respond by button press when they heard an auditory alarm. The 64 channel Cognionics dry-wireless EEG system was used to measure brain activity in a 4 seat light aircraft. An instructor was present on all flights and in charge of initiating the various scenarios to induce two levels of task engagement (simple navigation task vs. complex maneuvering task). Our experiment revealed that inattentional deafness to single auditory alarms could take place as the pilots missed a mean number of 12.5 alarms occurring mostly during the complex maneuvering condition, when the EEG engagement index was high.

Keywords

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
EUR   29.95
Price includes VAT (France)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR   117.69
Price includes VAT (France)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR   158.24
Price includes VAT (France)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Parasuraman, R., Rizzo, M.: Neuroergonomics: The brain at work. Oxford University Press, Oxford (2007)

    Google Scholar 

  2. Bliss, J.P.: Investigation of alarm-related accidents and incidents in aviation. Int. J. Aviat. Psychol. 13, 249–268 (2003)

    CrossRef  Google Scholar 

  3. Dehais, F., Tessier, C., Christophe, L., Reuzeau, F.: The perseveration syndrome in the pilotís activity: guidelines and cognitive countermeasures. Hum. Error Saf. Syst. Dev. 68–80 (2010)

    Google Scholar 

  4. Bliss, J.P., Dunn, M.C.: Behavioural implications of alarm mistrust as a function of task workload. Ergonomics 43, 1283–1300 (2000)

    CrossRef  Google Scholar 

  5. Peryer, G., Noyes, J., Pleydell-Pearce, K., Lieven, N.: Auditory alert characteristics: a survey of pilot views. Int. J. Aviat. Psychol. 15, 233–250 (2005)

    CrossRef  Google Scholar 

  6. Hasanain, B., Boyd, A.D., Edworthy, J., Bolton, M.L.: A formal approach to discovering simultaneous additive masking between auditory medical alarms. Appl. Ergon. 58, 500–514 (2017)

    CrossRef  Google Scholar 

  7. Molloy, K., Griffiths, T.D., Chait, M., Lavie, N.: Inattentional deafness: visual load leads to time-specific suppression of auditory evoked responses. J. Neurosci. 35, 16046–16054 (2015)

    CrossRef  Google Scholar 

  8. Macdonald, J.S., Lavie, N.: Visual perceptual load induces inattentional deafness. Atten. Percept. Psychophys. 73, 1780–1789 (2011)

    CrossRef  Google Scholar 

  9. Raveh, D., Lavie, N.: Load-induced inattentional deafness. Atten. Percept. Psychophys. 77, 483–492 (2015)

    CrossRef  Google Scholar 

  10. Lebib, R., Papo, D., de Bode, S., Baudonnière, P.-M.: Evidence of a visual-to-auditory cross-modal sensory gating phenomenon as reflected by the human P50 event-related brain potential modulation. Neurosci. Lett. 341, 185–188 (2003)

    CrossRef  Google Scholar 

  11. Scannella, S., Causse, M., Chauveau, N., Pastor, J., Dehais, F.: Effects of the audiovisual conflict on auditory early processes. Int. J. Psychophysiol. 89, 115–122 (2013)

    CrossRef  Google Scholar 

  12. Callan, D.E., Dehais, F., Gonthier, N., Durantin, G.: Inattentional deafness is signified by activity in brain regions involved with attentional bottleneck. Presented at the SFN 2016, San Diego (2016)

    Google Scholar 

  13. Dehais, F., Causse, M., Vachon, F., Régis, N., Menant, E., Tremblay, S.: Failure to detect critical auditory alerts in the cockpit evidence for inattentional deafness. Hum. Factors J. Hum. Factors Ergon. Soc. 56, 631–644 (2014)

    Google Scholar 

  14. Dehais, F., Causse, M., Vachon, F., Regis, N., Menant, E., Tremblay, S.: Inattentional deafness to auditory alarms in aviation: a safety issue. Hum. Factors J. Hum. Factors Ergon. Soc. (Submitted)

    Google Scholar 

  15. Scannella, S., Roy, R.N., Laouar, A., Dehais, F.: Auditory neglect in the cockpit: using ERPS to disentangle early from late processes in the inattentional deafness phenomenon. Presented at the Neuroergonomics 2016, Paris (2016)

    Google Scholar 

  16. Callan, D.E., Gateau, T., Gonthier, N., Dehais, F.: Neural signatures of inattentional deafness in airplane pilots recorded in real flight with dry-wireless EEG. Presented at the Neuroergonomics 2016, Paris (2016)

    Google Scholar 

  17. Causse, M., Péran, P., Dehais, F., Caravasso, C., Zeffiro, T., Sabatini, U., Pastor, J.: Affective decision making under uncertainty during a plausible aviation task: an fMRI study. NeuroImage 71, 19–29 (2013)

    CrossRef  Google Scholar 

  18. Causse, M., Dehais, F., Péran, P., Sabatini, U., Pastor, J.: The effects of emotion on pilot decision-making: a neuroergonomic approach to aviation safety. Transp. Res. Part C Emerg. Technol. 33, 272–281 (2012)

    CrossRef  Google Scholar 

  19. Dehais, F., Causse, M., Régis, N., Menant, E., Labedan, P., Vachon, F., Tremblay, S.: Missing critical auditory alarms in aeronautics: evidence for inattentional deafness? Presented at the Proceedings of the Human Factors and Ergonomics Society Annual Meeting (2012)

    Google Scholar 

  20. Dehais, F., Causse, M., Vachon, F., Régis, N., Menant, E., Tremblay, S.: Failure to detect critical auditory alerts in the cockpit evidence for inattentional deafness. Hum. Factors J. Hum. Factors Ergon. Soc. 56(4), 631–644 (2013)

    CrossRef  Google Scholar 

  21. Dehais, F., Roy, R.N., Gateau, T., Scannella, S.: Auditory alarm misperception in the cockpit: an EEG study of inattentional deafness. In: Schmorrow, D., Fidopiastis, C. (eds.) Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience, pp. 177–187. Springer, Heidelberg (2016)

    Google Scholar 

  22. Prinzel, L.J., Freeman, F.G., Scerbo, M.W., Mikulka, P.J., Pope, A.T.: A closed-loop system for examining psychophysiological measures for adaptive task allocation. Int. J. Aviat. Psychol. 10, 393–410 (2000)

    CrossRef  Google Scholar 

  23. Chaouachi, M., Chalfoun, P., Jraidi, I., Frasson, C.: Affect and mental engagement: towards adaptability for intelligent systems. In: Proceedings of the 23rd International FLAIRS Conference. AAAI Press (2010)

    Google Scholar 

  24. Freeman, F.G., Mikulka, P.J., Prinzel, L.J., Scerbo, M.W.: Evaluation of an adaptive automation system using three EEG indices with a visual tracking task. Biol. Psychol. 50, 61–76 (1999)

    CrossRef  Google Scholar 

  25. Poussot, C., Roy, R.N., Bovo, A., Gateau, T., Dehais, F., Carvalho, C.: A Loewner-based approach for the approximation of engagement-related neurophysiological features. Presented at the Submitted to IFAC, Toulouse (2017)

    Google Scholar 

  26. Dehais, F., Tessier, C., Chaudron, L.: GHOST: experimenting conflicts countermeasures in the pilot’s activity. In: Proceedings of International Joint Conference Artificial Intelligence IJCAI, vol. 18, pp. 163–168 (2003)

    Google Scholar 

  27. Callan, D., Durantin, G., Terzibas, C.: Classification of single-trial auditory events using dry-wireless EEG during real and motion simulated flight. Front. Syst. Neurosci. 9, 11 (2015)

    CrossRef  Google Scholar 

  28. Andéol, G., Suied, C., Scannella, S., Dehais, F.: The spatial release of cognitive load in cocktail party is determined by the relative levels of the talkers. J. Assoc. Res. Otolaryngol. 1–8 (2017)

    Google Scholar 

  29. Roy, R.N., Charbonnier, S., Campagne, A., Bonnet, S.: Efficient mental workload estimation using task-independent EEG features. J. Neural Eng. 13, 026019 (2016)

    CrossRef  Google Scholar 

Download references

Acknowledgments

This work was supported by the AXA Research Fund (“Neuroergonomics for flight safety”). We would like to thank Stephane Juaneda (chief pilot), Etienne Perrin (flight instructor) and Fabrice Bazelot (chief mechanics) for their assistance in conducting the experiments.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Frédéric Dehais .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Cite this paper

Dehais, F., Roy, R.N., Durantin, G., Gateau, T., Callan, D. (2018). EEG-Engagement Index and Auditory Alarm Misperception: An Inattentional Deafness Study in Actual Flight Condition. In: Baldwin, C. (eds) Advances in Neuroergonomics and Cognitive Engineering. AHFE 2017. Advances in Intelligent Systems and Computing, vol 586. Springer, Cham. https://doi.org/10.1007/978-3-319-60642-2_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-60642-2_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-60641-5

  • Online ISBN: 978-3-319-60642-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics