Skip to main content
SpringerLink
Log in

A Conceptual Augmentation of a Pilot Assistant System with Physiological Measures

  • Conference paper
  • First Online:
Intelligent Human Systems Integration 2020 (IHSI 2020)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1131))

Included in the following conference series:

Abstract

This article describes a concept for augmenting an adaptive assistant system for pilots in human-autonomy teaming missions with physiological measures such as heart rate, electrodermal activity and functional near-infrared spectroscopy. The article also showcases the potential benefits of such an approach. We first present our existing assistant system which utilizes a purely activity-based workload assessment. We then present three steps how we aim to utilize the sensing of various physiological measures of the pilot(s) to improve overall system performance. These steps include: (1) determining a purely physiological-based workload estimate, (2) incorporating physiological measures into the task-based workload estimate, and (3) generating individual operator models by tuning system parameters based on the physiological measures.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Schulte, A., Donath, D., Honecker, F.: Human-system interaction analysis for military pilot activity and mental workload determination. In: Proceedings - 2015 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015, pp. 1375–1380 (2016). https://doi.org/10.1109/SMC.2015.244

  2. Honecker, F., Schulte, A.: Automated online determination of pilot activity under uncertainty by using evidential reasoning. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (2017). https://doi.org/10.1007/978-3-319-58475-1_18

  3. Wickens, C.D.: Multiple resources and mental workload. Hum. Factors J. Hum. Factors Ergon. Soc. 50, 449–455 (2008). https://doi.org/10.1518/001872008x288394

  4. Honecker, F., Brand, Y., Schulte, A.: A task-centered approach for workload-adaptive pilot associate systems. In: Proceedings of 32rd Conference of the European Association for Aviation Psychology, Cascais, Portugal, pp. 485–507 (2016)

    Google Scholar 

  5. Wickens, C.D.: Multiple resources and performance prediction. Theor. Issues Ergon. Sci. 3, 159–177 (2002). https://doi.org/10.1080/14639220210123806

    Article  Google Scholar 

  6. North, R.A., Riley, V.A.: W/INDEX: A Predictive Model of Operator Workload (1989). https://doi.org/10.1007/978-1-4757-9244-7_6

  7. Maiwald, F., Schulte, A.: Mental Resource Demands Prediction as a Key Element for Future Assistant Systems in Military Helicopters. Presented at the (2011). https://doi.org/10.1007/978-3-642-21741-8_62

  8. Mansikka, H., Simola, P., Virtanen, K., Harris, D., Oksama, L.: Fighter pilots’ heart rate, heart rate variation and performance during instrument approaches. Ergonomics 59, 1344–1352 (2016). https://doi.org/10.1080/00140139.2015.1136699

    Article  Google Scholar 

  9. Castaldo, R., Melillo, P., Bracale, U., Caserta, M., Triassi, M., Pecchia, L.: Acute mental stress assessment via short term HRV analysis in healthy adults: a systematic review with meta-analysis. Biomed. Signal Process. Control 18, 370–377 (2015). https://doi.org/10.1016/J.BSPC.2015.02.012

    Article  Google Scholar 

  10. Shaffer, F., McCraty, R., Zerr, C.L.: A healthy heart is not a metronome: an integrative review of the heart’s anatomy and heart rate variability. Front. Psychol. 5, 1040 (2014). https://doi.org/10.3389/fpsyg.2014.01040

    Article  Google Scholar 

  11. Aghajani, H., Garbey, M., Omurtag, A.: Measuring mental workload with EEG + fNIRS. Front. Hum. Neurosci. 11, 359 (2017). https://doi.org/10.3389/fnhum.2017.00359

    Article  Google Scholar 

  12. Collet, C., Salvia, E., Petit-Boulanger, C.: Measuring workload with electrodermal activity during common braking actions. Ergonomics 57, 886–896 (2014). https://doi.org/10.1080/00140139.2014.899627

    Article  Google Scholar 

  13. Heard, J., Harriott, C.E., Adams, J.A.: A survey of workload assessment algorithms. IEEE Trans. Hum.-Mach. Syst. 48, 434–451 (2018). https://doi.org/10.1109/THMS.2017.2782483

    Article  Google Scholar 

  14. Horrey, W.J., Wickens, C.D.: Driving and side task performance: the effects of display clutter, separation, and modality. Hum. Factors 46, 611–624 (2004). https://doi.org/10.1518/hfes.46.4.611.56805

    Article  Google Scholar 

  15. Horrey, W.J., Wickens, C.D.: Multiple Resource Modeling of Task Interference in Vehicle Control, Hazard Awareness and In-vehicle Task Performance, pp. 7–12 (2005). https://doi.org/10.17077/drivingassessment.1082

Download references

Author information

Authors and Affiliations

  1. Universität der Bundeswehr München, Neubiberg, Germany

    Dennis Mund, Evgeni Pavlidis, Matthew Masters & Axel Schulte

Authors
  1. Dennis Mund
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Evgeni Pavlidis
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Matthew Masters
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Axel Schulte
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dennis Mund .

Editor information

Editors and Affiliations

  1. Institute for Advanced Systems Engineering, University of Central Florida, Orlando, FL, USA

    Tareq Ahram

  2. University of Central Florida, Orlando, FL, USA

    Waldemar Karwowski

  3. Dipartimento Di Ingegneria, Edificio 25, Università di Modena e Reggio Emilia, Modena, Modena, Italy

    Alberto Vergnano

  4. Department of Mechanical and Civil Engineering, University of Modena, Modena, Modena, Italy

    Francesco Leali

  5. GRESPI, Université de Reims Champagne-Ardenne, Reims Cedex 2, France

    Redha Taiar

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mund, D., Pavlidis, E., Masters, M., Schulte, A. (2020). A Conceptual Augmentation of a Pilot Assistant System with Physiological Measures. In: Ahram, T., Karwowski, W., Vergnano, A., Leali, F., Taiar, R. (eds) Intelligent Human Systems Integration 2020. IHSI 2020. Advances in Intelligent Systems and Computing, vol 1131. Springer, Cham. https://doi.org/10.1007/978-3-030-39512-4_146

Download citation

Publish with us

Policies and ethics

Search

Navigation