Skip to main content

An Intelligent Infrastructure for In-Flight Situation Awareness of Aviation Pilots

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNAI,volume 6780)


This paper presents an infrastructure that integrates intelligent agents in order to monitor, in real time, the attention of aviation pilots during training/operative flight missions. The primary goal of this infrastructure is to make the decision process easier and increase Situation Awareness, thus to increase flight safety pro-actively. The proposed hardware/software platform could be able to anticipate the onset of problems which can lead to incidents, and to make easier the decision making process toward a positive solution of the problem. To attain the goal, a multi-agent system is designed using the most recent technology in the field of artificial vision and of the measurement of psychophysical parameters, starting from the most recent knowledge of visual attention to arrive at the development of an original and innovative model of Augmented Reality. Finally it is provided a case study based on an event actually occurred to prove effectiveness of the proposed platform.


  • Situation Awareness
  • Intelligent Agents
  • Augmented Reality


  1. Flight Safety Foundation: Flight safety digest,

  2. Harris, D., Helen, C.: Muir: Contemporary issues in human factors and aviation safety. Ashgate Publishing, Ltd. (2005)

    Google Scholar 

  3. CAA, P-NPA 25-310, Issue 1 Human Centered Design Requirements. Gatwick, England, UK: UK Civil Aviation Authority (April 2000)

    Google Scholar 

  4. AIA/AECMA: Project Report, Propulsion system malfunction plus inappropriate crew response (PSM+ICR). Tech. Rep. 1 (1998)

    Google Scholar 

  5. Singer, G., Dekker, S.: The ergonomics of flight management systems: Fixing holes in the certification net. Applied Ergonomics 32(3), 247–254 (2001)

    CrossRef  Google Scholar 

  6. Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Computer Graphics and Applications 21(6), 34–47 (2001)

    CrossRef  Google Scholar 

  7. Kobus, D.A., St John, M., Morrison, J.G., Schmorrow, D.: Overview of the darpa augmented cognition technical integration experiment. International Journal of Human-Computer Interaction 17(2), 131–149 (2004)

    CrossRef  Google Scholar 

  8. Schmorrow, D.D.: Foundations of Augmented Cognition. Lawrence Erlbaum, Mahwah (2005)

    Google Scholar 

  9. Schmorrow, D.D., Kruse, A.: Improving Human Performance Through Advanced Cognitive System Technology. In: A1 LCDR MSC USN, Defense Advanced Research Projects Agency. A2 Strategic Analysis Inc, Arlington, VA (2005)

    Google Scholar 

  10. D. A. Kobus, M. St. John, M. R. Risser.: A real-time closed-loop system for predicting and counteracting lapses of attention. Pacific Science And Engineering Group Inc., San Diego CA, USA, Final Tech. Rep. (2008)

    Google Scholar 

  11. Zadeh, L.A.: Fuzzy sets. Information and Control 8, 338–353 (1965)

    MathSciNet  CrossRef  MATH  Google Scholar 

  12. Zadeh, L.A.: Fuzzy Sets, Fuzzy Logic, Fuzzy Systems. World Scientific, Singapore (1996)

    CrossRef  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations


Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Di Nuovo, A.G., Cannavò, R.B., Di Nuovo, S. (2011). An Intelligent Infrastructure for In-Flight Situation Awareness of Aviation Pilots. In: Schmorrow, D.D., Fidopiastis, C.M. (eds) Foundations of Augmented Cognition. Directing the Future of Adaptive Systems. FAC 2011. Lecture Notes in Computer Science(), vol 6780. Springer, Berlin, Heidelberg.

Download citation

  • DOI:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-21851-4

  • Online ISBN: 978-3-642-21852-1

  • eBook Packages: Computer ScienceComputer Science (R0)