An Intelligent Infrastructure for In-Flight Situation Awareness of Aviation Pilots

  • Alessandro G. Di Nuovo
  • Rosario Bruno Cannavò
  • Santo Di Nuovo
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6780)


This paper presents an infrastructure that integrates intelligent agents in order to monitor, in real time, the attention of aviation pilots during training/operative flight missions. The primary goal of this infrastructure is to make the decision process easier and increase Situation Awareness, thus to increase flight safety pro-actively. The proposed hardware/software platform could be able to anticipate the onset of problems which can lead to incidents, and to make easier the decision making process toward a positive solution of the problem. To attain the goal, a multi-agent system is designed using the most recent technology in the field of artificial vision and of the measurement of psychophysical parameters, starting from the most recent knowledge of visual attention to arrive at the development of an original and innovative model of Augmented Reality. Finally it is provided a case study based on an event actually occurred to prove effectiveness of the proposed platform.


Situation Awareness Intelligent Agents Augmented Reality 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Flight Safety Foundation: Flight safety digest,
  2. 2.
    Harris, D., Helen, C.: Muir: Contemporary issues in human factors and aviation safety. Ashgate Publishing, Ltd. (2005)Google Scholar
  3. 3.
    CAA, P-NPA 25-310, Issue 1 Human Centered Design Requirements. Gatwick, England, UK: UK Civil Aviation Authority (April 2000)Google Scholar
  4. 4.
    AIA/AECMA: Project Report, Propulsion system malfunction plus inappropriate crew response (PSM+ICR). Tech. Rep. 1 (1998)Google Scholar
  5. 5.
    Singer, G., Dekker, S.: The ergonomics of flight management systems: Fixing holes in the certification net. Applied Ergonomics 32(3), 247–254 (2001)CrossRefGoogle Scholar
  6. 6.
    Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Computer Graphics and Applications 21(6), 34–47 (2001)CrossRefGoogle Scholar
  7. 7.
    Kobus, D.A., St John, M., Morrison, J.G., Schmorrow, D.: Overview of the darpa augmented cognition technical integration experiment. International Journal of Human-Computer Interaction 17(2), 131–149 (2004)CrossRefGoogle Scholar
  8. 8.
    Schmorrow, D.D.: Foundations of Augmented Cognition. Lawrence Erlbaum, Mahwah (2005)Google Scholar
  9. 9.
    Schmorrow, D.D., Kruse, A.: Improving Human Performance Through Advanced Cognitive System Technology. In: A1 LCDR MSC USN, Defense Advanced Research Projects Agency. A2 Strategic Analysis Inc, Arlington, VA (2005)Google Scholar
  10. 10.
    D. A. Kobus, M. St. John, M. R. Risser.: A real-time closed-loop system for predicting and counteracting lapses of attention. Pacific Science And Engineering Group Inc., San Diego CA, USA, Final Tech. Rep. (2008)Google Scholar
  11. 11.
    Zadeh, L.A.: Fuzzy sets. Information and Control 8, 338–353 (1965)MathSciNetCrossRefzbMATHGoogle Scholar
  12. 12.
    Zadeh, L.A.: Fuzzy Sets, Fuzzy Logic, Fuzzy Systems. World Scientific, Singapore (1996)CrossRefzbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Alessandro G. Di Nuovo
    • 1
    • 2
  • Rosario Bruno Cannavò
    • 1
  • Santo Di Nuovo
    • 2
  1. 1.Cognitive Technologies and Services S.r.l.CataniaItaly
  2. 2.Università degli Studi di CataniaCataniaItaly

Personalised recommendations