Integration of an Exocentric Orthogonal Coplanar 360 Degree Top View in a Head Worn See-Through Display Supporting Obstacle Awareness for Helicopter Operations

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10905)


The objective was the development of an HMI for helicopter obstacle awareness and warning systems in order to improve the situational and spatial awareness as well as the workload of helicopter pilots. The related work concerning obstacle awareness and warning systems, situational awareness, orthogonal coplanar and perspective representations plus previous work done by DLR was depicted and discussed. The two main aspects of the developed HMI concept were explained, i.e., the combination of the exocentric orthogonal coplanar top view with the egocentric perspective view, and secondly three ways for the integration of the obstacle awareness display inside a head-worn see-through display. The developed HMI concept was applied to two helicopter offshore operations and its specific obstacle situation. The first operation is a hoist operation at the lower access point of an offshore wind turbine. The second regards the landing operation on an offshore platform. From a technical point of view, especially concerning available sensor technologies, helicopter might be fitted with obstacle awareness systems in future. The HMI design is still under investigation in order to support the pilot in a holistic and balanced way.


Situational awareness Spatial awareness 2D/3D representations Helicopter offshore operations Human machine interface Multimodal men machine interaction Cockpit display systems Augmented reality 


  1. 1.
    European Aviation Safety Agency (EASA): Annual Safety Review 2017 (2017).
  2. 2.
    Doehler, H.-U.: Improving visual-conformal displays for helicopter guidance. SPIE Newsroom. International Society for Optics and Photonics (2013). ISSN: 1818-2259
  3. 3.
    Offshore Wind Park Alpha Ventus (2018).
  4. 4.
    German Aerospace Center (DLR), Institute of Flight Guidance: Generic Experimental Cockpit (GECO) (2018).
  5. 5.
    Brunetti, M.: The guardian project: reasons, concept and advantages of a novel obstacle proximity LIDAR system. In: Proceedings of the 40th European Rotorcraft Forum 2014, 2–5 September 2014, Southampton, UK (2014). ISBN: 9781510802568Google Scholar
  6. 6.
    Waanders, T., et al.: Helicopter rotorstrike alerting system. In: Proceedings of the 41st European Rotorcraft Forum 2015, 1–4 September 2015, Munich, Germany (2015). ISBN: 9781510819832Google Scholar
  7. 7.
    Niermann, C.A.: Potential of 3D audio as human-computer interface in future aircraft. In: Harris, D. (ed.) EPCE 2016. LNCS (LNAI), vol. 9736, pp. 429–438. Springer, Cham (2016). ISBN 978-331940029-7. ISSN 03029743CrossRefGoogle Scholar
  8. 8.
    Muellhaeuser, M.: Tactile cuing with active cyclic stick for helicopter obstacle avoidance: development and pilot acceptance. CEAS Aeronaut. J. (2017). ISSN 1869-5582
  9. 9.
    Endsley, M.R.: Toward a theory of situation awareness in dynamic systems. Hum. Factor 37(1), 32–64 (1995)CrossRefGoogle Scholar
  10. 10.
    Endsley, M.R., Jones, D.J.: Designing for Situation Awareness: An Approach to User-Centered Design, 2nd edn. CRC Press, Boca Raton (2004)Google Scholar
  11. 11.
    Wickens, C.D.: Situation awareness and workload in aviation. Curr. Dir. Psychol. Sci. 11(4), 128–133 (2002)CrossRefGoogle Scholar
  12. 12.
    Wickens, C.D. Spatial awareness biases. Technical report No. ARL-02-6/NASA-02-4, University of Illinois, Aviation Research Lab (2002)Google Scholar
  13. 13.
    Wickens, C.D.: The when and how of using 2-D and 3-D displays for operational tasks. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 44(21), 3–403 (2000)Google Scholar
  14. 14.
    Wickens, C.D., Thomas, L.C., Young, R.: Frames of reference for the display of battlefield information: judgment-display dependencies. Hum. Factors: J. Hum. Factors Ergon. Soc. 42(4), 660–675 (2000)CrossRefGoogle Scholar
  15. 15.
    Wickens, C.D., Hollands, J.G., Banbury, S., Parasuraman, R.: Engineering Psychology and Human Performance, 4th edn. Pearson Education, Upper Saddle River (2013)Google Scholar
  16. 16.
    Domini, F., Shah, R., Caudek, C.: Do we perceive a flattened world on the monitor screen? Acta Psychol. 138(3), 359–366 (2011)CrossRefGoogle Scholar
  17. 17.
    Bolton, M.L., Bass, E.J.: Using relative position and temporal judgments to identify biases in spatial awareness for synthetic vision systems. Int. J. Aviat. Psychol. 18(2), 183–206 (2008)CrossRefGoogle Scholar
  18. 18.
    Bolton, M.L., Bass, E.J., Comstock, J.R.: Using relative position and temporal judgments to assess the effects of texture and field of view on spatial awareness for synthetic vision systems displays. Proc. Hum. Factors Soc. 50(1), 71–75 (2006)CrossRefGoogle Scholar
  19. 19.
    Doehler, H.-U., Ernst, J.M., Lueken, T.: Virtual aircraft-fixed cockpit instruments. In: Degraded Visual Environments: Enhanced, Synthetic, and External Vision Solutions 2015, vol. 9471, p. 94710E (2015)Google Scholar
  20. 20.
    Ernst, J.M., Doehler, H.-U., Schmerwitz, S.: A concept for a virtual flight deck shown on an HMD. In: ISI/SCOPUS, vol. 9839(10), Seiten 983909-1 (2016). SPIE Press. SPIE Defense + Commercial Sensing 2016, 17–21 April 2016, Baltimore.
  21. 21.
    Unity Technologies (2018).
  22. 22.
    Offshore Research Platform FINO1 (2018).

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.German Aerospace Center (DLR)Institute of Flight GuidanceBraunschweigGermany

Personalised recommendations