Skip to main content
Log in

Pilot performance evaluation of simulated flight approach and landing manoeuvres using quantitative assessment tools

  • Published:
Sādhanā Aims and scope Submit manuscript

Abstract

This research work examines the application of different statistical and empirical analysis methods to quantify pilot performance. A realistic approach and landing flight scenario is executed using the reconfigurable flight simulator at National Aerospace Laboratories and both subjective and quantitative measures are applied to the pilot performance data. Simulations were repeated for different difficult landing conditions like landing with degraded visibility, with crosswinds, with degraded aircraft handling qualities and with emergency conditions. Relative assessment of the different applicable metrics is made and significance of task difficulties on pilot performance is investigated. Changes in the pilot’s control strategy with respect to primary and secondary tasks are also discussed in detail. Results indicate that analysing pilot’s control strategy together with his/her deviations from predetermined flight profile provides a means to quantify pilot performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10

Similar content being viewed by others

References

  1. Bonner M A and Wilson G F 2001 Heart rate measures of flight test and evaluation. Int. J. Aviat. Psychol. 12(1): 63–77

    Article  Google Scholar 

  2. Petkar H, Dande S and Yadav R 2009 A pilot study to assess designer’s mental stress using eye gaze system and electroencephalogram. In: Proceedings of ASME 2009 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, 899–901

  3. Anders G 2001 Pilot’s attention allocation during approach and landing: eye and head tracking research in am A330 full flight simulator. In: 11th International Symposium on Aviation psychology (ISAP), Columbus, OH

  4. Biswas P and Langdon P 2015 Multimodal intelligent eye-gaze tracking system. Int. J. Human Comput. Interact. 31(4): 277–294, doi:10.1080/10447318.2014.1001301

    Article  Google Scholar 

  5. Kramer A F 1990 Physiological metrics of mental workload: a review of recent progress. Navy Personnel Research and Development Centre

  6. Ververs P May and Wickens C D 1998 Head up displays: effect of clutter, display intensity and display location of pilot performance. Int. J. Aviat. Psychol. 8(4): 377–403

    Article  Google Scholar 

  7. Smith J K and Caldwell J A 2004 Methodology for evaluating the simulator flight performance of pilots. Brooks City Base, TX: Air Force Research Laboratory. Report No, AFRL-HE-BR-TR-2004-0118

  8. Hanson C, Schaefer J, Burken J J, Larson D and Johnson M 2014 Complexity and pilot workload metrics for the evaluation of adaptive flight controls on a full scale piloted aircraft. NASA Dryden Flight Research Center; Edwards, CA United States. Document ID. 20140005730

  9. Field E J and Giese S E D 2005 Appraisal of several pilot control activity measures. In: Proceedings of AIAA Atmospheric Flight mechanics conference and exhibit, 15–18 August 2005, San Francisco, California

  10. Watson R W, Ntuen C and Park E 1996 Effects of task difficulty on pilot workload. In: Proceedings of the 19th International Conference on Computers and Industrial Engineering. 31(1–2): 487–490

  11. Boeing 2014 Statistical summary of commercial jet airplane accidents (1959–2014). Washington, USA: Aviation Safety

    Google Scholar 

  12. Pashilkar A A 2014 Trends in simulation technologies for aircraft design. J. Aerosp. Sci. Technol. 22(1): 1–10

    Google Scholar 

  13. Hart S G 1986 NASA Task load Index (TLX).Volume 1.0; Paper and pencil package. Human performance research group, NASA Ames Research Centre. Document ID. 20000021488

  14. Shepherd M J, MacDonald A, Gray W R and Cobb R G 2009 Limited simulator aircraft handling qualities evaluation of an adaptive controller. In: Proceedings of IEEE Aerospace Conference Paper 1292. doi:10.1109/AERO.2009.4839613

  15. Ebbatson M, Huddlestone J, Harris D and Sears R 2007 The application of frequency analysis based performance measures as an adjunct to flight path derived measures of pilot performance. Hum. Factors Aerosp. Saf. 6(4): 383–394

    Google Scholar 

  16. Lampton A and Klyde D H 2012 Power frequency: a metric for analyzing pilot in the loop flying tasks. J. Guidance Control Dyn. 35(5): 1526–1537

  17. Operations circular 9. 2011 Pilot workload, AV.22024/8/2010-FSD. Technical report, Director General of Civil Aviation

  18. Version 05 Standards document 24 2005 Guidance to examiners: multi-pilot aeroplanes type rating skill tests and proficiency checks. Technical report. Civil Aviation Authority

  19. FAA Advisory circular - AC120-28D. 1999. Technical report, Federal Aviation Administration

Download references

Acknowledgements

The work is carried out under a project sanctioned by Aeronautical Research and Development Board (ARDB). The authors sincerely thank the test pilot, Air Cmdr (Retd) Jose Mathappan, for supporting this study with his valuable comments and support for data collection.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Abhay A Pashilkar.

Nomenclature

Nomenclature

δ i :

stick deflection

\( \upomega_{\text{cutoff}} \) :

cut off frequency

ρ:

level of significance

t n :

flight time

X(n):

Fourier coefficients of stick data

X(m):

time series of stick data

PF:

power frequency

η2 :

effect size

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hebbar, P.A., Pashilkar, A.A. Pilot performance evaluation of simulated flight approach and landing manoeuvres using quantitative assessment tools. Sādhanā 42, 405–415 (2017). https://doi.org/10.1007/s12046-017-0613-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12046-017-0613-0

Keywords

Navigation