Abstract
This paper examines the development of training for effective interaction with multi-level automation, i.e., a system that switches between functions and roles corresponding to different levels of automation. These interactions need to span not only the nominal procedures and skills expected of the operator, but also effective reasoning about when and whether the automation should be employed. This suggests framing the operator’s tasks using Rasmussen’s classical categorization of human behavior as skill based, rule based, or knowledge based (SRK), thereby providing appropriate insights into appropriate training objectives and methods. This paper uses the aircraft traffic alert and collision avoidance system as a case study, demonstrating the application of the SRK framework to develop pilot training. Comparison of pilot behavior with and without this modified training highlights the training’s ability to improve interaction with the automation, leading to recommendations for broader application of the SRK framework in training development.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
Concerns with offering the “same” training generally are framed as following the same instructional process, although feedback by instructors or repeats of training events can adapt to the need of the pilot trainee. It does, however, constrain the extent to which the instructional process itself can be individualized based on some assessment of the trainee’s learning styles or other characteristics.
References
Billings CE (1996) Aviation automation: the search for a human centered approach. Lawrence Erlbaum Associates, Hillsdale
Boucek G, White R, Smith W, Kraus J (1982) Traffic alert and collision avoidance system. Report No. DOT/FAA/RD-82/49. Developmental simulation, Federal Aviation Administration, Seattle, WA
Boucek G, Pfaff T, White W, Smith W (1985) Traffic alert and collision avoidance system—operational simulation. Report No. DOT/FAA/PM-85/10. Federal Aviation Administration, Seattle, WA
Casner SM, Geven RW, Williams KT (2012) The effectiveness of airline pilot training for abnormal events. Hum Factors J Hum Factors Ergon Soc 55:477–485. doi:10.1177/0018720812466893
Cleveland WP (2013) Improving pilot understanding of TCAS through the traffic situation display improving pilot understanding of TCAS. Georgia Institute of Technology, Atlanta
Coso AE, Fleming ES, Pritchett AR (2011) Characterizing pilots’ interactions with the aircraft collision avoidance system. In: International symposium of aviation psychologists
Eurocontrol (2011) ACAS II Bulletin: Focus on pilot training. http://www.skybrary.aero/bookshelf/books/1444.pdf. Accessed 8 Jan 2016
Federal Aviation Administration (2011a) Introduction to TCAS II version 7.1. Tech Report No. HQ-111358. Washington
Federal Aviation Administration (2011b) Advisory circular no. 120-55C: air carrier operational approval and use of TCAS II. Tech Report No. 120-55C. Washington
Federal Aviation Administration (2013) Report on the operational use of flight path management systems. Washington
Fleming ES, Pritchett AR (2015) Training pilots for collision avoidance within a realistic operating context. J Aerosp Inf Syst 12:467–475. doi:10.2514/1.I010291
Jenkins DP, Stanton NA, Salmon PM, Walker GH (2009) Cognitive work analysis: coping with complexity. Ashgate, Farnham, pp 155–196
Kilgore R, St-Cyr O (2006) The SRK inventory: a tool for structuring and capturing a worker competencies analysis. In: Human factors and ergonomics society annual meeting proceedings, pp 506–509
Lebron JE, Mulder SJ (1985) System safety study of minimum TCAS II. Report No. DOT/FAA/PM-85/12. Department of Transportation, Atlantic City, NJ
Leplat J (1989) Simulation and simulators in training: some comments. In: Bainbridge LD, Ruiz-Quintanilla SA (eds) Developing skills with information technology. Wiley, New York, pp 277–292
Lintern G, Naikar N (2000) The use of work domain analysis for the design of training systems. In: Proceedings of the human factors and ergonomics society annual meeting, pp 198–201
McIlroy RC, Stanton NA (2015) Ecological interface design two decades on: whatever happened to the SRK taxonomy? IEEE Trans Human Mach Syst 45:145–163. doi:10.1109/THMS.2014.2369372
Mellone VJ (1993) TCAS II, genie out of the bottle. ASRS Directline
Norros L (2004) Acting under uncertainty. The core-task analysis in ecological study of work. Espoo, VTT, Finland. http://www.vtt.fi/inf/pdf/publications/2004/P546.pdf. Accessed 8 Jan 2016
Olsen S, Rasmussen J (1989) The reflective expert and the prenovice: notes on skill-, rule- and knowledge-based performance in the setting of instruction and training. In: Bainbridge L, Quintanilla S (eds) Developing skills with information technology. Wiley, Chichester, pp 9–33
Olson WA, Olszta JE (2010) TCAS operational performance assessment in the US national airspace. In: Digital avionics systems conference (DASC), 2010 IEEE/AIAA 29th. IEEE, Salt Lake City, pp 1–11
Olszta JE, Olson WA (2011) Characterization and analysis of traffic alert and collision avoidance resolution advisories resulting from 500′ and 1,000′ vertical separation. In: Ninth USA/Europe air traffic management research and development seminar. Berlin, Germany
Parasuraman R, Sheridan Thomas B, Wickens CD (2000) A model for types and levels of human interaction with automation. IEEE Trans Syst Man Cybern A 30:286–297
Popescu V, Cleveland WP, Boidot E et al (2013) Reliably creating collision avoidance advisories in piloted simulations. IEEE Trans Syst Man Cybern 43:416–420
Pritchett AR (1999) Pilot performance at collision avoidance during closely spaced parallel approaches. Air Traffic Control Q 7:47–75
Pritchett AR (2005) Reviewing the role of cockpit alerting systems. In: Harris D, Murris HC (eds) Contemporary issues in human factors and aviation safety. Ashgate, London, pp 47–80
Pritchett AR (2014) Can we automate compliance to collision avoidance resolution advisories? In: Proceedings of the human factors and ergonomics society annual meeting 58th meeting. Chicago, pp 97–101
Pritchett AR, Fleming ES (2013) Pilot compliance to TCAS resolution advisories. In: Proceedings of the 2013 IEEE/AIAA 32nd digital avionics systems conference. Syracuse
Radio Technical Commission for Aeronautics (2008) Minimum operational performance standards for traffic alert and collision avoidance system II. DO-185B
Rasmussen J (1983) Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models. IEEE Trans Syst Man Cybern 13:257–266
Rasmussen J, Vicente K (1989) Coping with human errors through system design: implications for ecological interface design. Int J Man Mach Stud 31:517–534
Rasmussen J, Pejtersen AM, Goodstein LP (1994) Cognitive systems engineering. Wiley, Indianapolis
Sanderson PM, Naikar N, Lintern G, Goss S (1999) Use of cognitive work analysis across the system life cycle: from requirements to decommissioning. Proc Hum Factors Ergon Soc Annu Meet 43:318–322
Sheridan TB, Verplank WL (1978) Human and computer control of undersea teleoperators. Office of Naval Research, Cambridge
Taiwan Aviation Safety Council (2007) Far Eastern Air Transport Flight EF306, Boeing 757-200/Thai International Airways Flight TG659, Boeing 777-300 Near Collision at an Altitude of 34,000 Ft. and 99 NM South of Jeju Island, Korea on November 16, 2006: factual data report
Vicente KJ (1999) Cognitive work analysis: toward safe, productive, and healthy computer-based work. Lawrence Earlbaum Associates, Mahwah
Vicente KJ (2002) Ecological interface design: progress and challenges. Hum Factors 44:62–78
Vicente KJ, Rasmussen J (1992) Ecological interface design: theoretical foundations. IEEE Trans Syst Man Cybern 22:589–606
Acknowledgments
The authors are grateful for the time of the pilots who participated in these studies. Additionally, the authors thank Jonathan Zoetrum, William Cleveland, Jelle Wissink, Dhruv Thakkar, Thomas Legrande, Vlad Popescu, Henry Tran, Jack Ridderhof, Alyssa Whitlock, Rachel Haga, and Justin Mullins for their assistance in preparing and running the flight simulator studies and in data analysis. The authors also gratefully acknowledge the time and expertise provided by Wes Olson of MIT Lincoln Labs and Tom McCloy of the FAA. This work was supported in part by a Cooperative Agreement (DTFAWA-10-C-00084) with the Federal Aviation Administration (FAA) Human Factors Research and Engineering Group. Since completing this study and during preparation of this manuscript, the first author has been supported by the National Science Foundation Graduate Research Fellowship under Grant No. DGE-0644493.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Fleming, E., Pritchett, A. SRK as a framework for the development of training for effective interaction with multi-level automation. Cogn Tech Work 18, 511–528 (2016). https://doi.org/10.1007/s10111-016-0376-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10111-016-0376-0