Skip to main content
SpringerLink
Log in

Human Factors Perspective on Next Generation Unmanned Aerial Systems

  • Reference work entry
  • First Online:
Handbook of Unmanned Aerial Vehicles

Abstract

This chapter presents a synthesis of past work on Unmanned Aerial System (UAS) autonomy and user interface design and uses this synthesis to motivate emerging themes in near-term and far-term UAS developments. Issues include user interface design, UAS autonomy, UAS teaming, operator workload, and payload management.

This chapter is a fusion of work from two previously published papers by the authors, integrated and extended to give a fresh perspective on the issues:

  • ML Cummings, S Bruni, S Mercier, PJ Mitchel (2007) Automation architecture for single operator, multiple UAV command and control. Int C2 J 1(2):1–24.

  • M Draper, T Barry, G Calhoun, J Clark, M Draper, M Goodrich, C Jansen, J Kessens, F Kooi, A Lefebvre, S Murray, J Nelson, C Nielsen, G Osga, A Oudenhuijzen, M Quigley, R Shively, B Simpson, R Stone, L van Breda, J van Delft, J van Erp (2006) Advanced operator interfaces. In: Uninhabited military vehicles (UMVs): human factors issues in augmenting the force. Chapter 6. NATO-RTO-TR-HFM-078. Neully-sur-Seine: NATO-RTO. An excerpt written by M. Goodrich from this chapter.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 1,399.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 1,999.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • 32nd Army Air and Missile Defense Command, Patriot Missile Defense Operations during Operation Iraqi Freedom, U. S. Army, Ed. Washington, DC, 2003

    Google Scholar 

  • A. L. Alexander, C.D. Wickens, Synthetic vision systems: flightpath tracking, situation awareness, and visual scanning in an integrated hazard display, in Proceedings of the 13th International Symposium on Aviation Psychology, Oklahoma City, Oklahoma, 2005

    Google Scholar 

  • L. Bertuccelli, N. Pellegrino, M.L. Cummings, Choice modeling of relook tasks for UAV search missions, in IEEE American Control Conference, Baltimore, MD, June 2010

    Google Scholar 

  • D.E. Broadbent, Perception and Communication (Pergamon, Oxford, 1958)

    Book  Google Scholar 

  • J.L. Burke, R.R. Murphy, Human-robot interaction in USAR technical search: two heads are better than one, in Proceedings of the 13th IEEE International Workshop on Robot and Human Interactive Communication Kurashiki, Okayama, Japan, 2004

    Google Scholar 

  • A. S. Clare, M.L. Cummings, Task-based interfaces for decentralized multiple unmanned vehicle control, Proceedings of AUVSI 2011: Unmanned Systems North America, Washington DC, Aug 2011

    Google Scholar 

  • J.L. Cooper, M.A. Goodrich, Portable mini-UAV control interfaces for non-pilots. Presented at the 2005 human factors of UAVs workshop, Mesa, Arizona, 2005

    Google Scholar 

  • J.L. Cooper, Supporting Flight Control for UAV-Assisted Wilderness Search and Rescue through Human Centered Interface Design, Computer Science Department Master’s Thesis, Brigham Young University, Provo, Utah, 2007

    Google Scholar 

  • M.L. Cummings, Automation bias in intelligent time critical decision support systems. Presented at AIAA 3rd intelligent systems conference, Chicago, 2004

    Google Scholar 

  • M.L. Cummings, S. Guerlain, Developing operator capacity estimates for supervisory control of autonomous vehicles. Human Factors 49, 1–15 (2007)

    Article  Google Scholar 

  • M.L. Cummings, P.J. Mitchell, Predicting controller capacity in remote supervision of multiple unmanned vehicles. IEEE Syst. Man Cybern. A 38(2), 451–460 (2008)

    Article  Google Scholar 

  • M.L. Cummings, C.E. Nehme, J. Crandall, Predicting operator capacity for supervisory control of multiple UAVs, in Innovations in Intelligent Machines, ed. by J.S. Chahl, L.C. Jain, A. Mizu-tani, M. Sato-Ilic. Studies in Computational Intelligence, vol. 70 (Springer, Berlin/Heidelberg, 2007)

    Google Scholar 

  • S. Dixon, C.D. Wickens, D. Chang, Unmanned aerial vehicle flight control: false alarms versus misses. Presented at Humans Factors and Ergonomics Society 48th Annual Meeting, New Orleans, 2004

    Google Scholar 

  • S. Dixon, C. Wickens, D. Chang, Mission control of multiple unmanned aerial vehicles: a workload analysis. Human Factors 47(3), 479–487 (2005)

    Article  Google Scholar 

  • R.D. Dunlap, The evolution of a distributed command and control architecture for semi-autonomous air vehicle operations. Presented at Moving Autonomy Forward Conference, Grantham, UK, 2006

    Google Scholar 

  • M.R. Endsley, Toward a theory of situation awareness in dynamic systems. Human Factors 37, 32–64 (1995)

    Article  Google Scholar 

  • M.R. Endsley, D.B. Kaber, Level of automation effects on performance, situation awareness and workload in a dynamic control task. Ergonomics 42, 462–492 (1999)

    Article  Google Scholar 

  • G. L. Feitshans, A.J. Rowe, J.E. Davis, M. Holland, L. Berger, Vigilant spirit control station (VSCS): the face of counter, in Proceedings of the AIAA Guidance, Navigation, and Control Conference, Honolulu, Hawaii, 2008

    Google Scholar 

  • M.A. Goodrich, B.S. Morse, D. Gerhardt, J.L. Cooper, M. Quigley, J.A. Adams, C. Humphrey, Supporting wilderness search and rescue using a camera-equipped mini UAV. J. Field Robot. 25, 89–110 (2008)

    Article  Google Scholar 

  • M.A. Goodrich, A.C. Schultz, Human-robot interaction: a survey. Found. Trends Human Comput. Interact. 1, 203–275 (2007)

    MATH  Google Scholar 

  • B. Hilburn, P.G. Jorna, E.A. Byrne, R. Parasuraman, The effect of adaptive air traffic control (ATC) decision aiding on controller mental workload, in Human-Automation Interaction: Research and Practice (Lawrence Erlbaum, Mahwah, 1997), pp. 84–91

    Google Scholar 

  • K.F. Jackson, P.W. Quimby, M.L. Cummings, MAV-VUE Outdoor Usability Analysis, (HAL2011- 01), MIT Humans and Automation Laboratory, Cambridge, MA, 2011

    Google Scholar 

  • M. Lewis, J. Polvichai, K. Sycara, P. Scerri, Scaling-up human control for large UAV teams, in Human Factors of Remotely Operated Vehicles, ed. by N. Cooke, H. Pringle, H. Pedersen, O. Connor (Elsevier, New York, 2006), pp. 237–250

    Chapter  Google Scholar 

  • M. Lewis, H. Wang, S. Chien, P. Scerri, P. Velagapudi, K. Sycara, B. Kane, Teams organization and performance in multi-human/multi-robot teams, in Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Istanbul, Turkey, 2010

    Google Scholar 

  • L. Lin, M. Roscheck, M.A. Goodrich, B.S. Morse, Supporting wilderness search and rescue with integrated intelligence: autonomy and information at the right time and the right place, in Proceedings of the 24th AAAI Conference on Artificial Intelligence: Special Track on Integrated Intelligence, Atlanta, Georgia, 2010

    Google Scholar 

  • B. Mekdeci, M.L. Cummings, Modeling multiple human operators in the supervisory control of heterogeneous unmanned vehicles, in Proceedings of the 9th Workshop on Performance Metrics for Intelligent Systems, (ACM, New York, 2009)

    Google Scholar 

  • P. Milgram, F. Kishino, A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. E77-d, 1321–1329 (1994)

    Google Scholar 

  • B. S. Morse, C.H. Engh, M.A. Goodrich, UAV video coverage quality maps and prioritized indexing for wilderness search and rescue, in Proceedings of the 5th ACM/IEEE RAS International Conference on Human-Robot Interaction, Osaka, Japan, 2010

    Google Scholar 

  • B. S. Morse, D. Gerhardt, C. Engh, M.A. Goodrich, N. Rasmussen, D. Thornton, D. Eggett, Application and evaluation of spatiotemporal enhancement of live aerial video using temporally local mosaics, in Proceedings of CVPR, Anchorage, Alaska, 2008

    Google Scholar 

  • K.L. Mosier, L.J. Skitka, Human decision makers and automated decision aids: made for each other? in Automation and Human Performance: Theory and Applications, Human Factors in Transportation, ed. by R. Parasuraman, M. Mouloua (Lawrence Erlbaum, Mahwah, 1996), pp. 201–220

    Google Scholar 

  • R.R. Murphy, E. Steimle, C. Griffin, C. Cullins, M. Hall, K. Pratt, Cooperative use of unmanned sea surface and micro aerial vehicles at hurricane Wilma. J. Field Robot. 25, 164–180 (2008)

    Article  Google Scholar 

  • R. Parasuraman, T.B. Sheridan, C.D. Wickens, A model for types and levels of human interaction with automation. IEEE Trans. Syst. Man Cybern. A 30, 286–297 (2000)

    Article  Google Scholar 

  • M. Plumlee, C. Ware, An evaluation method for linking 3D views, in Proceedings of the 2003 Symposium on Interactive 3D Graphics, Monterey, California, 2003

    Google Scholar 

  • L.J. Prinzel, J.R. Comstock Jr., L.J. Glaab, L.J. Kramer, J.J. Arthur, The efficacy of head-down and head-up synthetic vision display concepts for retro- and forward-fit of commercial aircraft. Int. J. Aviat. Psychol. 14, 53–77 (2004)

    Article  Google Scholar 

  • M. Quigley, M.A. Goodrich, R. Beard, Semi-autonomous human-UAV interfaces for fixed-wing mini-UAVs, Proceedings of IROS, Sendai, Japan, 2004

    Google Scholar 

  • H.A. Ruff, S. Narayanan, M.H. Draper, Human interaction with levels of automation and decision- aid fidelity in the supervisory control of multiple simulated unmanned air vehicles. Presence 11, 335–351 (2002)

    Article  Google Scholar 

  • H. A. Ruff, G.L. Calhoun, M.H. Draper, J.V. Fontejon, B.J. Guilfoos, Exploring automation issues in supervisory control of multiple UAVs. Presented at 2nd human performance, situation awareness, and automation conference (HPSAA II), Daytona Beach, FL, 2004

    Google Scholar 

  • J. Rasmussen, Skills, rules, and knowledge; signals, signs, and symbols, and other distractions in human performance models. IEEE Trans. Syst. Man Cybern. SMC-13, 257–266 (1983)

    Article  Google Scholar 

  • T. Schnell, Y. Kwon, S. Merchant, T. Etherington, Improved flight technical performance in flight decks equipped with synthetic vision information system displays. Int. J. Aviat. Psychol. 14, 79–102 (2004)

    Article  Google Scholar 

  • T.B. Sheridan, W.L. Verplank, Human and computer control of undersea teleoperators, MIT, Cambridge, Man-Machine Systems Laboratory Report, 1978

    Google Scholar 

  • T.B. Sheridan, Telerobotics, Automation and Human Supervisory Control (MIT, Cambridge, 1992)

    Google Scholar 

  • M. Sirak, DARPA, Northrop Grumman move into next phase of UAV control architecture. Defense Daily, Nov 29, 2007, Retrieved 2009-03-16

    Google Scholar 

  • P. Velagapudi, P. Scerri, K. Sycara, H. Wang, M. Lewis, J. Wang, Scaling effects in multi-robot control, Proceedings of IROS, Nice, France, 2008

    Google Scholar 

  • K.J. Vicente, K. Christoffersen, A. Pereklita, Supporting operator problem solving through ecological interface design. IEEE Trans. Syst. Man Cybern. 25, 529–545 (1995)

    Article  Google Scholar 

  • A.T. Welford, The psychological refractory period and the timing of high-speed performance – a review and a theory. Br. J. Psychol. 43, 2–19 (1952)

    Google Scholar 

  • J.M. Whetten, M.A. Goodrich, Y. Guo, Beyond robot fan-out: towards multi-operator supervisory control, in Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Istanbul, Turkey, 2010

    Google Scholar 

  • C. D. Wickens, S.E. Gordon, Y. Liu, An Introduction to Human Factors Engineering (Longman, New York, 1998)

    Google Scholar 

  • C. D. Woods, J. Tittle, M. Feil, A. Roesler, Envisioning human-robot coordination in future operations. IEEE Trans. Syst. Man Cybern. A 34, 749–756 (2004)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, Brigham Young University, Provo, UT, USA

    M. A. Goodrich

  2. Department of Aeronautics and Astronautics, Massachusetts Institute of Technology, Cambridge, MA, USA

    M. L. Cummings

Authors
  1. M. A. Goodrich
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. L. Cummings
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to M. A. Goodrich or M. L. Cummings .

Editor information

Editors and Affiliations

  1. Department of Electrical and Computer Engineering, University of Denver, Denver, Colorado, USA

    Kimon P. Valavanis

  2. School of Electrical and Computer Engineering, The Georgia Institute of Technology, Atlanta, Georgia, USA

    George J. Vachtsevanos

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer Science+Business Media Dordrecht

About this entry

Cite this entry

Goodrich, M.A., Cummings, M.L. (2015). Human Factors Perspective on Next Generation Unmanned Aerial Systems. In: Valavanis, K., Vachtsevanos, G. (eds) Handbook of Unmanned Aerial Vehicles. Springer, Dordrecht. https://doi.org/10.1007/978-90-481-9707-1_23

Download citation

Publish with us

Policies and ethics

Search

Navigation