Advertisement

Engineering Model for Ethical Decision-Making and Regulation in Autonomous Systems

  • Scott HeritschEmail author
  • Linell A. Letendre
Living reference work entry

Latest version View entry history

Abstract

Humans learn to live within societal rules and norms and make ethical decisions through a process of trial and error, complete with positive and negative inputs and consequences for faulty choices. People learn a vast array of boundary conditions and then apply judgment across a variety of changing environments to make sound, ethical, and moral choices. To help make these judgments, humans are equipped with three distinct and overlapping cognitive reasoning capabilities: deductive, inductive, and abductive. While current computational cognition is confined almost exclusively to deductive reasoning, the field of autonomy – from engineers and manufacturers to operators and policy makers – should begin asking tough questions about how autonomous systems might begin to use inductive and abductive reasoning in an ethical manner. This chapter explores principles in autonomous system design focused on ensuring the responsible and ethical application of autonomy within practical-use technology. To do this, the chapter proposes that system architects must build in transparency of both the reasoning techniques employed in the autonomous system and the contextual features used by the reasoning models. Furthermore, the ability to expand contextual boundaries of an autonomous system must be appropriately linked to the environmental complexity in which it operates and the user’s capabilities. The creation of an ethical decision-making model for autonomous systems helps both engineers in the development of such systems and policy makers in the regulations for appropriate use and restriction of such systems.

Keywords

Autonomy Engineering design Abductive Inductive Deductive Cognitive reasoning Regulation Contextual boundaries Heuristics Ethical design Context Features World model 

References

  1. Y. Abu-Mostafa, Lecture 14 – support vector machines (California Institute of Technology, Machine Learning Video Library, 2012), https://work.caltech.edu/library/140.html. Accessed 4 Feb 2017
  2. J. Adler, L. Rips, Reasoning, 1st edn. (Cambridge University Press, Cambridge, 2008)CrossRefGoogle Scholar
  3. AGM-88 high-speed anti-radiation missile (HARM), (Jane’s air-launched weapons, 2015),https://janes.ihs.com/AirLaunchedWeapons/Display/1306854. Accessed 6 Feb 2017
  4. M. Calvo, Uncertainty and innovation: the need for effective regulations to foster successful integration of personal and commercial drones. Southwest. J. Int. Law 22, 189 (2016)Google Scholar
  5. J. Estefan, Survey of model-based systems engineering (MBSE) methodologies (International Council on Systems Engineering MBSE Initiative, 2007), http://www.omgsysml.org/MBSE_Methodology_Survey_ RevB.pdf. Accessed 3 Nov 2016
  6. A. Feeney, E. Heit, Inductive Reasoning, 1st edn. (Cambridge University Press, Cambridge, 2007)CrossRefGoogle Scholar
  7. F.A. Fiedler, G.H. Reynolds, Legal problems of nanotechnology: an overview. South. Calif. Interdisc. Law J. 3, 593 (1994)Google Scholar
  8. E. Guizzo, Autonomous weapons “Could Be Developed For Use Within Years,” Says Arms-Control Group (IEEE Spectrum, 2016). http://spectrum.ieee.org/automaton/robotics/military-robots/autonomous-weapons-could-be-developed-for-use-within-years. Accessed 4 Feb 2017
  9. D. Gunning, Explainable artificial intelligence (XAI) (Defense Advanced Research Projects Agency, 2016), http://www.darpa.mil/program/explainable-artificial-intelligence). Accessed 4 Feb 2017
  10. S. Haykin, Neural Networks and Learning Machines, 1st edn. (Prentice Hall/Pearson, New York, 2009)Google Scholar
  11. J. Markoff, Tesla and google take different roads to self-driving car, N.Y. Times, 2016., https://www.nytimes.com/2016/07/05/business/tesla-and-google-take-different-roads-to-self-driving-car.html?_r=0. Accessed 4 Feb 2017
  12. P. J. Spielmann, Israeli killer robots could be banned under UN proposal (The Times of Israel, 2013), http://www.timesofisrael.com/israeli-killer-robots-could-be-banned-under-un-proposal/
  13. M. Streetly, IAI Harpy, IHS Jane’s All the World’s Aircraft: Unmanned (IHS Jane’s, 2016), p. 104Google Scholar
  14. V. Sutton, Nanotechnology Law and Policy: Cases and Materials (Carolina Academic Press, Durham, 2011)Google Scholar
  15. L. Tung, MIT’s latest breakthrough? Getting AIs to explain their decisions (ZDNet, 2016) http://www.zdnet.com/article/mits-latest-breakthrough-getting-ais-to-explain-their-decisions/. Accessed 4 Feb 2017
  16. P. Viola, M. Jones, Rapid object detection using a boosted cascade of simple features, in Proceeding on the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2001)Google Scholar
  17. D. Walton, Abductive Reasoning, 1st edn. (University of Alabama, Tuscaloosa, 2005)Google Scholar

Copyright information

© This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply 2018

Authors and Affiliations

  1. 1.U.S. Air Force (retired)WashingtonUSA
  2. 2.Department of LawU.S. Air Force AcademyColorado SpringsUSA

Section editors and affiliations

  • Dawn Zoldi
    • 1
  1. 1.ColoradoUSA

Personalised recommendations