Who Should Decide How Machines Make Morally Laden Decisions?
- 2.1k Downloads
Who should decide how a machine will decide what to do when it is driving a car, performing a medical procedure, or, more generally, when it is facing any kind of morally laden decision? More and more, machines are making complex decisions with a considerable level of autonomy. We should be much more preoccupied by this problem than we currently are. After a series of preliminary remarks, this paper will go over four possible answers to the question raised above. First, we may claim that it is the maker of a machine that gets to decide how it will behave in morally laden scenarios. Second, we may claim that the users of a machine should decide. Third, that decision may have to be made collectively or, fourth, by other machines built for this special purpose. The paper argues that each of these approaches suffers from its own shortcomings, and it concludes by showing, among other things, which approaches should be emphasized for different types of machines, situations, and/or morally laden decisions.
KeywordsArtificial intelligence Ethics Self-driving car Collective decision-making Regulation Public policies Market freedom Economic efficiency Moral agency
The ideas behind this paper were presented at the Centre de recherche en éthique at the Université de Montréal in Spring 2016. I would like to thank the members of the Centre for their useful comments.
- Ackerman, B. A. (1980). Social justice in the liberal state. New Haven: Yale University Press.Google Scholar
- Allen, C., Wallach, W., & Smith, I. (2006). Why machine ethics. IEEE Computer Society, 21(4), 12–17.Google Scholar
- Anderson, M., & Anderson, S. L. (2007). Machine ethics: Creating an ethical intelligent agent. AI Magazine, 28(4), 15.Google Scholar
- Appiah, A. (2008). Experiments in ethics. Cambridge: Harvard University Press.Google Scholar
- Bonnefon, J.-F., Shariff, A., & Rahwan, I. (2015). Autonomous vehicles need experimental ethics: Are we ready for utilitarian cars?” arXiv. http://arxiv.org/abs/1510.03346.
- Bostrom, N. (2014). Superintelligence: Paths, dangers, strategies. Oxford: Oxford University Press.Google Scholar
- Burn-Murdoch, J. (2013). The problem with algorithms: Magnifying misbehaviour. The Guardian. http://www.theguardian.com/news/datablog/2013/aug/14/problem-with-algorithms-magnifying-misbehaviour. Accessed Aug 2014.
- Crawford, K. (2016). Artificial Intelligence’s white guy problem. The New York Times, June 25. http://www.nytimes.com/2016/06/26/opinion/sunday/artificial-intelligences-white-guy-problem.html.
- Dworkin, R. M. (1979). Liberalism. In Public and private morality, Cambridge: Cambridge University Press, pp. 113–43.Google Scholar
- Dworkin, G. (2014). Paternalism. In Edward N. Z. (Ed.). The Stanford Encyclopedia of Philosophy. http://plato.stanford.edu/archives/sum2014/entries/paternalism/.
- Economist. (2014). The Computer Will See You Now. The Economist, August 16. http://www.economist.com/news/science-and-technology/21612114-virtual-shrink-may-sometimes-be-better-real-thing-computer-will-see.
- Economist. (2016). “Who Wields the Knife?” The Economist, May 7. http://www.economist.com/news/science-and-technology/21698220-operations-performed-machines-could-one-day-be-commonplaceif-humans-are-willing.
- Economist The. (2013). Robot Recruiters. The Economist, April 6. http://www.economist.com/news/business/21575820-how-software-helps-firms-hire-workers-more-efficiently-robot-recruiters.
- Engel, J. (2016). Making the web more open: Drupal creator floats an ‘FDA for Data.’ Xconomy, March 2. http://www.xconomy.com/boston/2016/03/02/making-the-web-more-open-drupal-creator-floats-an-fda-for-data/.
- Evans, O., Andreas S., & Noah D. G. (2015). Learning the preferences of bounded agents. In NIPS 2015 Workshop on Bounded Optimality. http://web.mit.edu/owain/www/nips-workshop-2015-website.pdf.
- Evans, O., Andreas S., & Noah D. G. (2016). Learning the preferences of ignorant, inconsistent agents. In 13th AAAI Conference on Artificial Intelligence. http://web.mit.edu/owain/www/evans-stuhlmueller.pdf.
- Fiala, B., Adam, A., & Shaun, N. (2014). You, Robot. In M. Edouard (Ed.), Current controversies in experimental philosophy. Abingdon-on-Thames: Routledge.Google Scholar
- Foot, P. (1978). Virtues and vices and other essays in moral philosophy. Berkeley: University of California Press.Google Scholar
- Friedman, M. (1962). Capitalism and freedom. Chicago: University of Chicago Press.Google Scholar
- Gantenbein, R. E. (2014). Watson, Come Here! The Role of Intelligent Systems in Health Care. In 2014 World Automation Congress (WAC), 165–68. doi: 10.1109/WAC.2014.6935748.
- Garber, M. (2014). Would you want therapy from a computerized psychologist? The Atlantic, May 23. http://www.theatlantic.com/technology/archive/2014/05/would-you-want-therapy-from-a-computerized-psychologist/371552/.
- Kahneman, D. (2011). Thinking, fast and slow. New York: Farrar Straus and Giroux.Google Scholar
- Knight, W. (2015). How to help self-driving cars make ethical decisions. MIT Technology Review, July 29. https://www.technologyreview.com/s/539731/how-to-help-self-driving-cars-make-ethical-decisions/.
- Legg, S. (2008). Machine super intelligene. Doctoral dissertation, University of Lugano.Google Scholar
- Lewis, M. (2014). Flash boys: A wall street revolt. New York: W.W. Norton & Company.Google Scholar
- Lin, P. (2013a). The ethics of saving lives with autonomous cars is far murkier than you think. WIRED, July 30. http://www.wired.com/2013/07/the-surprising-ethics-of-robot-cars/.
- Lin, P. (2013b). The ethics of autonomous cars. The Atlantic, October 8. http://www.theatlantic.com/technology/archive/2013/10/the-ethics-of-autonomous-cars/280360/.
- Lin, P. (2014). Here’s a terrible idea: Robot cars with adjustable ethics settings. WIRED, August 18. http://www.wired.com/2014/08/heres-a-terrible-idea-robot-cars-with-adjustable-ethics-settings/.
- Lohr, S. (2015). Data-Ism: The revolution transforming decision making, consumer behavior, and almost everything else. New York: HarperBusiness.Google Scholar
- Metz, C. (2016). Self-driving cars will teach themselves to save lives—But also to take them. WIRED, June 9. http://www.wired.com/2016/06/self-driving-cars-will-power-kill-wont-conscience/.
- Mill, J. S. (1859). On liberty. London: John W. Parker and Son.Google Scholar
- Millar, J. (2014a). Technology as moral proxy: Autonomy and paternalism by design. In 2014 IEEE International Symposium on Ethics in Science, Technology and Engineering, 1–7. doi: 10.1109/ETHICS.2014.6893388.
- Millar, J. (2014b). You should have a say in your robot car’s code of ethics. Wired. September 2. http://www.wired.com/2014/09/set-the-ethics-robot-car/.
- MIT Technology Review. (2015). Why Self-Driving Cars Must Be Programmed to Kill. October 22. https://www.technologyreview.com/s/542626/why-self-driving-cars-must-be-programmed-to-kill/.
- Nader, R. (1965). Unsafe at any speed; the designed-in dangers of the American automobile. New York: Grossman.Google Scholar
- Orseau, L., & Mark R. (2012). Space-time embedded intelligence. In Joscha B., Ben G., & Matthew I. (Eds.). Artificial General Intelligence, pp. 209–18. Lecture Notes in Computer Science 7716. Berlin: Springer. doi: 10.1007/978-3-642-35506-6_22.
- Rawls, J. (1999). A theory of justice (Rev ed.). Cambridge: Belknap Press of Harvard Univeristy Press.Google Scholar
- Rawls, J. (2005). Political liberalism (Exp ed.). Columbia Classics in Philosophy. New York: Columbia University Press.Google Scholar
- Searle, J. R. (1984). Minds, brains, and science. Cambridge: Harvard University Press.Google Scholar
- Susskind, R., & Susskind, D. (2015). The future of the professions: How technology will transform the work of human experts. New York: Oxford University Press.Google Scholar
- Transport Canada Civil Aviation. (2016). Flying a Drone or an Unmanned Air Vehicle (UAV) for Work or Research. Transport Canada. April 21. http://www.tc.gc.ca/eng/civilaviation/standards/general-recavi-uav-2265.htm.
- Wall, S. (2012). Perfectionism in Moral and Political Philosophy. In Edward N. Z. (Ed.) The Stanford Encyclopedia of Philosophy. http://plato.stanford.edu/archives/win2012/entries/perfectionism-moral/.
- Weng, Y-H., Chien-Hsun C., & Chuen-Tsai S. (2007). The legal crisis of next generation robots: On safety intelligence. In Proceedings of the 11th International Conference on Artificial Intelligence and Law, 205–209. New York: ACM. doi: 10.1145/1276318.1276358.