Skip to main content
Log in

The status of machine ethics: a report from the AAAI Symposium

  • Original Paper
  • Published:
Minds and Machines Aims and scope Submit manuscript

Abstract

This paper is a summary and evaluation of work presented at the AAAI 2005 Fall Symposium on Machine Ethics that brought together participants from the fields of Computer Science and Philosophy to the end of clarifying the nature of this newly emerging field and discussing different approaches one could take towards realizing the ultimate goal of creating an ethical machine.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Notes

  1. Moor has, since then, in “The Nature, Importance, and Difficulty of Machine Ethics,” included in the special issue of IEEE Intelligent Systems on “Machine Ethics,” July/August, 2006, pp. 18–21, combined the last two senses into one.

  2. This is the category that was dropped in Moor’s paper, perhaps because it is controversial whether machines that are developed by humans can be said to be truly autonomous.

  3. The parts of Moor’s analogy have been changed somewhat to clarify what is involved in both cases.

  4. Steve Torrance, in his paper “A Robust View of Machine Ethics,” argued that to be a full ethical agent (to have “intrinsic moral status”), the entity in question must be organic. On his view, only organic beings are “genuinely sentient,” and only sentient beings can be “subjects of either moral concern or moral appraisal.”

  5. “The Bicentennial Man” was originally commissioned to be part of a volume of stories written by well-known authors to commemorate the United States’ bicentennial. Asimov was simultaneously writing a story about the history of the United States (with its unjust treatment of African-Americans, who had to fight for their rights) and a vehicle for Asimov to present his view of how intelligent robots should be treated and be required to act.

  6. If one accepts Cultural Relativism, which we believe is problematic for the reason we have given, then one would simply compute the action that is considered to be correct according to the majority in the society in which the machine will function.

References

  • Allen, C., Varner, G., & Zinser, J. (2000). Prolegomena to any future artificial moral agent. Journal of Experimental and Theoretical Artificial Intelligence, 12, 251–261.

    Article  MATH  Google Scholar 

  • Anderson, S. (2005). Asimov’s ‘Three Laws of Robotics’ and machine metaethics. In M. Anderson, S. Anderson, & C. Armen (Eds.), Machine ethics: Papers from the AAAI Fall Symposium, Technical Report FS-05-06. Menlo Park, CA: AAAI Press.

  • Anderson, M., Anderson, S., & Armen, C. (Eds.), (2005). Machine ethics: Papers from the AAAI Fall Symposium, Technical Report FS-05-06. Menlo Park, CA: AAAI Press.

  • Anderson, M., Anderson, S., & Armen, C. (2006). MedEthEx: A prototype medical ethics advisor. In Proceedings of the eighteenth conference on innovative applications of artificial intelligence (IAAI-06), Boston, MA.

  • Arkoudas, K., Bringsjord, S., & Bello, P. (2005). Toward ethical robots via mechanized deontic logic. In M. Anderson, S. Anderson, & C. Armen (Eds.), Machine ethics: Papers from the AAAI Fall Symposium, Technical Report FS-05-06. Menlo Park, CA: AAAI Press.

  • Asimov, I. (1976). The bicentennial man. In The bicentennial man and other stories. Doubleday.

  • Grau, C. (2005). There is no ‘I’ in ‘Robot’: Robotic utilitarians and utilitarian robots. In M. Anderson, S. Anderson, & C. Armen (Eds.), Machine ethics: Papers from the AAAI Fall Symposium, Technical Report FS-05-06. Menlo Park, CA: AAAI Press.

  • Guarini, M. (2005). Particularism and generalism: How AI can help us to better understand moral cognition. In M. Anderson, S. Anderson, & C. Armen (Eds.), Machine ethics: Papers from the AAAI Fall Symposium, Technical Report FS-05-06. Menlo Park, CA: AAAI Press.

  • McLaren, B. (2005). Lessons in machine ethics from the perspective of two computational models of ethical reasoning. In M. Anderson, S. Anderson, & C. Armen (Eds.), Machine ethics: Papers from the AAAI Fall Symposium, Technical Report FS-05-06. Menlo Park, CA: AAAI Press.

  • Moor, J. H. (2006). The nature, importance, and difficulty of Machine Ethics. IEEE Intelligent Systems Special Issue on Machine Ethics, 21(4), 18–21.

    Google Scholar 

  • Powers, T. (2005). Deontological machine ethics. In M. Anderson, S. Anderson, & C. Armen (Eds.), Machine ethics: Papers from the AAAI Fall Symposium, Technical Report FS-05-06. Menlo Park, CA: AAAI Press.

  • Rzepka, R., & Araki, K. (2005). What could statistics do for ethics? The idea of a commonsense-processing-based safety valve. In M. Anderson, S. Anderson, & C. Armen (Eds.), Machine ethics: Papers from the AAAI Fall Symposium, Technical Report FS-05-06. Menlo Park, CA: AAAI Press.

  • Wallach, W., Allen, C., & Smit, I. (2005). Machine morality: Bottom-up and top-down approaches for modeling human moral faculties. In M. Anderson, S. Anderson, & C. Armen (Eds.), Machine ethics: Papers from the AAAI Fall Symposium, Technical Report FS-05-06. Menlo Park, CA: AAAI Press.

Download references

Acknowledgements

We wish to thank the participants of the AAAI Fall 2005 Symposium on Machine Ethics without whose collective efforts this paper would not have been possible (see http://www.machineethics.org for more information). This material is based upon work supported in part by the National Science Foundation grant number IIS-0500133.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Michael Anderson.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Anderson, M., Anderson, S.L. The status of machine ethics: a report from the AAAI Symposium. Minds & Machines 17, 1–10 (2007). https://doi.org/10.1007/s11023-007-9053-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11023-007-9053-7

Keywords

Navigation