Skip to main content
SpringerLink
Log in

Ethics of Autonomous Intelligent Systems in the Human Society: Cross Views from Science, Law and Science-Fiction

  • Conference paper
  • First Online:
Service Oriented, Holonic and Multi-Agent Manufacturing Systems for Industry of the Future (SOHOMA 2020)

Part of the book series: Studies in Computational Intelligence ((SCI,volume 952))

Abstract

The objective of this paper is to discuss issues and insights relevant to the ethical behaviour of future autonomous intelligent system merged in the human society. This discussion is done at the frontier of three domains: science, as the mean to imagine and design innovative technological solutions in the field of autonomous artificial systems; law, as the mean to control, forbid and promote what can be used in the human society or not from these technological solutions; and science-fiction, as the imaginary world where scientists and lawyers get consciously or not their inspirations, fears and dreams, driving their decisions and actions in the real world. Four issues are specifically discussed. The crossing of these domains illustrates that addressing ethics in AIS is an urgent need but remains incomplete if addressed from a single discipline or domain point of view.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Karel Čapek, R.U.R. (tr. P. Silver & Nigel Playfair), New York: Doubleday, 1923, p. 17.

References

  1. Trentesaux, D., Karnouskos, S.: Ethical behaviour aspects of autonomous intelligent cyber-physical systems. In: Service Oriented, Holonic and Multi-agent Manufacturing Systems for Industry of the Future. Studies in Computational Intelligence, vol. 853, pp. 55–71. Springer, Cham (2020)

    Google Scholar 

  2. Jenkins, R.: Autonomous vehicle ethics and laws: toward an overlapping consensus. New America (2016)

    Google Scholar 

  3. Ricoeur, P.: Soi-même comme un autre. Seuil (1990)

    Google Scholar 

  4. Trentesaux, D., Rault, R.: Ethical behaviour of autonomous non-military cyber-physical systems. In: 19th International Conference on Complex Systems: Control and Modeling Problems, Samara (2017)

    Google Scholar 

  5. Kuhn, T.S.: The Structure of Scientific Revolutions. University of Chicago Press, Chicago (1970)

    Google Scholar 

  6. Stolze, P.: La Science-Fiction: littérature d’images et non d’idées. In: Nicot, S. (ed.) Les Univers de la Science-Fiction - Essais, pp. 183–202. Galaxies (1998)

    Google Scholar 

  7. Dick, P.K.: Man, android and machine. In: Nicholls, P. (ed.) Science Fiction At Large. Harper & Row, New York (1976)

    Google Scholar 

  8. Barlow, A.: Philip K. Dick’s androids: victimized victimizers. In: Kerman, J.B. (ed.) Retrofitting Blade Runner. The University of Wisconsin Press, Madison (1997)

    Google Scholar 

  9. Arnold, T., Scheutz, M.: The “big red button” is too late: an alternative model for the ethical evaluation of AI systems. Ethics Inf. Technol. 20, 59–69 (2018)

    Article  Google Scholar 

  10. Karnouskos, S.: Self-driving car acceptance and the role of ethics. IEEE Trans. Eng. Manag. 1–14 (2018). https://doi.org/10.1109/TEM.2018.2877307

  11. Rajaonah, B., Sarraipa, J.: Trustworthiness-based automatic function allocation in future humans-machines organizations. In: 2018 IEEE 22nd International Conference on Intelligent Engineering Systems (INES), pp. 371–376 (2018). https://doi.org/10.1109/INES.2018.8523876

  12. Kirby, D.: The future is now: diegetic prototypes and the role of popular films in generating real-world technological development. Soc. Stud. Sci. 40, 41–70 (2010)

    Article  Google Scholar 

  13. Alexandre, L., Besnier, J.-M.: Les robots font-ils l’amour? Le transhumanisme en 12 questions, Dunod (2018)

    Google Scholar 

  14. Romero, D., Bernus, P., Noran, O., Stahre, J., Fast-Berglund, Å.: The operator 4.0: human cyber-physical systems & adaptive automation towards human-automation symbiosis work systems. In: IFIP Advances in Information and Communication Technology, pp. 677–686. Springer, Cham (2016)

    Google Scholar 

  15. Longo, F., Padovano, A., Umbrello, S.: Value-oriented and ethical technology engineering in industry 5.0: a human-centric perspective for the design of the factory of the future. Appl. Sci. 10, 4182 (2020). https://doi.org/10.3390/app10124182

    Article  Google Scholar 

  16. Schwarz, J.O.: The ‘narrative turn’ in developing foresight: assessing how cultural products can assist organisations in detecting trends. Technol. Forecast. Soc. Chang. 90, 510–513 (2015). https://doi.org/10.1016/j.techfore.2014.02.024

    Article  Google Scholar 

  17. Bina, O., Mateus, S., Pereira, L., Caffa, A.: The future imagined: exploring fiction as a means of reflecting on today’s grand societal challenges and tomorrow’s options. Futures 86, 166–184 (2017). https://doi.org/10.1016/j.futures.2016.05.009

    Article  Google Scholar 

  18. Anderson, S.L.: Asimov’s “three laws of robotics” and machine metaethics. AI Soc. 22, 477–493 (2008). https://doi.org/10.1007/s00146-007-0094-5

    Article  Google Scholar 

  19. Snow, C.P.: The Two Cultures: And a Second Look. Cambridge University Press, Cambridge (1964)

    Google Scholar 

  20. Hottois, G.: SF ou l’ambiguïté d’une littérature vraiment contemporaine. In: Science-fiction et fiction spéculative, Editions de l’Université de Bruxelles (1985)

    Google Scholar 

  21. Tubaro, P., Casilli, A.A.: Micro-work, artificial intelligence and the automotive industry. J. Ind. Bus. Econ. 46, 333–345 (2019)

    Article  Google Scholar 

  22. Berrah, L., Trentesaux, D.: Decision-making in future industrial systems: is ethics a new performance indicator? In: 10th SOHOMA Workshop on Service Oriented, Holonic and Multi-Agent Manufacturing Systems for Industry of the Future. Studies in Computational Intelligence, vol. 952, 1–2 October, Paris. Springer, Cham (2020)

    Google Scholar 

  23. Pacaux-Lemoine, M.-P., Trentesaux, D.: Ethical risks of human-machine symbiosis in industry 4.0: insights from the human-machine cooperation approach. IFAC-PapersOnLine 52, 19–24 (2019). https://doi.org/10.1016/j.ifacol.2019.12.077

    Article  MathSciNet  Google Scholar 

  24. Gardony, A.L., Brunyé, T.T., Mahoney, C.R., Taylor, H.A.: How navigational aids impair spatial memory: evidence for divided attention. Spatial Cogn. Comput. 13, 319–350 (2013). https://doi.org/10.1080/13875868.2013.792821

    Article  Google Scholar 

  25. Huftier, A.: Pierre Boulle: présentation. ReS Futurae, Revue d’études sur la science-fiction (2015). https://doi.org/10.4000/resf.781

  26. Williamson, J.: The Best of Jack Williamson. Ballantine, New York (1978)

    Google Scholar 

  27. Billingsley, R., Billingsley, J., Gärdenfors, P., Peppas, P., Prade, H., Skillicorn, D., Williams, M.-A.: The altruistic robot: do what i want, not just what i say. In: Moral, S., Pivert, O., Marín, N. (eds.) Scalable Uncertainty Management, pp. 149–162. Springer, Cham (2017)

    Google Scholar 

  28. Wu, Y.-H., Pino, M., Boesflug, S., de Sant’Anna, M., Legouverneur, G., Cristancho, V., Kerhervé, H., Rigaud, A.-S.: Robots émotionnels pour les personnes souffrant de maladie d’Alzheimer en institution. NPG Neurologie Psychiatrie Gériatrie 14, 194–200 (2014). https://doi.org/10.1016/j.npg.2014.01.005

  29. Trentesaux, D., Dahyot, R., Ouedraogo, A., Arenas, D., Lefebvre, S., Schön, W., Lussier, B., Chéritel, H.: The autonomous train. In: 2018 13th Annual Conference on System of Systems Engineering (SoSE), pp. 514–520 (2018). https://doi.org/10.1109/SYSOSE.2018.8428771

  30. Gaham, M., Bouzouia, B., Achour, N.: Human-in-the-loop cyber-physical production systems control (HiLCP2sC): a multi-objective interactive framework proposal. In: Service Orientation in Holonic and Multi-agent Manufacturing, pp. 315–325. Springer, Cham (2015)

    Google Scholar 

  31. Rüßmann, M., Lorenz, M., Gerbert, P., Waldner, M., Justus, J., Engel, P., Harnisch, M.: Industry 4.0: The Future of Productivity and Growth in Manufacturing Industries (2015)

    Google Scholar 

  32. Rault, R., Trentesaux, D.: Artificial intelligence, autonomous systems and robotics: legal innovations, service orientation in Holonic and multi-agent manufacturing. In: Borangiu, T., et al. (eds.) Studies in Computational Intelligence, vol. 762, pp. 1–9. Springer, Cham (2018)

    Google Scholar 

  33. Palmerini, E., Bertolini, A., Battaglia, F., Koops, B.-J., Carnevale, A., Salvini, P.: RoboLaw: towards a European framework for robotics regulation. Robot. Auton. Syst. 86, 78–85 (2016). https://doi.org/10.1016/j.robot.2016.08.026

    Article  Google Scholar 

  34. Nagenborg, M., Capurro, R., Weber, J., Pingel, C.: Ethical regulations on robotics in Europe. AI Soc. 22, 349–366 (2007). https://doi.org/10.1007/s00146-007-0153-y

    Article  Google Scholar 

  35. Dreier, T., Döhmann, I.S.: Legal aspects of service robotics. Poiesis Prax. 9, 201–217 (2012). https://doi.org/10.1007/s10202-012-0115-4

    Article  Google Scholar 

  36. Glaser, P.: Intelligence artificielleet responsabilité: un système juridique inadapté? Bulletin Rapide Droit des Affaires (BRDA), pp. 19–22 (2018)

    Google Scholar 

  37. Delvaux, M.: Civil law rules on robotics, European Parliament Legislative initiative procedure 2015/2103 (2016)

    Google Scholar 

  38. Marty, A.: Legal and ethical considerations in the era of autonomous robots, University of St. Gallen, Zurich, Switzerland (2017)

    Google Scholar 

  39. Barfield, W.: Liability for autonomous and artificially intelligent robots. Paladyn J. Behav. Robot. 9, 193–203 (2018). https://doi.org/10.1515/pjbr-2018-0018

    Article  Google Scholar 

  40. Johnson, D.G., Verdicchio, M.: Why robots should not be treated like animals. Ethics Inf. Technol. 20, 291–301 (2018). https://doi.org/10.1007/s10676-018-9481-5

    Article  Google Scholar 

  41. Bensoussan, A., Bensoussan, J.: Droit des robots, Larcier, Bruxelles (2015)

    Google Scholar 

  42. Nevejans, N., Hauser, J., Ganascia, J.-G.: Traité de droit et d’éthique de la robotique civile. Les Etudes Hospitalières édition, Bordeaux (2017)

    Google Scholar 

  43. Alsegier, R.A.: Roboethics: sharing our world with humanlike robots. IEEE Potentials 35, 24–28 (2016). https://doi.org/10.1109/MPOT.2014.2364491

    Article  Google Scholar 

  44. Allen, C., Wallach, W., Smit, I.: Why machine ethics? IEEE Intell. Syst. 21, 12–17 (2006). https://doi.org/10.1109/MIS.2006.83

    Article  Google Scholar 

  45. Anderson, M., Anderson, S.L.: GenEth: a general ethical dilemma analyzer. Paladyn J. Behav. Robot. 9, 337–357 (2018). https://doi.org/10.1515/pjbr-2018-0024

    Article  Google Scholar 

  46. Bergmann, L.T., Schlicht, L., Meixner, C., König, P., Pipa, G., Boshammer, S., Stephan, A.: Autonomous vehicles require socio-political acceptance - an empirical and philosophical perspective on the problem of moral decision making. Front. Behav. Neurosci. 12, 31 (2018). https://doi.org/10.3389/fnbeh.2018.00031

    Article  Google Scholar 

  47. Norman, D.A.: Emotional Design: Why We Love (or Hate) Everyday Things. Basic Books, New York (2005)

    Google Scholar 

  48. Trentesaux, D., Rault, R.: Designing ethical cyber-physical industrial systems. IFAC-PapersOnLine 50, 14934–14939 (2017). https://doi.org/10.1016/j.ifacol.2017.08.2543

    Article  Google Scholar 

Download references

Acknowledgement

The work described in this chapter was conducted under the auspices of the project “Law of robots and other human avatars” funded by the IDEX Strasbourg Université et Cité and in the framework of the joint laboratory “SurferLab” founded by Bombardier, Prosyst and the Université Polytechnique Hauts-de-France. This Joint Laboratory is supported by the CNRS, the European Union (ERDF) and the Hauts-de-France region. Parts of the work are also carried out in the context of the HUMANISM No ANR-17-CE10-0009 research program, funded by the French ANR “Agence Nationale de la Recherche”. The authors would like to thank warmly Bérangère Kieken, Fabien Bruniau and Sébastien Caudrelier for discussions that nourished this paper. Finally, the authors testify that no AI was used or mishandled in the writing of this chapter.

Author information

Authors and Affiliations

  1. LAMIH UMR CNRS 8201, Université Polytechnique Hauts-de-France, Le Mont Houy, 59313, Valenciennes Cedex, France

    Damien Trentesaux

  2. Alter Via Avocats, 7 rue de l’Hôpital Militaire, 59800, Lille, France

    Raphaël Rault

  3. ICUBE UMR, Université de Strasbourg, 3, rue de l’université, Strasbourg, France

    Emmanuel Caillaud

  4. Laboratoire DeScripto, Université Polytechnique Hauts-de-France, Le Mont Houy, 59313, Valenciennes Cedex, France

    Arnaud Huftier

Authors
  1. Damien Trentesaux
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Raphaël Rault
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Emmanuel Caillaud
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Arnaud Huftier
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Damien Trentesaux .

Editor information

Editors and Affiliations

  1. Faculty of Automatic Control and Computer Science, University Politehnica of Bucharest, Bucharest, Romania

    Theodor Borangiu

  2. Université Polytechnique Hauts-de-France, Le Mont Houy, Valenciennes, France

    Damien Trentesaux

  3. Research Centre in Digitalization and Intelligent Robotics (CeDRI), Instituto Politécnico de Bragança, Campus de Santa Apolónia, Bragança, Portugal

    Paulo Leitão

  4. Department of Génie Mecanique et Productique, Université de Nantes, Carquefou, France

    Olivier Cardin

  5. LAMIH Arts et Métiers Paris Tech, Paris, France

    Samir Lamouri

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Trentesaux, D., Rault, R., Caillaud, E., Huftier, A. (2021). Ethics of Autonomous Intelligent Systems in the Human Society: Cross Views from Science, Law and Science-Fiction. In: Borangiu, T., Trentesaux, D., Leitão, P., Cardin, O., Lamouri, S. (eds) Service Oriented, Holonic and Multi-Agent Manufacturing Systems for Industry of the Future. SOHOMA 2020. Studies in Computational Intelligence, vol 952. Springer, Cham. https://doi.org/10.1007/978-3-030-69373-2_17

Download citation

Publish with us

Policies and ethics

Search

Navigation