Ethical Behaviour Aspects of Autonomous Intelligent Cyber-Physical Systems

  • Damien TrentesauxEmail author
  • Stamatis Karnouskos
Conference paper
Part of the Studies in Computational Intelligence book series (SCI, volume 853)


Industry 4.0 fosters the development of more autonomous and intelligent cyber-physical systems that interact with humans in open environments. While the technical aspects are heavily researched, the same does not hold for the accompanying ethical issues that are relevant for the design, development, operation, and maintenance of such systems. In engineering teams and industrialists at large, ethical behavior aspects of autonomous intelligent cyber-physical systems are often seen as an add-on and are rarely appropriately considered during system engineering. The aim of this work is firstly to understand the reluctance of researchers and industrialists and secondly, to justify the need to address ethical considerations in all lifecycle phases of autonomous intelligent cyber-physical systems. A case study in train transportation exemplifies some of the issues discussed, and clearly shows that the development of autonomous intelligent cyber-physical systems without addressing their ethical behavior is incomplete.



Surferlab is a joint research lab with Bombardier and Prosyst, which is partially funded by the European Regional Development Fund (ERDF). The authors wish to thank the European Union and the Nord–Pas-de-Calais in France for their support. This research work is also done in the context of the project EFIA “Ètude de faisabilité de l’intelligence artificielle pour le train autonome” (feasibility study on artificial intelligence for the autonomous train) and “train fret autonome” (autonomous freight train), both funded by the SNCF in collaboration with IRT Railenium research institute. The authors would like to thank the SNCF for its support. Parts of the work presented in this paper are carried out in the context of the HUMANISM No ANR-17-CE10-0009 research program, funded by the French ANR “Agence Nationale de la Recherche”. This paper contains elements discussed during workshops led within the context of the project “Droit des robots et autres avatars de l’humain” (robots and other human avatar rights) of the IDEX “Université et Cité” of Strasbourg University.


  1. 1.
    ACATECH: Cyber-physical systems: driving force for innovation in mobility, health, energy and production. Technical report (2011).
  2. 2.
    Allen, C., Wallach, W., Smit, I.: Why machine ethics? IEEE Intell. Syst. 21(4), 12–17 (2006). Scholar
  3. 3.
    Anderson, S.L.: Asimov’s “three laws of robotics” and machine metaethics. AI Soc. 22(4), 477–493 (2007). Scholar
  4. 4.
    Asimov, I.: I, Robot. Bantam Books, New York (1950)Google Scholar
  5. 5.
    Beyerer, J., Kühnert, C., Niggemann, O. (eds.): Machine Learning for Cyber Physical Systems. Springer, Berlin (2019). Scholar
  6. 6.
    Biffl, S., Lüder, A., Gerhard, D. (eds.): Multi-Disciplinary Engineering for Cyber-Physical Production Systems. Springer, Berlin (2017). Scholar
  7. 7.
    Cardin, O.: Classification of cyber-physical production systems applications: proposition of an analysis framework. Comput. Ind. 104, 11–21 (2019). Scholar
  8. 8.
    Cardin, O., Derigent, W., Trentesaux, D.: Evolution of holonic control architectures towards industry 4.0: a short overview. IFAC-PapersOnLine 51(11), 1243–1248 (2018). Scholar
  9. 9.
    Cintuglu, M.H., Mohammed, O.A., Akkaya, K., Uluagac, A.S.: A survey on smart grid cyber-physical system testbeds. IEEE Commun. Surv. Tutorials 19(1), 446–464 (2017). Scholar
  10. 10.
    Colombo, A.W., Karnouskos, S., Bangemann, T.: A system of systems view on collaborative industrial automation. In: 2013 IEEE International Conference on Industrial Technology (ICIT). IEEE (2013).
  11. 11.
    Colombo, A.W., Karnouskos, S., Kaynak, O., Shi, Y., Yin, S.: Industrial cyberphysical systems: a backbone of the fourth industrial revolution. IEEE Ind. Electron. Mag. 11(1), 6–16 (2017). Scholar
  12. 12.
    Eisenführ, F., Weber, M., Langer, T.: Rational Decision Making. Springer, Berlin (2010)CrossRefGoogle Scholar
  13. 13.
    Ess, C.: Digital Media Ethics, 2. Digital Media and Society, 2nd edn. Polity Press, Cambridge (2014)Google Scholar
  14. 14.
    Goodall, N.J.: Can you program ethics into a self-driving car? IEEE Spectr. 53(6), 28–58 (2016). Scholar
  15. 15.
    Hooker, B.: Consequentialism. In: The Routledge Companion to Ethics. Routledge (2010).
  16. 16.
    Karnouskos, S.: Cyber-physical systems in the smartgrid. In: IEEE 9th International Conference on Industrial Informatics (INDIN), Lisbon, Portugal (2011).
  17. 17.
    Karnouskos, S.: Self-driving car acceptance and the role of ethics. IEEE Trans. Eng. Manag. 1–14 (2018).
  18. 18.
    Lei, T., Barzilay, R., Jaakkola, T.: Rationalizing neural predictions. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics (2016).
  19. 19.
    Leitao, P., Karnouskos, S., Ribeiro, L., Lee, J., Strasser, T., Colombo, A.W.: Smart agents in industrial cyber–physical systems. Proc. IEEE 104(5), 1086–1101 (2016). Scholar
  20. 20.
    Leitão, P., Karnouskos, S. (eds.): Industrial Agents: Emerging Applications of Software Agents in Industry. Elsevier (2015)Google Scholar
  21. 21.
    Monostori, L.: Cyber-physical production systems: roots, expectations and R&D challenges. Procedia CIRP 17, 9–13 (2014). Scholar
  22. 22.
    Morahan, M.: Ethics in management. IEEE Eng. Manage. Rev. 43(4), 23–25 (2015). Scholar
  23. 23.
    Murphy, R., Woods, D.D.: Beyond asimov: the three laws of responsible robotics. IEEE Intell. Syst. 24(4), 14–20 (2009). Scholar
  24. 24.
    Orseau, L., Armstrong, S.: Safely interruptible agents. In: Proceedings of the Thirty-Second Conference on Uncertainty in Artificial Intelligence, UAI 2016, pp. 557–566. AUAI Press, Arlington (2016)Google Scholar
  25. 25.
    Pacaux-Lemoine, M.P., Berdal, Q., Enjalbert, S., Trentesaux, D.: Towards human-based industrial cyber-physical systems. In: 2018 IEEE Industrial Cyber-Physical Systems (ICPS), pp. 615–620 (2018).
  26. 26.
    Pacaux-Lemoine, M.P., Trentesaux, D.: Ethical risks of human-machine symbiosis in industry 4.0: insights from the human-machine cooperation approach. In: 14th IFAC/IFIP/IFORS/IEA Symposium on Analysis, Design, and Evaluation of Human-Machine Systems (IFAC HMS) (2019)Google Scholar
  27. 27.
    Rault, R., Trentesaux, D.: Artificial intelligence, autonomous systems and robotics: legal innovations. In: Service Orientation in Holonic and Multi-Agent Manufacturing: Proceedings of SOHOMA 2017. Studies in Computational Intelligence, vol. 762, pp. 1–9. Springer, Cham (2018)Google Scholar
  28. 28.
    Skorupski, J.: The Routledge Companion to Ethics. Routledge (2010). Scholar
  29. 29.
    The IEEE global initiative on ethics of autonomous and intelligent systems: ethically aligned design: a vision for prioritizing human well-being with autonomous and intelligent systems. Technical report (2017).
  30. 30.
    Trappey, A.J.C., Trappey, C.V., Govindarajan, U.H., Sun, J.J., Chuang, A.C.: A review of technology standards and patent portfolios for enabling cyber-physical systems in advanced manufacturing. IEEE Access 4, 7356–7382 (2016). Scholar
  31. 31.
    Trentesaux, D., Dahyot, R., Ouedraogo, A., Arenas, D., Lefebvre, S., Schön, W., Lussier, B., Cheritel, H.: The autonomous train. In: 2018 13th Annual Conference on System of Systems Engineering (SoSE). IEEE (2018).
  32. 32.
    Trentesaux, D., Millot, P.: A human-centred design to break the myth of the “magic human” in intelligent manufacturing systems. In: Service Orientation in Holonic and Multi-Agent Manufacturing. Studies in Computational Intelligence, vol. 640, pp. 103–113. Springer (2016)Google Scholar
  33. 33.
    Trentesaux, D., Rault, R.: Designing ethical cyber-physical industrial systems. IFAC-PapersOnLine 50(1), 14934–14939 (2017). Scholar
  34. 34.
    Tsiatsis, V., Karnouskos, S., Höller, J., Boyle, D., Mulligan, C.: Internet of Things: Technologies and Applications for a New Age of Intelligence. Academic Press, Elsevier (2018)Google Scholar
  35. 35.
    WEC: Industrial internet of things: unleashing the potential of connected products and services. Technical report (2015).
  36. 36.
    Winter-Levy, S., Trefethen, J.: Safety first. World Policy J. 33(1), 105–111 (2016). Scholar
  37. 37.
    Xu, L.D., Xu, E.L., Li, L.: Industry 4.0: state of the art and future trends. Int. J. Prod. Res. 56(8), 2941–2962 (2018). Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.LAMIH UMR CNRS 8201, Polytechnic University Hauts-de-FranceValenciennesFrance
  2. 2.SAPWalldorfGermany

Personalised recommendations