Advertisement

Ethical Behaviour Aspects of Autonomous Intelligent Cyber-Physical Systems

  • Damien TrentesauxEmail author
  • Stamatis Karnouskos
Conference paper
Part of the Studies in Computational Intelligence book series (SCI, volume 853)

Abstract

Industry 4.0 fosters the development of more autonomous and intelligent cyber-physical systems that interact with humans in open environments. While the technical aspects are heavily researched, the same does not hold for the accompanying ethical issues that are relevant for the design, development, operation, and maintenance of such systems. In engineering teams and industrialists at large, ethical behavior aspects of autonomous intelligent cyber-physical systems are often seen as an add-on and are rarely appropriately considered during system engineering. The aim of this work is firstly to understand the reluctance of researchers and industrialists and secondly, to justify the need to address ethical considerations in all lifecycle phases of autonomous intelligent cyber-physical systems. A case study in train transportation exemplifies some of the issues discussed, and clearly shows that the development of autonomous intelligent cyber-physical systems without addressing their ethical behavior is incomplete.

Notes

Acknowledgement

Surferlab is a joint research lab with Bombardier and Prosyst, which is partially funded by the European Regional Development Fund (ERDF). The authors wish to thank the European Union and the Nord–Pas-de-Calais in France for their support. This research work is also done in the context of the project EFIA “Ètude de faisabilité de l’intelligence artificielle pour le train autonome” (feasibility study on artificial intelligence for the autonomous train) and “train fret autonome” (autonomous freight train), both funded by the SNCF in collaboration with IRT Railenium research institute. The authors would like to thank the SNCF for its support. Parts of the work presented in this paper are carried out in the context of the HUMANISM No ANR-17-CE10-0009 research program, funded by the French ANR “Agence Nationale de la Recherche”. This paper contains elements discussed during workshops led within the context of the project “Droit des robots et autres avatars de l’humain” (robots and other human avatar rights) of the IDEX “Université et Cité” of Strasbourg University.

References

  1. 1.
    ACATECH: Cyber-physical systems: driving force for innovation in mobility, health, energy and production. Technical report (2011). https://goo.gl/Q6WFQN
  2. 2.
    Allen, C., Wallach, W., Smit, I.: Why machine ethics? IEEE Intell. Syst. 21(4), 12–17 (2006).  https://doi.org/10.1109/mis.2006.83CrossRefGoogle Scholar
  3. 3.
    Anderson, S.L.: Asimov’s “three laws of robotics” and machine metaethics. AI Soc. 22(4), 477–493 (2007).  https://doi.org/10.1007/s00146-007-0094-5CrossRefGoogle Scholar
  4. 4.
    Asimov, I.: I, Robot. Bantam Books, New York (1950)Google Scholar
  5. 5.
    Beyerer, J., Kühnert, C., Niggemann, O. (eds.): Machine Learning for Cyber Physical Systems. Springer, Berlin (2019).  https://doi.org/10.1007/978-3-662-58485-9Google Scholar
  6. 6.
    Biffl, S., Lüder, A., Gerhard, D. (eds.): Multi-Disciplinary Engineering for Cyber-Physical Production Systems. Springer, Berlin (2017).  https://doi.org/10.1007/978-3-319-56345-9Google Scholar
  7. 7.
    Cardin, O.: Classification of cyber-physical production systems applications: proposition of an analysis framework. Comput. Ind. 104, 11–21 (2019).  https://doi.org/10.1016/j.compind.2018.10.002CrossRefGoogle Scholar
  8. 8.
    Cardin, O., Derigent, W., Trentesaux, D.: Evolution of holonic control architectures towards industry 4.0: a short overview. IFAC-PapersOnLine 51(11), 1243–1248 (2018).  https://doi.org/10.1016/j.ifacol.2018.08.420CrossRefGoogle Scholar
  9. 9.
    Cintuglu, M.H., Mohammed, O.A., Akkaya, K., Uluagac, A.S.: A survey on smart grid cyber-physical system testbeds. IEEE Commun. Surv. Tutorials 19(1), 446–464 (2017).  https://doi.org/10.1109/comst.2016.2627399CrossRefGoogle Scholar
  10. 10.
    Colombo, A.W., Karnouskos, S., Bangemann, T.: A system of systems view on collaborative industrial automation. In: 2013 IEEE International Conference on Industrial Technology (ICIT). IEEE (2013).  https://doi.org/10.1109/icit.2013.6505980
  11. 11.
    Colombo, A.W., Karnouskos, S., Kaynak, O., Shi, Y., Yin, S.: Industrial cyberphysical systems: a backbone of the fourth industrial revolution. IEEE Ind. Electron. Mag. 11(1), 6–16 (2017).  https://doi.org/10.1109/mie.2017.2648857CrossRefGoogle Scholar
  12. 12.
    Eisenführ, F., Weber, M., Langer, T.: Rational Decision Making. Springer, Berlin (2010)CrossRefGoogle Scholar
  13. 13.
    Ess, C.: Digital Media Ethics, 2. Digital Media and Society, 2nd edn. Polity Press, Cambridge (2014)Google Scholar
  14. 14.
    Goodall, N.J.: Can you program ethics into a self-driving car? IEEE Spectr. 53(6), 28–58 (2016).  https://doi.org/10.1109/MSPEC.2016.7473149CrossRefGoogle Scholar
  15. 15.
    Hooker, B.: Consequentialism. In: The Routledge Companion to Ethics. Routledge (2010).  https://doi.org/10.4324/9780203850701.ch37
  16. 16.
    Karnouskos, S.: Cyber-physical systems in the smartgrid. In: IEEE 9th International Conference on Industrial Informatics (INDIN), Lisbon, Portugal (2011).  https://doi.org/10.1109/indin.2011.6034829
  17. 17.
    Karnouskos, S.: Self-driving car acceptance and the role of ethics. IEEE Trans. Eng. Manag. 1–14 (2018).  https://doi.org/10.1109/tem.2018.2877307
  18. 18.
    Lei, T., Barzilay, R., Jaakkola, T.: Rationalizing neural predictions. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics (2016).  https://doi.org/10.18653/v1/d16-1011
  19. 19.
    Leitao, P., Karnouskos, S., Ribeiro, L., Lee, J., Strasser, T., Colombo, A.W.: Smart agents in industrial cyber–physical systems. Proc. IEEE 104(5), 1086–1101 (2016).  https://doi.org/10.1109/jproc.2016.2521931CrossRefGoogle Scholar
  20. 20.
    Leitão, P., Karnouskos, S. (eds.): Industrial Agents: Emerging Applications of Software Agents in Industry. Elsevier (2015)Google Scholar
  21. 21.
    Monostori, L.: Cyber-physical production systems: roots, expectations and R&D challenges. Procedia CIRP 17, 9–13 (2014).  https://doi.org/10.1016/j.procir.2014.03.115CrossRefGoogle Scholar
  22. 22.
    Morahan, M.: Ethics in management. IEEE Eng. Manage. Rev. 43(4), 23–25 (2015).  https://doi.org/10.1109/emr.2015.7433683CrossRefGoogle Scholar
  23. 23.
    Murphy, R., Woods, D.D.: Beyond asimov: the three laws of responsible robotics. IEEE Intell. Syst. 24(4), 14–20 (2009).  https://doi.org/10.1109/MIS.2009.69CrossRefGoogle Scholar
  24. 24.
    Orseau, L., Armstrong, S.: Safely interruptible agents. In: Proceedings of the Thirty-Second Conference on Uncertainty in Artificial Intelligence, UAI 2016, pp. 557–566. AUAI Press, Arlington (2016)Google Scholar
  25. 25.
    Pacaux-Lemoine, M.P., Berdal, Q., Enjalbert, S., Trentesaux, D.: Towards human-based industrial cyber-physical systems. In: 2018 IEEE Industrial Cyber-Physical Systems (ICPS), pp. 615–620 (2018).  https://doi.org/10.1109/ICPHYS.2018.8390776
  26. 26.
    Pacaux-Lemoine, M.P., Trentesaux, D.: Ethical risks of human-machine symbiosis in industry 4.0: insights from the human-machine cooperation approach. In: 14th IFAC/IFIP/IFORS/IEA Symposium on Analysis, Design, and Evaluation of Human-Machine Systems (IFAC HMS) (2019)Google Scholar
  27. 27.
    Rault, R., Trentesaux, D.: Artificial intelligence, autonomous systems and robotics: legal innovations. In: Service Orientation in Holonic and Multi-Agent Manufacturing: Proceedings of SOHOMA 2017. Studies in Computational Intelligence, vol. 762, pp. 1–9. Springer, Cham (2018)Google Scholar
  28. 28.
    Skorupski, J.: The Routledge Companion to Ethics. Routledge (2010).  https://doi.org/10.4324/9780203850701CrossRefGoogle Scholar
  29. 29.
    The IEEE global initiative on ethics of autonomous and intelligent systems: ethically aligned design: a vision for prioritizing human well-being with autonomous and intelligent systems. Technical report (2017). https://standards.ieee.org/content/dam/ieee-standards/standards/web/documents/other/ead_v2.pdf
  30. 30.
    Trappey, A.J.C., Trappey, C.V., Govindarajan, U.H., Sun, J.J., Chuang, A.C.: A review of technology standards and patent portfolios for enabling cyber-physical systems in advanced manufacturing. IEEE Access 4, 7356–7382 (2016).  https://doi.org/10.1109/access.2016.2619360CrossRefGoogle Scholar
  31. 31.
    Trentesaux, D., Dahyot, R., Ouedraogo, A., Arenas, D., Lefebvre, S., Schön, W., Lussier, B., Cheritel, H.: The autonomous train. In: 2018 13th Annual Conference on System of Systems Engineering (SoSE). IEEE (2018).  https://doi.org/10.1109/sysose.2018.8428771
  32. 32.
    Trentesaux, D., Millot, P.: A human-centred design to break the myth of the “magic human” in intelligent manufacturing systems. In: Service Orientation in Holonic and Multi-Agent Manufacturing. Studies in Computational Intelligence, vol. 640, pp. 103–113. Springer (2016)Google Scholar
  33. 33.
    Trentesaux, D., Rault, R.: Designing ethical cyber-physical industrial systems. IFAC-PapersOnLine 50(1), 14934–14939 (2017).  https://doi.org/10.1016/j.ifacol.2017.08.2543CrossRefGoogle Scholar
  34. 34.
    Tsiatsis, V., Karnouskos, S., Höller, J., Boyle, D., Mulligan, C.: Internet of Things: Technologies and Applications for a New Age of Intelligence. Academic Press, Elsevier (2018)Google Scholar
  35. 35.
    WEC: Industrial internet of things: unleashing the potential of connected products and services. Technical report (2015). http://www3.weforum.org/docs/WEFUSA_IndustrialInternet_Report2015.pdf
  36. 36.
    Winter-Levy, S., Trefethen, J.: Safety first. World Policy J. 33(1), 105–111 (2016).  https://doi.org/10.1215/07402775-3545918CrossRefGoogle Scholar
  37. 37.
    Xu, L.D., Xu, E.L., Li, L.: Industry 4.0: state of the art and future trends. Int. J. Prod. Res. 56(8), 2941–2962 (2018).  https://doi.org/10.1080/00207543.2018.1444806CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.LAMIH UMR CNRS 8201, Polytechnic University Hauts-de-FranceValenciennesFrance
  2. 2.SAPWalldorfGermany

Personalised recommendations