The teaching of computer ethics on computer science and related degree programmes. a European survey

Within the Computer Science community, many ethical issues have emerged as significant and critical concerns. Computer ethics is an academic field in its own right and there are unique ethical issues associated with information technology. It encompasses a range of issues and concerns including privacy and agency around personal information, Artificial Intelligence and pervasive technology, the Internet of Things and surveillance applications. As computing technology impacts society at an ever growing pace, there are growing calls for more computer ethics content to be included in Computer Science curricula. In this paper we present the results of a survey that polled faculty from Computer Science and related disciplines about teaching practices for computer ethics at their institutions. The survey was completed by respondents from 61 universities across 23 European countries. Participants were surveyed on whether or not computer ethics is taught to Computer Science students at each institution, the reasons why computer ethics is or is not taught, how computer ethics is taught, the background of staff who teach computer ethics and the scope of computer ethics curricula. This paper presents and discusses the results of the survey.


Introduction
Computers and technological applications are now central to many aspects of life and society, from industry and commerce, government, research, education, medicine, communication, and entertainment systems. Computer Scientists and professionals from related disciplines who design and develop computer applications have a significant responsibility as the systems they develop can have wide ranging impacts on society where those impacts can be beneficial but may also at times be negative. The last decade has seen rapid technological growth and innovation, with the realities of Artificial Intelligence technology and related applications coming to fruition. Increasingly there is a sense that we are developing technology faster than we are assessing its moral and ethical implications.
Computer ethics, defined as "the analysis of the nature and social impact of computer technology and the corresponding formulation and justification of policies for the ethical use of such technology" (Moor, 1985, p.266), has a long history, dating back to the works of Wiener on Cybernetics almost 70 years ago. Over the years many variations of the term computer ethics have entered the literature including computing ethics, information ethics, informatics ethics, ICT Ethics, IT ethics and ethics of information systems (Stahl et al., 2016). These terms reflect the widespread and increasingly pervasive use and impacts of computing technology in all areas of society such as education, transportation, governance and so on (Dodig-Crnkovic, 2003).
As such, in this paper we use the term "computer ethics" as a broad term to encompass a wide range of topics related to computer technology and ethics, including computing ethics, information ethics, informatics ethics, ICT Ethics, IT ethics and ethics of information systems. Despite the long history of computer ethics and many academic discussions on the topic, professional ethics for designers and developers of computer technology are less well developed than for those in other fields such as medical, legal and business and engineering ethics. Computer Science is still a relatively young and still evolving discipline. Furthermore, the ethical questions faced by Computer Scientists are often more nuanced than those faced by other professions. For example, in Engineering education, the classic ethical case studies depict losses of life or injury as a result of ethical lapses in these fields. e.g. the Ford Pinto fires or the collapse of the Hyatt walkway in Kansas City. While some Computer Scientists build safety critical systems, many others develop systems that are non-critical from a safety perspective, but at the same time have wide societal impacts. For example, commercial and government systems such social media platforms, predictive analytics for consumer behaviours or surveillance technologies. Some of the impacts of such systems are intended, for example, to encourage online consumers to purchase goods or services or to automate human-centric tasks. However, unintended consequences of new technologies are becoming increasingly obvious-code developed for one purpose in a specific system can be reused in another system where it could different or even ethical consequences. These consequences have increasingly come into public view, for example, how data harvested illegally from social media platforms was used to influence voters in elections in the US and the UK or how automated decision making software displayed gender and racial biases when shortlisting applicants for jobs.
As such it is important that graduates of Computer Science and related programmes are equipped to consider the ethical dimensions of the technology they will design and develop in their professional lives. It is becoming more commonplace for institutions to prioritize integrating computer ethics into their Computer Science curricula so students don't just learn about how to build software, but also they learn how to analyse the potential negative consequences of any software they design and build. Finally, with more and more countries introducing computing into school curricula (Passey, 2017;Sentance & Csizmadia, 2017) with the aim of creating a whole new learning culture (Brodnik & Lewin, 2017), Computer Science will come to play an even more important role in all levels of education, thus making computer ethics an imperative field of knowledge for all educators.
In this paper we outline the results of a large scale survey of European academics about existing competencies in the teaching of computer ethics in Computer Science and related disciplines (Ethics4EU, 2021). The survey was completed by respondents from 61 universities across 23 European countries. Respondents were surveyed on whether or not computer ethics is taught to Computer Science students at each institution, the reasons why computer ethics is or is not taught, how computer ethics is taught (for example, as a standalone course or embedded within other modules), the background of staff who teach computer ethics and the scope of computer ethics curricula. Data was also gathered on teaching and learning methods used (theory, case studies, practical work) and how computer ethics is assessed. The survey was conducted as part of an Erasmus + project, Ethics4EU that is focused on developing new computer ethics curricula and learning materials for faculty teaching Computer Science. The aim of the survey was to provide a comprehensive insight into teaching practices for computer ethics in Computer Science and related disciplines which will be used to guide the development of new teaching and learning resources.
The rest of this paper is organized as follows. In the next section, we present a literature review about the teaching of computer ethics in Computer Science. In Section 3 we present our survey methodology. In Section 4 we present and discuss the finding from our survey. We conclude with a discussion in Section 5.

Literature review
Computer ethics have been the subject of academic research for many years. In The Human Use of Human Beings (Wiener, 1950), Wiener wrote about how computers have the potential to drastically alter the communication mechanisms and therefore transform the fabric of societies namely social policies, law, the economy and personal relationships. The issues he identified in included topics that are still important today: computers and security, computers and unemployment, responsibilities of computer professionals, computers for persons with disabilities, information networks and globalization, virtual communities, teleworking, merging of human bodies with machines, robot ethics, artificial intelligence, computers and religion, and a number of other subjects (Bynum, 2000).
In the 1970s Walter Maner coined the term 'computer ethics' recognising an important new area of applied ethics and was one of the first academics to develop a computer ethics course for students (Bynum, 2008). In 1985 Debora Johnson published the seminal textbook Computer Ethics (D. Johnson, 1985) where she stated that computers "pose new versions of standard moral problems and moral dilemmas, exacerbating the old problems, and forcing us to apply ordinary moral norms in uncharted realms." "Computer Ethics" quickly became the primary text used to teach computer at universities. The textbook also set the research agenda on topics such as ownership of software and intellectual property, computing and privacy, responsibilities of computer professionals, and fair distribution of technology and human power. In later editions in 1994, 2001 and 2009, Johnson added new ethical topics such as hacking, inclusive technologies for persons with disabilities, and Internet ethics.
A different emphasis for computer ethics was advocated by Donald Gotterbarn (Gotterbarn, 1991), who believed that computer ethics should be seen as a professional ethics devoted to the development and advancement of standards of good practice and codes of conduct for computing professionals. In the 1990s Gotterbarn's professional ethics approach purported that Computer Science students should be taught their professional responsibilities, standards and reasoning skills to deal with emerging and future ethical issues relevant to their profession as well as specific values and avoid malpractice (Iqbal & Beigh, 2017). Gotterbarn's position was complemented by the publication of the ACM's Code of Ethics and Professional Conduct in 1991 which included recommendations to teach social and ethical issues as part of undergraduate Computer Science curricula (Bynum, 2008(Bynum, , 1992Fuller et al., 2010;Tucker, 1991).
The approach of teaching computer ethics as a standalone professional ethics subject or for it to be delivered as an external course, often outsourced to a different department like that of Philosophy or Social Sciences, sometimes devoid of technical context has pervaded for some time (Skirpan et al., 2018). For example, a survey from 2019 by Saltz et al. (2019) examined the syllabi of machine learning courses from a large number of third level institutions in the US and found that for a majority of programmes, students are not taught any ethics content and for those that are, it is usually a stand-alone elective course. It is only recently that scholars have argued that since every computer-related subject carries social or ethical implications, then these ethical topics should be widely integrated and infused in Computer Science curricula (Harris et al., 2019;Weikle, 2018). For example, Grosz et al. (2019) argue that modern technology cannot be considered "value-neutral" (p. 54); it can have unplanned consequences and that Computer Science students should be trained to identify the potential harmful effects of the technologies they help develop. An important concept that students need to be able to think about is not only whether they can create something, but whether they should create it in the first place. The authors argue that teaching computer scientists to identify and address ethical problems starting from the design phase is as important as enabling them to develop algorithms and programs that work efficiently (p. 61). Therefore, they argue for the integration of computer ethics throughout the whole Computer Science curriculum.
A recent paper (Fiesler et al., 2020) surveys Computer Science computer ethics classes in 94 universities located mainly in the US, showed that there is much variability in the content of computer ethics courses which they attribute to the lack of standards in this particular subject. This is not to say that there are no common patterns. Topics such as privacy, algorithms and inequality are considered critical. The study also highlighted a slight move from standalone computer ethics courses towards integrating computer ethics throughout technical courses. Scott and Barlowe (2016) describe an experimental Computer Science module that introduced first-year university students to basic programming with computer ethics and found that those students who had completed the course were more likely to do better during their first year of Computer Science. In related work, Ferrarello (2019) underline that social and ethical awareness when introduced into Design and Engineering education generally promotes the industry's capability to tackle ethical and social issues effectively. The study found that using methods such as workshops that adopted collaborative, engaged design approaches, facilitated discussion, debates and reflection helped the participants acknowledge responsibilities and the ownership of decision making in design and engineering.
At a postgraduate level, Dexter et al. (2013) investigated the requirement for computer ethics education on graduate level programmes in four diverse US academic institutions. They found that the majority of faculty and students were in favour of an elective computer ethics course and almost half were in favour of a compulsory computer ethics graduate course.
In terms of how computer ethics is taught, case-based analysis of ethical and societal issues of technology that have either appeared in the news or are part of hypothetical scenarios are a popular approach (Ghafarian, 2002;Kraft, 2011;Larson & Miller, 2018;Quinn, 2006). This approach relies on precedent cases and paradigms to reach a conclusion about a test case. Larson and Miller (Larson & Miller, 2018) argue that just reading about ethical issues is not enough, rather case-based analysis provides an environment where students can apply computer ethics and critical thinking in realistic scenarios. In a 2019 study Lester and Dalat-Ward (Lester & Dalat-Ward, 2019) found that combining case-based learning and ethical decision making with deliberative dialogue and role playing was an efficient method to achieve the learning outcomes when compared to traditional lecture-based teaching. They also found that the students' self-confidence on the subject matter increased as well as their critical thinking skills and their openness towards differing viewpoints. However, one challenge the researchers discovered is the extensive preparation time required by faculty members before each class.
Deliberation appears to be a good tool for teaching ethics as shown in a 2020 study by Shen et al. (2020) where they used deliberation and Value Cards in a gamified teaching approach that combines technical training with topics such as Fairness, Accountability, Transparency and Ethics (FATE) for a Machine Learning class. Their aim was to help students understand the societal and ethical implications of machine learning-based algorithmic systems while taking into account diverse social values. They designed a set of Value Cards drawing from the research on value sensitive design and based on the concept of the Envisioning cards toolkit (Friedman & Hendry, 2012).
Others advocate interdisciplinary collaborations between different academic faculties as an effective way to deliver computer ethics. For example, Kesar (2016) created a computing curriculum that emphasizes interdisciplinary collaborations between academic departments, promotes industry interactions and supports students to develop critical ethical reasoning skills for real business settings. In a review, the majority of students identified the ethical and social properties of their projects rather than the technological aspects as the most complex issues. Another recent interdisciplinary approach was reported by Reich et al. (2020) who designed a multidisciplinary approach for teaching computer ethics at Stanford University. Their approach combines the expertise from the faculties of Philosophy, Political Science and Computer Science and includes panels of speakers and custom-built case studies. Wilk (2019) who proposes the creation of an entirely new Computer Science course titled "Computers, Ethics, Law, and Public Policy". The course would combine computer ethics with law and use examples and case studies to illustrate ethical and legal decision making. The author states the importance of teaching legal aspects to Computer Science students because as new technologies appear there will be new requirements to develop laws and computer ethics to address them. Kortsarts and Fischbach (Kortsarts & Fischbach, 2014) proposed an approach which combines together the ACM Code of Ethics and case-based design and analysis. More specifically, their approach to computer ethics constituted of three parts. The first part was about the students learning the ACM code of ethics and designing case studies. In the second part the students had to analyse said case studies. In the last part, the students had to review reading material from the ACM digital library and present their findings. The researchers found that over two thirds of the students found computer ethics to be important and would influence their decisionmaking process in the future and also said discovering the ACM Code of Ethics was worthwhile.
Drawing a parallel with the field of Engineering Ethics, which historically precedes Computer Ethics, Hess and Fore (2018) conducted a systematic literature review of US Engineering ethics interventions and found that the most common approaches were the use of case studies, exposure to professional codes and standards and discussion activities. Their study identified a great amount of variation in the aims, methodologies and assessment approaches in the interventions available. They argue that there is need for greater specificity about the term "ethics", educators should set clear and well-defined goals for teaching ethics and they should be able to provide evidence to community about the effectiveness of their approaches with respect to the aforementioned goals. Bates et al. (2020) identified various challenges in integrating ethical and societal dimensions into programmes. For example, forming a curriculum that is based on ethical values can be challenging when teaching has to accommodate students coming in with different cultural values to their academic teachers. Also, an interdisciplinary approach to teaching ethics and critical thinking skills might run into the obstacle of miscommunication due to different fields of expertise that have to work together.
It is worth noting that much of the research on the teaching of computer ethics focuses on US institutions and there is a lack of comprehensive data on the teaching of computer ethics in Computer Science from a European perspective. Our study aims to contribute towards shedding more light on what is the situation regarding European Computer Science and related programmes. In the next sections, we outline the results of a survey of 61 universities across Europe designed to understand the extent to which and how computer ethics is taught on Computer Science and related programmes across Europe.

Methodology
We designed an online survey to better understand existing practices in the teaching of computer ethics in Computer Science programmes at European Universities. The survey was created using Lime Survey software and was developed in the English language only. The questionnaire was sent to all members and networking partners of Informatics Europe and European Digital Learning Network who are partners in the Ethics4EU project with a reach of reaching 152 European Universities from 30 European countries. It was also publicly available from the Informatics Europe website and shared on a range of social media platforms, including: Twitter, Facebook and relevant LinkedIn groups. The questionnaire was deployed in January 2020 and was available online for 6 weeks. Over the six weeks, weekly reminders asking people to fill out the online questionnaire were sent. In total we received responses from 61 universities from 23 European countries representing a 40% response rate. Each response is unique for the respective university. Participants did not receive any incentives or remuneration to complete the survey.
The questionnaire (see Appendix) was divided into three sections. Section A surveyed demographic information including the country of the respondent's institution, their role, and the number of students studying Computer Science and related programmes at the institution. The rest of the questionnaire was split into two parts, B and C, based on whether the institution taught computer ethics as part of any Computer Science or related programmes. Section B was completed by those at institutions that do not teach computer ethics, and amounted to 22 out of 61 responses. The questions in Section B examined the reasons why Computer Science is not taught at those institutions. Section C was completed by respondents at institutions where computer ethics is taught on their Computer Science and/or related programmes. This amounted to 39 institutions and the questions surveyed how computer ethics is taught, the background of staff who teach computer ethics and the scope of computer ethics curricula.
For reasons beyond the researcher's control there was a larger number of responses from Italian institutions relative to other countries represented in the survey. However, as responses were grouped by whether an institution teaches computer ethics or not, the responses from Italian universities were balanced with the rest of the countries for Section C (institutions that do teach computer ethics). On the other hand, in section B (institutions that do not teach computer ethics), Italian institutions accounted for almost one third of the responses (7 out of 22). Steps were taken to balance the data using Jackknife resampling (Tukey, 1958) whereby each response is systematically left out of the overall sample to ensure that no single response has a significant impact on the overall outcome. Additionally, pairs and trios of the responses from the Italian institutions were left out to explore whether or not those responses had a significant impact on the overall trends, and it was found that they did not.

Results
In this section we present the results of the survey starting with participants' demographic information. The survey reached around 150 academic institutions and 61 of them completed it. This shows a response rate of 41%.

What country is your institution primarily based in? (choose only one answer)
Twenty-three countries were represented in the 61 responses. It is worth noting that the majority of EU member countries are represented here, as well as several other European countries. Respondents from Italy are in the majority, and as discussed responses were analysed and no significant impact of this overrepresentation was found (Fig. 1).

Does your institution teach all subjects or focus on technical ones? (choose only one answer)
As show in in Table 1, almost one third (31%) of academic institutions focus on technical subjects, whereas the remaining institutions (69%) are general universities that teach a broader range of subjects.

What is your role within your institution? (choose all that apply)
The majority of the respondents identified as Professor (62%). 14.75% identified as Lecturers. Please note that in European counties, lecturers and professors are both full time academic staff who carry out teaching and research duties. Therefore 77% (Table 2) of respondents have direct teaching experience at an academic institution. It is also helpful that other respondents identify themselves as having academic management roles, given that they would be more acutely aware of challenges associated to resource allocation, which has been identified as a key challenge to the teaching of computer ethics in Computer Science programmes (Grosz et al., 2019;Johnson, 2010;Pease & Baker, 2009).
Respondents could also provide other roles additionally to those shown in

Approximately how many students attend your institution? (choose only one answer)
A wide range of academic institutions sizes were represented in the survey (Table 3). The majority of institutions (74%) had between 10,000 and 50,000 students.
Approximately how many students are studying on Computer Science and/ or Computer Science related programmes (e.g. Informatics, Information Systems, Analytics, Computing for Business, Computer Engineering, etc.)? (choose only one answer) All academic institutions reported students studying on Computer Science or related programmes. 30% of institutions surveyed report having between 1001 and 2500 students (Table 4) enrolled in Computer Science and related programmes. NOTE: A "programme" refers to a complete collection of subjects a student had to study before achieving a qualification, e.g. a BSc in Computer Science.

At what level does your institution teach Computer Science and/or Computer Science related programmes? (choose all that apply)
Of the 61 academic institutions surveyed, only 3 exclusively teach postgraduate programmes, and 1 exclusively teaches undergraduate programmes, with majority (90) teaching a combination of both (Table 5).

Section B-Institutions that do not teach ethics as part of their Computer Science and/or Computer Science related programmes
A total of 22 responses from 61 countries were received from academic institutions that do not teach computer ethics on their Computer Science (and related) programmes. Of those responses, 21 came from institutions that teach all academic subject areas and only 1 from an institution that focuses on technical subjects. In our dataset, almost one third (7 out of 22) of those responses were from Italian institutions. In response to this overrepresentation, Jackknife resampling was applied to estimate the bias of the sample and no significant impact was found. The rest of the institutions were spread geographically across Europe. How important do you think it is that ethics is taught on Computer Science and/ or Computer Science related programmes?
In academic institutions that do not teach computer ethics, almost two-thirds (63%) of the respondents' consider the teaching of computer ethics as either being "Important" or "Very Important" for Computer Science (and related) programmes (Table 6).

Please explain in a sentence or two why you answered the previous question the way you did
The respondents gave a range of reasons as to why the teaching of computer ethics is important. The. most common was the ever-growing impact that computers have on society which was mentioned by almost 50% of the respondents. Some of the respondents highlighted specific areas within Computer Science where they believe computer ethics is important-Data Science, Artificial Intelligence, Computer Security and Ubiquitous Computing were mentioned multiple times.
In terms of content delivery, some respondents felt that computer ethics should be taught by incorporating it into existing modules, whereas others felt it should be delivered as an optional module. Specific content that respondents suggested included Codes of Ethics, Intellectual Property rights, privacy, as well as the broader areas of software design and development and where computer ethics fits into those processes.
Those who felt that there was not a need to teach computer ethics suggested it was because employers don't ask for it, it's not the most important thing to teach on a Computer Science (or related) programme, and that teaching it is not cost effective. Others claimed that teaching computer ethics would not help students become more ethical as they should already know about ethics before they come to university -from previous schooling and their family. One respondent claimed that ethics isn't taught in other non-natural science programmes, so wondered why Computer Science should be different; and another suggested it is only relevant in Computer Science research, not teaching.

Rate the following as reasons why ethics is not taught on your Computer Science and/or Computer Science related programmes
Respondents were asked to select from a number of possible options outlining why computer ethics is not taught (see Table 7). The main reasons the academic institutions do not teach it is a lack of time (73%) and a lack of staff availability (73%). Half of the respondents suggests a lack of staff expertise was also a factor. The responses reaffirm the notion that the majority of respondents do believe that teaching computer ethics is important event though it is not taught on Computer Science (or related) programmes at their institutions (71%).

Are there plans to teach ethics on your Computer Science and/or Computer Science related programmes?
The responses were evenly split between academic institutions that planning to begin teaching computer ethics on their Computer Science (and related) programmes and those who aren't (41% each). 18% of respondents did not know (Table 8). Respondents were asked to comment on their answer to this question. For those respondents whose institutions are planning to teach computer ethics, the main subject areas mentioned were Data Science, Artificial Intelligence, Computer Security, Health Informatics & Bioinformatics, Requirements Engineering, and CSCW (Computer-Supported Cooperative Work). One respondent mentioned that their institute are launching an Ethical-Legal stream on their MSc in Data Science programme. For those from institutions with no plans to teach computer ethics, they stated it was due to either a lack of interest or a lack of expertise in the topic. One respondent did mention that students at their institution have the option of doing an ethics module in another faculty as part of their programmes.

Section C-Institutions that do teach ethics as part of their Computer Science and/or Computer Science related programmes
A total of 39 responses were collected from academic institutions that teach computer ethics in their Computer Science (and related) programmes from 17 countries. Of those responses, 18 came from institutions that only focus on technical subjects and 21 came from institutions that teach all academic subjects areas.

How important do you think it is that ethics is taught on Computer Science and/ or Computer Science related programmes?
From the institutions that are teaching computer ethics in Computer Science (and related) programmes, 95% of the respondents rate the teaching of computer ethics as either being "Important" or "Very Important" (Table 9).

Do you think your institution/department is teaching enough ethics on your Computer Science and/or Computer Science related programmes? (choose only one answer)
Over one-third (36%) of the participants responded that do not believe that their intuitions are teaching enough computer ethics in their Computer Science or related programmes (Table 10). Almost half felt enough computer ethics is being taught "to a certain extent".

At what level is ethics taught as part of your Computer Science and/or Computer Science related programmes? (choose all that apply)
Computer ethics is taught in 26% of the surveyed institutions at BSc level only (Table 11). In 23% of the surveyed institutions it is taught at both BSc and MSc level. In 28% of institutions it is taught at BSc, MSc, and PhD level. The final 23% represents other combinations, such as "BSc and PhD level" or "MSc level only".

How is ethics taught on your Computer Science and/or Computer Science related programmes? (choose only one answer)
NOTE: in this case, a "module" refers to a single topic that a student studies over one or two semesters, e.g. Databases, Computer Networks, etc. This question explores if computer ethics is being taught as a stand-alone module, or distributed throughout several modules, or a combination of both (Table 12). In the majority of institutions (38%), computer ethics is taught as a standalone module.

Which background does the person or people who teach ethics in your Computer Science and/or Computer Science related programmes have? (choose all that apply)
The results presented in Table 13 show that staff teaching computer ethics at the surveyed institutions come from a wide variety of backgrounds, with many coming from multiple disciplines. The most represented discipline is Computer Science at 72%. However, a large number of those teaching computer ethics have backgrounds in Ethics, Philosophy and Law. Please note that respondents could choose more than one background and as such the percentage sum is higher than 100%.
Other backgrounds were provided by respondents in free text answers and included: "Economics"; "Linguistics, Cognitive Science".

Which of the following teaching methods are used to teach ethics on your Computer Science and/or Computer Science related programmes?
Traditional approaches to teaching, such as "Lecturing" and "Case Studies" are the popular approaches to teaching computer ethics, with "Debates" and "Problem Based Learning" the next most popular pair of approaches (see Table 14). Guest As a stand-alone module 15 38% A combination of both above approaches 13 33%

How many teaching hours per semester is devoted to ethics on your Computer Science and/or Computer Science related programmes? (choose only one answer)
Just under half of all respondents (48%) indicated that they teach between up to 5 h per semester, in contrast to 18% of respondents who indicated that they teach  computer ethics for 20 + hours per semester (Table 15). There is clearly a large difference to the amount of time the surveyed institutions devote to the teaching of computer ethics in Computer Science (and related) programmes Table 16.

Which ethical topics are taught on your Computer Science and/or Computer Science related programmes?
The most common topic is ethical issues with respondents commenting that these are topics specific to subjects (e.g. Data Science). Just over half of the respondents (51%) said that Code of Ethics from a professional body are taught at their institutions and exactly half (50%) teach Ethical Theory. Other topics mentioned in respondents comments included: • Responsibility • Legal Issues • Ethics Washing • Epistemic Issues • EU Ethics

How is ethics assessed on your Computer Science and/or Computer Science related programmes? (choose all that apply)
The top three methods of assessing students' understanding of computer ethics are Exams, Essays, and Presentations; three quite standard approaches to assessing Computer Science content. With much lower representation we find Quizzes, Portfolios, and Rubrics (Table 17). Some other approaches mentioned by respondents included methods such as Debates, Peer Instruction, and Discussion, and dynamic and real-world approaches such as Risk Analysis, Real Use Cases, and Videos.

Does your institution teach ethics as part of any of the computing topics outlined below? (These classifications are based on criteria by ACM -Association for Computing Machinery)
The survey used the European Research Council's Peer Evaluation (PE) panel classifications of Computer Science (PE6) disciplines. The categories are as follows: • PE6_1: Computer architecture, pervasive computing, ubiquitous computing • PE6_2: Computer systems, parallel/distributed systems, sensor networks, embedded systems, cyber-physical systems • PE6_3: Software engineering, operating systems, computer languages • PE6_4: Theoretical computer science, formal methods, and quantum computing • PE6_5: Cryptology, security, privacy, quantum crypto • PE6_6: Algorithms, distributed, parallel and network algorithms, algorithmic game theory • PE6_7: Artificial intelligence, intelligent systems, multi agent systems • PE6_8: Computer graphics, computer vision, multi-media, computer games • PE6_9: Human computer interaction and interface, visualization and natural language processing • PE6_10: Web and information systems, database systems, information retrieval and digital libraries, data fusion • PE6_11: Machine learning, statistical data processing and applications using signal processing (e.g. speech, image, video) • PE6_12: Scientific computing, simulation and modelling tools • PE6_13: Bioinformatics, biocomputing, and DNA and molecular computation Respondents to indicate "Yes" or "No" as to whether or not they taught ethical content for each topic. The results are presented in Fig. 2.
The PE6 areas considered to be most important in terms of teaching computer ethics were: 1. PE6_7 Artificial Intelligence, Intelligent Systems, Multi Agent Systems 2. PE6_5 Cryptology, Security, Privacy, Quantum Crypto 3. PE6_9 Human Computer Interaction and Interface, Visualization and Natural Language Processing The PE6 areas considered to be least important in terms of teaching: 1. PE6_8 Computer graphics, computer vision, multi-media, computer games 2. PE6_1 Computer architecture, pervasive computing, ubiquitous computing 3. PE6_12 Scientific Computing, Simulation and Modelling Tools It is perhaps not surprising that Artificial Intelligence, Security and Privacy ranked highly in topics that are taught as these are mentioned frequently by respondents as areas where there are important computer ethics issues to be considered, for example as indicated by responses outlined in Sect. 4.3.3 and Sect. 4.3.8. It is surprising however that pervasive and ubiquitous computing and simulation and modelling ranked so lowly on the list of topics taught given the important ethical dimensions to these topics.

Discussion
We have presented the results of a survey that polled faculty from Computer Science and related disciplines on teaching practices in computer ethics in Computer Science and related programmes across Europe. The survey was completed by respondents from 61 universities across 23 European countries. Some of the interesting findings that emerged from the survey include: • Two thirds of the institutions surveyed teach computer ethics as part of Computer Science (or related) programmes, however one third do not. • There is widespread agreement about the importance of teaching computer ethics to students enrolled on Computer Science (or related) programmes. This importance was noted whether or not an institute taught computer ethics as part of their Computer Science or related programmes. • Computer ethics is often taught as a standalone subject. • When computer ethics is not taught as part of Computer Science (or related) programmes the most common reasons cited are a lack of staff availability and expertise. • Computer ethics is considered more important for certain Computer Science topics. For example Data Science, Artificial Intelligence and Computer Security. • Most institutions devote a relatively small number of hours to teaching computer ethics on their Computer Science or related programmes, 67% of institutions surveyed teach 10 h or less per semester.
As noted from the survey computer ethics is considered more important by many respondents, for certain Computer Science topics. For example, respondents mention the importance of computer ethics with regard to topics such as Data Science, Artificial Intelligence and Computer Security and respondents replied that computer ethics is most commonly taught as part of Artificial Intelligence, Computer Security and Human Computer Interaction courses. There is a great deal of public interest in and media coverage of topics concerning data and Artificial Intelligence applications; they are also topics that are currently undergoing intense academic research. It may be that those who teach computer ethics can more easily locate and identify case studies and other relevant information such as research papers for these topics. For example (Morley et al., 2020), new AI ethics tools are emerging that allow developers to analyse AI and machine learning systems for levels of potential bias. Furthermore, much has been written on the European Union's General Data Protection Regulation which effectively create a "right to explanation," whereby a user can ask for an explanation of an algorithmic decision that was made about them (Goodman & Flaxman, 2017). This has led to an increase in the literature about how create explainable AI systems (Ras et al., 2018). However, it should not be overlooked that computer ethics is relevant across a range of Computer Science topics including all of the PE6 areas outlined in Fig. 2. Evidently there is a need to develop teaching content and case studies for ethical issues across a broader range of Computer Science topics.
Our survey also found that computer ethics is often taught as a standalone subject at the academic institutions surveyed. This is in spite of evidence that infusing computer ethics in Computer Science curricula gives students a better understanding of the ethical impacts and possible harmful effects of the technologies they implement (Grosz et al. 2019). According to Grosz, such a "distributed pedagogy" approach reinforces the message that ethical reasoning is part of what you do as a Computer Scientist. Embedding computer ethics across the curriculum helps Computer Science students see how ethical issues can arise from many contexts. Given the increasing likelihood that many Computer Science graduates will work on sociotechnical systems with a variety of impacts on their end users, it is important that Computer Science teaching emphasizes not only the technical capabilities of these systems but also provides students with the ethical reasoning skills to analyse the understand the ethical implications of these systems.
It is also worth noting that our survey found that people who teach computer ethics to Computer Science students are more likely to come from a technical background rather than an Ethics background. The question of who should teach computer ethics to Computer Science students raises questions about the goals of teaching computer ethics. If the goal is to raise awareness of the ethical issues surrounding computers and to develop analytical skills for ethical decision making then it would seem that it is more appropriate for Ethicists to teach this content (D. Johnson, 1994). However, many ethical topics in Computer Science require a deep understanding of the technology that gives rise to the ethical questions, for example the complex mathematical structures that underpin deep learning algorithms. To increase both the breadth and depth of computer ethics teaching, content would be best developed via collaborations between Computer Scientists and Ethicists.
It is also noteworthy that looking at the responses from Sect. 4.3.6, when teaching computer ethics, guest lecturers from industry and professional bodies are not widely used. Taking this in conjunction with the responses from Sect. 4.3.8 which indicates that the least frequent type of teaching is through the use of different corporations' codes of ethics, followed by national bodies' codes of ethics (although teaching using professionally bodies' codes of ethics is far more common), this may suggest that the connection between computer ethics and the relevant sectorial industry needs to be further emphasised. This is important, as one of the key aims of this research is to produce teaching content that will equip students with a working knowledge of the types of ethically quandaries that they may encounter in their working lives. Therefore, having guest lecturers from industry, and particularly from local or national industry, that may be more readily identifiable with by the students, may help underscore the relevance of computer ethics to their own future professional careers.
In future work, the Ethics4EU project is that is focused on developing new open computer ethics curricula and learning materials for faculty who teach Computer Science. The design and development of these curricula will be done in collaboration between academics from Computer Science and Ethics. The curricula will consist of teaching content including case studies, in-class activities, assignments and recommended readings. The Ethics4EU project will also establish a community of practice for those who teach computer ethics to share lessons learned. The overarching aims of the curricula will be to integrate the teaching of computational methods with ethical reasoning skills and provide students with experience in identifying, confronting, and working through ethical questions across many topics in Computer Science. Such skills will equip graduates to produce socially responsible computer technology with benefits for all of society.

Conflicts of interest/Competing interests
The authors have no conflicts of interest to declare that are relevant to the content of this article.

Ethics
This research was undertaken using the BERA guidelines as a reference point to ensure that all activities were designed in such a way as to adhere to normal ethical research practices.

About Your Institution
In this survey INSTITUTION refers to a University, University College, Technical University, Institute of Technology, Polytechnic University and other types of higher education institutions; PROGRAMME refers to a complete collection of subjects a student had to study before achieving a qualification, e.g. a BSc in Computer Science; MODULE refers to a single topic that a student studies over one or two semesters, e.g. Databases, Computer Networks, etc.

6.At what level does your institution teach Computer Science and/or Computer Science related programmes? (choose all that apply)
Bachelor Master PhD

Yes
No PROGRAMME refers to a complete collection of subjects a student had to study before achieving a qualification, e.g. a BSc in Computer Science.

How important do you think it is that ethics is taught in a Computer Science and/or
Computer Science related programme? (1=not at all important, 5=very important) 1 2 3 4 5 PROGRAMME refers to a complete collection of subjects a student had to study before achieving a qualification, e.g. a BSc in Computer Science.

Please explain in a sentence or two why you answered the previous question the way you did.
Please write your answer here: 3. Rate the following as reasons why ethics is not taught as part of your Computer Science and/or Computer Science related programmes 1 (never) 2 3 4 5 (regularly)

Ethics isn't that important
We have a lack of staff expertise We have a lack of staff availability We have a lack of time (there's too many other things to teach) The content we teach is too far away from ethics If none of the reasons above fits, specify your reason why ethics isn't taught on Computer Science and/or Computer Science related programmes at your institution.
Please write your answer here:

Are there plans to teach ethics on Computer Science and/or Computer Science related programmes at your institution?
Data Availability All materials and data related to survey is available.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http:// creat iveco mmons. org/ licen ses/ by/4. 0/.