The Asilomar Survey: Stakeholders’ Opinions on Ethical Issues Related to Brain-Computer Interfacing
- 4.5k Downloads
Brain-Computer Interface (BCI) research and (future) applications raise important ethical issues that need to be addressed to promote societal acceptance and adequate policies. Here we report on a survey we conducted among 145 BCI researchers at the 4th International BCI conference, which took place in May–June 2010 in Asilomar, California. We assessed respondents’ opinions about a number of topics. First, we investigated preferences for terminology and definitions relating to BCIs. Second, we assessed respondents’ expectations on the marketability of different BCI applications (BCIs for healthy people, BCIs for assistive technology, BCIs-controlled neuroprostheses and BCIs as therapy tools). Third, we investigated opinions about ethical issues related to BCI research for the development of assistive technology: informed consent process with locked-in patients, risk-benefit analyses, team responsibility, consequences of BCI on patients’ and families’ lives, liability and personal identity and interaction with the media. Finally, we asked respondents which issues are urgent in BCI research.
KeywordsBrain-computer interfaces Brain-machine interfaces Neuroethics Neuroimaging Locked-in syndrome
The research field of Brain-Computer Interface (BCI) is growing rapidly. The scientific foundations of BCI research were established decades ago, mostly by medical doctors, neurophysiologists, psychologist and physicists (e.g. [6, 7, 14, 15, 18, 19, 20, 33, 34, 67, 70].
Recent contributions from other fields such as human-computer interaction (HCI), electrical engineering, computer science and artificial intelligence have fostered tremendous innovation in BCI research. This has resulted in a new (additional) focus on non-medical applications (e.g. gaming, military use, and workplace devices). The increasing number of contributors, applications, and users has exposed some controversial topics and potential roadblocks. In particular, researchers and policy makers are becoming more and more aware of emerging ethical issues related to BCI research, development and dissemination. BCIs are also increasingly prominent in popular culture and thus, perceived by the general public. For example, popular TV shows such as House, Star Trek, and Fringe have aired episodes that present BCIs . Media frequently and inaccurately report that science is now capable of reading peoples’ thoughts and dreams, even when people are in a vegetative state (e.g.: [1, 11, 21, 46, 65]). However, most BCI researchers described in these articles merely try to obtain a binary signal, a so-called single switch, from a patient to enable control of an assistive technology (AT) device. As long as patients have a single switch, either a residual muscle movement or a BCI-controlled signal, they can use AT .
In 2006, Wilhelm and colleagues reported on their attempt to communicate with a complete locked-in patient. Through food imagery, the patient manipulated her salivary pH and could give yes/no answers to questions . In an accompanying editorial, Phillips responded to this article with the critical question ‘even when you can communicate with a locked-in patient, should you do it?’1 . Phillips argued that the development of Brain-Computer Interfaces for communication might compel physicians and patients to consider life-sustaining treatments more often, and that patients are therefore at higher risk of becoming locked-in. However, the assumption that quality of life in the locked-in state is necessarily low, as suggested by Phillips, is factually wrong [28, 29, 32, 52, 58]. Phillips further argued that life-sustaining treatments might inflict heavy burdens on the quality of life of the patients and the emotional and financial state of the caregivers. Dobkin also suggests that the use/availability of BCIs as assistive technology might bring financial, physical and emotional burden to persons . Both authors urge BCI researchers to address ethical concerns related to Brain-Computer Interfacing.
Phillips and Dobkin raise important issues that the BCI community should address further. BCI research and future applications do not necessarily have only beneficial consequences, but may also lead to harmful consequences.
The nascent neuroethical debate has identified several topics of importance to Brain-Computer Interfacing: 1) obtaining informed consent from people who have difficulty communicating, 2) risk/benefit analysis 3) shared responsibility of BCI teams (e.g. how to ensure that responsible group decisions can be made), 4) the consequences of BCI technology for the quality of life of patients and their families, 5) side-effects (e.g. neurofeedback of sensorimotor rhythm training is reported to affect sleep quality) 6) personal responsibility and its possible constraints (e.g. who is responsible for erroneous actions with a neuroprosthesis?), 7) issues concerning personality and personhood and its possible alteration, 8) therapeutic applications, including risks of excessive use, 9) questions of research ethics that arise when progressing from animal experimentation to application in human subjects, 10) mind-reading and privacy, 11) mind-control, 12) selective enhancement and social stratification, 13) human dignity, 14) mental integrity, 15) bodily integrity, 16) regulating safety, 17) communication to the media [4, 8, 9, 17, 22, 40, 53, 54, 61, 63].
The Emerging Neuroethical Debate
However, the results from this initial debate do not seem to be fully integrated into BCI research. BCI researchers, like neuroscientists, may have good reason for their reluctance to wade into ethics. The questions raised are likely to be open-ended, and their arrival in the world both inside and outside the laboratory may be some way off . Furthermore, many BCI researchers come from an engineering background, and may have less training and interest in ethical matters. Finally, BCI researchers may be interested in ethical issues they are confronted with in daily work situations, while some ethicists focus on more abstract, but no less relevant, themes like enacted mind or embodied mind [17, 66]. Additionally, the public community may be more concerned with issues like mind-reading, animal experimentation and military applications. These different viewpoints and interests notwithstanding, we believe it is worthwhile to invite and support the BCI community to articulate its (varying) views as clearly as possible. Obviously, this is not something that can be accomplished in one big swoop, as extracting and clearly identifying the opinions of the members of a young, multi-disciplinary research field will take time for thinking about, discussing thoroughly and articulating clearly the ethical issues perceived to be central and/or most pressing. We therefore submit our work as one of the first incomplete steps in a long-range attempt towards clarifying the views of at least a segment of the BCI research community. Work such as provided here may invite other BCI-researchers to give their thoughts on the ethical issues involved.
During the 4th International BCI Meeting, which took place at the Asilomar conference centre in California, we conducted a survey among the attendees to help assess the views and moral concerns of the BCI community, and lay the foundations for developing BCI research efforts into a more mature effort. After extensive internal discussion and pilot testing, our team developed a two-part survey shown in Appendix I. One portion of the survey focused on the ethical issues that are important for the maturing technology of BCI. The second part of the survey addressed issues such as terminology, criteria for BCI definition, matters of urgency and expected marketability. The 4th International BCI meeting was the largest BCI meeting ever (289 estimated attendees) and provided an exceptional opportunity to explore key issues amongst colleagues, although it has to be noted that many other qualified respondents (e.g. from the field of human-computer interaction or ambient intelligence) do not typically attend this meeting which may have biased our findings (see ‘Some thoughts on the survey’ in the Discussion). The conference is focused on systems that measure brain signals, extract relevant features from those brain signals and translate them into commands to software or hardware applications. This close community refers to itself as the BCI community, although many other persons use the phrase brain-computer interface also to refer to Deep Brain Stimulation, vagal nerve stimulation or cochlear implants. Thus, it needs to be noted that at this BCI conference only brain-to-computer systems are the center of focus.
What’s in a Name?
Individual assessments of the ethical implications of research and applications in a multi-disciplinary and multi-faceted area as BCI will depend largely on the individual’s interpretation on what a BCI is and isn’t. For example, someone who excludes certain research directions or applications as not being part of BCI may be less interested in certain ethical issues than a person with a broader definition. Moreover, the ethical debate will be facilitated with common terminology concerning BCIs, which has proven highly problematic. The first reason for the variance in terminology is that BCIs may have several functions. The term BCI, for example, may be used for a gaming application for healthy users, but also as an assistive technology for a person in the locked-in state. Depending on functions and target users, different ethical issues will arise. A second complication is that some BCIs use invasive recordings from the brain, whereas others use non-invasive recordings. The pervasiveness of the imaging technique used for BCIs may greatly influence the ethical debate, such as when a risk/benefit analysis is made. A third issue consists of whether people consider BCIs an outward-directional (from the brain to the computer/machine) or an inward-directional (from the computer/machine to the brain) interface. Are BCIs systems that measure brain signals and “translate” this input into output signals? Or can a BCI also be a system that uses externally generated input, e.g. Deep Brain Stimulation (DBS), to modify brain activity?
Some articles that discuss ethical issues and BCIs rely on a very broad definition of ΒCIs. For example, Racine and colleagues investigated media coverage of neurostimulation technologies and other contemporary neuroscience topics and included the terms “brain-machine interface”, “brain-computer interface” and “neural prosthesis” in the search for printed media about these topics [50, 51]. They clearly perceive invasive BCI as examples of neurostimulation techniques (personal communication). Similarly, Demetriades and colleagues recently argued that Brain-Machine Interfaces (BMIs) should solely be used for purposes of medical treatment, and all other applications should be immediately banned as unethical. However, they came to this conclusion because they included the implantation of deep brain stimulation electrodes in the definition of BMIs and focused heavily on risks of mind control that are unrealistic with conventionally defined BCIs .
Schermer, who discusses the conceptual and moral implications of Brain-Machine Interaction, also includes cochlear implants, deep brain stimulation in her definition of Brain-Machine Interfaces . Furthermore, she describes, as an example of neurofeedback, a new method for preventing epilepsy attacks with the aid of Vagal Nerve Stimulation (VNS). Changes in brainwaves can be detected and used to predict an oncoming epileptic attack. This warning system can then generate an automatic reaction from the VNS system which stimulates the vagal nerve and prevents the attack . This example of neurofeedback need not be considered a typical example by the so-called BCI community.
Apart from terminology, there are other topics that may influence a person’s stance on ethical questions. For example, people contributing to the debate may have different opinions on what is currently feasible with BCIs and which commercial BCIs are currently available. Also, they may have different expectations about BCI marketability in the future. Overly optimistic or pessimistic predictions regarding functionality, benefit and marketability of BCI products may have several consequences. First, expectations of marketability of future BCI products influence the timing and the pace of the ethical debate. Secondly, beliefs about functionality and benefit of BCI products influence the risk/benefit analysis. For example, a locked-in patient may be told during the informed consent procedure that the BCI is “going to bring back his communication skills”, whereas realistically the chances are much lower.
Below, we survey ethical opinions of BCI researchers, preferences for terminology and definitions of BCI, and expectations about marketability of BCIs.
A pilot internet survey with 29 items was created to elicit opinions on ethical aspects of BCI research, terminology and matters of urgency. Items consisted of multiple choice questions, open questions and rating scales. The survey was distributed to members of the group of BCI scientists at the Braingain Group of the Radboud University of Nijmegen. Respondents were asked to complete the survey and give feedback on the relevance, quality and quantity of the questions.
The survey assessed 1) demographic information, 2) opinions about terminology and definition of BCIs, 3) opinions about BCI applications for healthy users, 4) for assistive technology, 5) for prosthesis, 6) for therapy tools. The largest part of the survey was about 7) ethical aspects related to BCI research and finally, assessed 8) opinions about urgent issues in BCI research.
Nine BCI researchers (1 female, 8 males), with different degrees of expertise, entered the pilot study. Respondents needed between 15 and 30 min to complete the survey, which was evaluated as too time consuming. Therefore, we revised the survey such that the time needed to complete the survey was reduced to an estimated maximum of 15 min. Respondents gave constructive criticisms to the questions, so that we revised items to be more concise. From the data we could see variance in the answers, which supported the notion that the survey could uncover the various differences in opinions. Open questions about what is needed to market BCIs in future did not result in many answers and were thus omitted in the final survey. Finally, more focus on the ethical part was ensured by eliminating many general questions about BCIs.
The Asilomar Survey
The final Asilomar survey consisted of 24 items (see Appendix I). The survey assessed 1) demographic information and opinions about 2) preferred terminology and definition of BCI, 3) marketability of different types of BCI applications, 4) ethical aspects related to BCI research, development and dissemination and 5) matters of urgency. One final open question asked respondents which questions should have been included in the survey that were not included. The survey was available through internet and on paper.
At the 4th International BCI conference at the Asilomar conference grounds, we encouraged participation in the survey through posters, two oral announcements at general lectures and one email. One week after the conference a follow-up email was send to all attendees of the conference to encourage final participation. The survey was closed 2 weeks after the conference. Throughout the paper the word “respondents” will refer to the BCI researchers who participated in the survey, while “participants” will refer to persons participating in BCI studies.
Overview of profiles of respondents
Number of answers
What’s your gender?
N = 144
What’s your age (years)?
N = 144
In which year did you start with BCI research?
N = 143
Where do you live and perform this occupation?
N = 144
Eleven respondents worked as BCI researchers in Asia, 60 respondents in Europe and 73 respondents in North-America.
Terminology and Definition of BCIs
Overview of preferred name: BCI = Brain-Computer Interface; BMI = Brain-Machine Interface; BNCI = Brain/neuronal Computer Interface and assessment of three different types of BCI. See Appendix I for the complete question
Terminology and Definition
Moderately experienced experts
Which name has your preference?
Direct Neural Interface
Number of answers
In your opinion, which of these devices is a BCI? (you may choose more than one)
Number of answers
Furthermore, we assessed respondents’ views on a current “hot” topic in the BCI community. BCIs can be distinguished based on the amount of “will” the user exerted to produce the signal in the EEG [69, 72]. BCIs which rely on the user to self-regulate certain brain patterns (e.g. mu rhythm or slow cortical potentials) are dubbed as spontaneous or active BCI. BCIs which rely on a evoked responses in a user’s brain (e.g. P300 evoked potential) by presenting it external stimuli but asking a user to willfully attend to one of the stimuli are dubbed evoked or reactive BCIs. Finally, BCIs which rely on ongoing brain activity (e.g. arousal level) while the user is not willfully producing these signals or attending any special stimuli are dubbed passive BCIs.2 The BCI community has debated whether passive BCIs should be considered as BCIs as they do not seem to fit Wolpaw’s definition from 2002 [69, 71]. In our sample (N = 143) all respondents agreed that active systems are BCIs. Almost all respondents (95.1%) also consider reactive systems to be exemplary BCIs. Although respondents are less sure about passive systems, a majority (65.7%) also view these as BCIs. Notably, passive systems seem more accepted as BCIs in Asia (81.8%) and not well accepted as BCIs by experienced researchers (41.7%).
Opinions were divided about a number of issues. Fifty-three percent of the respondents did not consider an EEG lie detector as a BCI, but 41% did. Forty-four percent of the respondents considered image detection (in other words whether a recently presented object stands out) as a BCI, although 37% did not. Nineteen percent of the respondents indicated that they did not know if they considered image detection as a BCI, which may reflect that the example was not sufficiently clear. We suspect that respondents felt they could decide whether this was a BCI or not because we did not specify whether image classification would take in realtime or near realtime. This factor has been indicated as particularly important for the definition of a BCI (see next paragraph). Respondents also did not agree whether a remote controlled rat was an example of a BCI. Forty-four percent thought so, and 38% did not think it is a BCI. Neuromarketing, which uses the classification of brain responses to advertisements or new products, also divides opinions. Finally, 61% of the respondents would not consider a retinal implant as a BCI example. These results demonstrate that BCI researchers often do not agree on what is and what is not a BCI.
must detect brain activity directly (without using signals from peripheral nerves or muscles) (83.8% of the respondents).
provides feedback in realtime, or neartime (71.1% of the respondents).
must classify brain activity (60.6% of the respondents).
provides feedback to the user that reflects whether s/he successfully attained a goal (50.0% of the respondents).
Only 20% of the respondents believed that it is required that the user chooses to send a signal each time. In other words, the device can also rely on signals that the user produces involuntarily as with passive BCIs. Similarly, only 9% of the respondents believe a BCI is only a BCI when it is used solely for the purpose of sending a message or command.
Comments from respondents reflected mainly the question if ‘feedback’ is important. For example, one respondent defines BCI as a “realtime or neartime communication channel directly from the central nervous system to a computer [and that] this communication may be ‘active’ or ‘passive’, but need not provide feedback to the user”. Another respondent was of a different opinion: “If a BCI does not provide feedback there is no ‘interface’ and the device or system is simply a monitor. One could also argue that user can receive feedback because they sense human-computer interaction alters in concordance with their state” Finally, only 1 respondent remarked that “the communication can go in the direction from the computer into the brain such as with electrical stimulation to alter the state of the brain”. If we would draw the conclusion from this that a general trend is to emphasize feedback as an essential aspect of BCI, then this is somewhat inconsistent with the results from Fig. 2 that show what applications are and are not considered to be an example of BCI. As many as 43.8% of the respondents consider a remote controlled rat as an example of BCI, yet retinal implants are not considered a BCI. Also, 24.8% of the respondents consider Deep Brain Stimulation a Brain-Computer Interface.
Thus, it is clear that “BCI” researchers differ significantly amongst themselves about the definition of Brain-Computer Interfaces. More clarity concerning the interpretation of what a BCI is (or is not) is important, especially in discussions with philosophers, policy makers, health care organizations, ethicists and the general public. However, we do not want to attempt to provide a standard definition here. Any such definition should ideally be developed through consensus amongst many established researchers, but it is more likely the definition will evolve naturally over time.
At least, we would like to stress the current variety in definitions, and the ensuing risk of misinterpretation. Groups who address ethical or other issues in BCI research should clarify their interpretations of the term “BCI” and how this might influence the specific nuances of their (ethical) position.
Expected Marketability of BCIs
BCIs for healthy users
BCIs as assistive technology, which provides compensation for loss of motor function (e.g. BCI-controlled communication program or wheelchair)
BCI-controlled prostheses, which restore motor function by replacing a paralyzed limb by a prosthesis (e.g. a BCI-controlled robotic arm or leg)
BCIs as therapy tools, which help people with psychological/neurological disorders to directly use feedback of their brain activity for training/recovery purposes (e.g. neurofeedback of sensorimotor rhythms may promote brain recovery after stroke, neurofeedback of slow cortical potentials may help improve attention).
First, 44.8% of the respondents (N = 145) expect BCIs for healthy people to become available on the market within the next 5 years, 13.8% between 6 and 10 years and 12.4% in more than 10 years. Few people (1.4%) believe it will never become available on the market and 27.6% of the respondents believe it is already on the market. The companies mentioned are Neurosky, Emotiv, InterAxon, Mattel, Brain Actuated Technologies, ZEO, OCZ, Uncle Milton, NIA, Ambien Audeo, and Hitachi. Some respondents add a critical note, for example: “if it [the products these companies are selling] is really BCI and not EMG+EEG”. Another respondent however specifies: “….what NeuroSky, Emotiv, etc. are doing is BCI. But it’s crude and not what we all dreamed of seeing (the “EEG-headset-controls-computer-in-many-dimensions” thing) when we got into this field. That’s at least 10 years off”.
Second, every respondent (N = 145) believed that BCIs as assistive technology will become available on the market. Most respondents (42.1% of N = 145) expect a BCI as assistive technology to become available on the market within the next 5 years, 33.8% between 6 and 10 years and 7.6% in more than 10 years. Almost 17% of the respondents think BCI as AT is already on the market and mention predominantly g.tec, which sells the Intendix Home BCI System, as well as software like OpenVibe and BCI2000.
Third, most respondents (43.4%, N = 145) believe BCIs as prostheses will become available on the market between 5 and 10 years. Another large group (34.5%) believes it will take more than 10 years. One respondent commented: “It was clear during the conference that if other muscles/nerves are available, no company will think to produce [BCI-controlled] prosthesis for amputated users. If here BCI-controlled prostheses is intended also for SCI users, I believe that in more than 10 years it could be available on the market”. The first probably refers to the keynote lecture from Dr. Zev Rymer at the 4th International BCI conference in Asilomar, which stated that as long as prostheses or assistive technology can be controlled with remnant muscles or nerve activity, and as long as the longevity of the neuronal recordings of the central nervous system remains limited, there will be no need, let alone a market, for BCI technology. However, an opposing view argues that BCIs can be valuable to persons with limited motor function, such as when these channels are unavailable due to fatigue [30, 37, 47].
Twenty percent of the respondents believe prostheses will be on the market within the next 5 years. Two persons (1.4%) do not think BCI-controlled prosthesis will ever reach the market and 1 person (0.7%) thinks such products are already on the market stating that: “The Parastep-1 system may have been the first, depending on how strictly you define BCI”.
Fifth, a large group of respondents (39.4%) think BCIs as therapy tools will become available on the market within the next 5 years. An equally sized group believes this will happen between 6 and 10 years. One person believes BCIs will never be on the market as therapy tools, but unfortunately did not comment on her choice. Additionally, 9.9% of the respondents say BCI technologies are already on the market as therapy tools. Some examples of companies are EEGInfo and Brainmaster. However, some persons comment that “On the market doesn’t mean it is proven to work” illustrating the scepticism of many BCI researchers towards neurofeedback therapy. Finally, one respondent commented: “Folks who do DBS are working on plenty of interesting ways to adaptively program DBS based on user and brain-signal feedback. That counts as BCI in my book” illustrating again that the definition of a BCI is critical in any discussion of ethical or other issues.
To conclude, respondents had different views on the marketability of different BCI systems. This creates some challenges for ethical discussions, because it is difficult to determine which issues are most urgent without agreement on which BCIs are most imminent.
Ethical Issues Related to BCIs as Assistive Technology
Before asking respondents to rate their agreement with statements about the informed consent process, we explained that informed consent is the process in which participants or legal representatives of participants are fully informed about the study the participant is entering and legally agree to participation.
We included six items related to informed consent, since it is an urgent practical issue in BCI research [22, 61]. We first review the statements that focus on the most vulnerable patients who are in the complete locked-in state (CLIS). CLIS patients cannot communicate in any way, whereas locked-in patients (LIS) usually have minimal residual muscle movement with which they can signal yes/no responses to questions caregivers, legal representatives or researchers might ask [27, 29]. The informed consent process with LIS patients takes effort and time, but can be straightforward. Haselager and colleagues suggested some guidelines researchers could follow when engaging with a legal representative and LIS patient in this process . However, it is unclear how the BCI researchers should act when, as has been experienced, family members of CLIS patients ask BCI laboratories for an intervention.
Overview of statements regarding the informed consent process. Columns 2 to 5 show the percentage of respondents (dis)agreeing (with the extent indicated in the column) to the different statements The last column (response count) indicates how many respondents scored the statement
I don’t know
People who cannot communicate in any way should *not* be included in BCI studies even if their legal representative agrees with their participation
Obtaining an informed consent from a locked-in patient should be video-taped
A BCI expert is the suited person to inform the locked-in patients about the BCI studies, the risks and the benefits
A medical expert is the suited person to inform the locked-in patients about the BCI studies, the risks and the benefits
If a patient has no means to communicate but the legal representative of a patient asks for a BCI intervention then an attempt should be made to provide him or her with a BCI
If a patient has no means to communicate, and the legal representative does not agree to a BCI intervention, you should still attempt to provide a BCI
Consequently, 67% of the respondents mostly or completely disagreed that one should still attempt to provide a BCI to a non-communicative patient when the legal representative does not agree. Twenty-one percent indicated not knowing the answer, but some commented again that it depended on the invasiveness of the recording. Seventeen persons (11.9%) mostly or completely agreed a BCI intervention should be attempted even if the legal representative does not agree. Three people commented on their choice. The first person asked: “what if the person has clearly expressed his/her thoughts about “extreme” treatments (before getting into a LIS)?” The second and third person only agreed to this option when the BCI procedure was non-invasive. One of the five persons who completely agreed in our survey commented (in personal communication with one of the authors) that it would be unethical not to attempt to help this people.
Thus, the BCI community seems to have a general consensus that CLIS (non-communicative) patients can be included in non-invasive BCI research when the legal representatives agree. However, the BCI community seems to generally agree that CLIS patients should not be included in invasive BCI research or when the legal representative does not agree. Although in theory legislation exists about how and when to include legally incompetent persons in scientific studies, the opinion of the researchers does influence the legal representative. The legal representative, who may be faced with a non-communicative patient, may not have the background needed to scrutinize the information given by the research team. If the research team presents the study plan too optimistically the legal representative may not realize this.
Researchers did not agree on videotaping the process of obtaining an informed consent in a case with a LIS patient. Fifty-five percent of the respondents mostly or completely agreed that the process should be video-taped, but 32% did not know.
Finally, we focused on the question of which person(s) should inform LIS patients about BCI studies, the risks and the benefits. Sixty-three percent of the respondents mostly or completely agreed that the BCI expert is appropriate, but 66% of the respondents also agreed that a medical doctor is appropriate. Twelve persons commented that these persons should work together or at least that knowledge from both or more disciplines is necessary. The presence of a medical doctor in the informed consent process is even more desired by some respondents when invasive BCI methods are used. One person expressed concern that BCI researchers may be biased, another that computer scientists are not necessarily equipped or sufficiently experienced to have such conversations. Finally, one person may have expressed the general concern well: “I do not believe that a single party can, in all situations, adequately inform the patient about all issues concerning a BCI study. In such cases, I believe it would be more appropriate for experts with complementary areas of expertise .... to inform the patient. This raises the issue of whether multiple perspectives are consistent. It is not clear to me how this can be resolved systematically”.
We could cautiously conclude that the BCI community acknowledges the role of the BCI expert and the medical doctor in the process of obtaining informed consent, but that a broader debate is needed on this topic. Haselager et al. (2009) point out that, in relation to team responsibility and patient communication, much can be learned from interdisciplinary teams such as intensive care units (ICU), teams concerned with patients who have severe mental disorders , or chronic or progressively ill patients facing end-of-life care decisions. Thus, we suggest that we could learn from similar cases in the medical system (e.g. in relation to surgery with very elderly people). The BCI community might benefit from a state-of-the-art overview of medical decision making procedures. We suggest that, at future BCI workshops and conferences, the organizers could invite experts on medical decision making to inform the audience and contribute to the debate. Another practical recommendation could be to assess perspectives on BCI, risks and benefit in different disciplines and establish (and evaluate) an overall consistent position. Without consistency we might have to conclude that obtaining informed consent will always be a custom-tailored process to each individual, but (some) consistency could facilitate tentative guidelines avoiding unacceptably large ‘local variations’ (see for further recommendation the section on “team responsibility”).
Benefits and Risks
Overview of statements regarding the risks and benefits. Columns 2 to 5 show the percentage of respondents (dis)agreeing (with the extent indicated in the column) to the different statements The last column (response count) indicates how many respondents scored the statement
I don’t know
The current benefits outweigh the current risks of non-invasive BCI for locked-in patients
The risks of non-invasive BCIs are still largely unknown
The current benefits outweigh the currently risks of invasive BCI for locked-in patients
The risks of invasive BCIs are still largely unknown
Most BCI researchers (87.5%) indicated that they mostly or completely agreed that the current benefits outweigh the current risks of non-invasive BCI for locked-in patients. A somewhat smaller majority (70.7%) indicated that they mostly or completely disagree that the risks of non-invasive BCI are largely unknown.
BCI researchers had different views about the risk-benefit analysis concerning invasive BCIs. Thirty-three percent of the respondents did not know whether the current benefits of invasive BCI outweighs the current risks. This outcome corresponds with the result that more than half of the respondents mostly or completely agreed that the risks of invasive BCIs are argely unknown. One respondent commented: “Invasive BCIs are certainly useful. Risks are likely low, but this is still not proven at this point”. Another respondent has a different opinion: “I think the risks of invasive BCI are fairly well-known, actually. Just not sure the current benefits are enough. As soon as someone comes out with a good ECoG-based BCI system I would say the benefits outweigh the risks, and I wouldn’t think twice about signing up for an implant myself if I was locked-in”. Another two respondents pointed out that the risk-benefit analysis should be done on a patient-by-patient basis and cannot be generalized to all patients.
Thus, although there seems to be more agreement on the risk-benefit analysis of non-invasive BCIs compared to invasive BCIs, respondents do agree that empirical data is needed and risk-benefits analysis can only be done individually.
Like in every other medical intervention it is essential to distinguish between effectiveness of the intervention and the patient’s benefit. While physicians and researchers can judge whether a BCI is effective, pure effectiveness dose not entail a normative justification. Normatively relevant is the benefit for the patient. While effectiveness is usually a necessary prerequisite, it also depends on patient’s individual preferences [10, 60]. We recommend monitoring each patient’s benefits through open, in-depth interviews following BCI use.
Overview of statements regarding team responsibility. Columns 2 to 5 show the percentage of respondents (dis)agreeing (with the extent indicated in the column) to the different statements The last column (response count) indicates how many respondents scored the statement
I don’t know
All BCI teams should have 1 common code with rules & regulations for team responsibility issues
It is okay when a patient hears about the difference op opinion of various team members considering the risks and the benefits of a BCI
BCI teams should stick to one risk/benefit analysis and tell this to the patient
Columns 2 to 5 show the percentage of respondents (dis)agreeing (with the extent indicated in the column) to the different statements The last column (response count) indicates how many respondents scored the statement
I don’t know
A BCI as assistive technology will be a reason for a patient to change his or her end-of-life decisions
BCI as assistive technology will add an extra burden to the family of the patient
BCI as assistive technology will aid the family of the patient
Columns 2 to 5 show the percentage of respondents (dis)agreeing (with the extent indicated in the column) to the different statements. The last column (response count) indicates how many respondents scored the statement
I don’t know
BCI users are responsible for the actions they execute and the messages they transmit with the device
BCIs as assistive technology could lead to behaviors uncharacteristic of the user’s personal identity
BCIs as assistive technology will not change a person’s identity
Columns 2 to 5 show the percentage of respondents (dis)agreeing (with the extent indicated in the column) to the different statements The last column (response count) indicates how many respondents scored the statement
I don’t know
It is the responsibility of scientists to check whether their separation from the facts and fiction is adequately represented by journalists
BCI scientists should moderate their enthusiasm when speaking to the media
Each BCI scientist should restrict him/herself to discussing current and near-future applications of BCI instead of speculating about long-term applications
BCI scientists should actively speak out against inaccurate statements in the media, regardless of the source
To conclude, BCI researchers seem to disagree about whether and how BCI teams should operate and give information as a unit. BCI teams could learn from other interdisciplinary groups working in similarly demanding situations such as intensive care units . Haselager and colleagues recommend several strategies to improve team functioning, many of which are reasonably obvious (e.g. regular team meetings, ensuring good lines of communication), but two recommendations are worth mentioning in relation to acquiring informed consent . First, ensure that appropriate members of the team are asked whether they should be present at a decision making meetings with patient and family. Second, have a ‘preconference’ of team members to develop team consensus and facilitate discussion of issues or conflicts that may occur within a team .
Consequences of BCI on Patients’ and Familes’ Lives
Most BCI researchers who aim to develop Brain-Computer Interfaces assume that AT will increase quality of life for persons with disabilities and their families. Increased quality of life, or assurance that communication will remain intact, could very well change end-of-life decisions among persons with neurodegenerative diseases. One article proposed that AT, especially AT that requires a difficult and time-consuming set-up such as current BCI technology, could add to the burden of the family or caregivers and not aid them .
Sixty-four percent of the respondents thought that BCI as AT will be a reason for a patient to change his or her end-of-life decisions, but almost 30% did not know whether this was true (See Table 6). Additional concern was expressed by one respondent: “Ultimately, I think that BCI technology will change end-of-life plans for some people. However, it is very important that users do not change their end-of-life plans based on false hopes of obtaining technology that does not yet exist or is not yet widely available”.
Forty-seven percent of the respondents mostly or completely disagreed that BCI will add an extra burden to the family of the patient. Those who did believe that BCI could, to some extent, add extra burden to the family said for example: “…while a potentially extended lifetime might add to burden, family members’ perception might be of decreased burden or intangible gain. This will vary on a case-by-case basis and will be largely subjective for both patient and family member”. More than 80% of the respondents did feel that BCI could also aid families. The common conclusion might be that BCIs may bring extra burden but also extra aid. One respondent said: “it definitely adds a burden, but it also lightens a load”.
However, ultimately these issues demand empirical investigation. As one respondent stated: “These are empirical matters, which can only be evaluated by interrogating the relevant individuals and tracking such things as their continued financial solvency or the quality of filial relations over time”. Additionally, again the BCI community might benefit from an investigation of how the medical practice or companies study the effects of new treatments and therapies.
Liability and Personal Identity
The use of BCI may affect psychological aspects of a person, including his or her self-perception, types of behavior characteristic of a person, the capacity to remember, understand and decide upon information etc., possibly leading to questions about the psychological continuity or even personal identity of the person [2, 53, 54, 63]. Since these capacities are relevant to the process of informed consent (e.g. affecting someone’s evaluation of a decision to continue or stop the use of a BCI) this is not ‘just’ an ethical issue but may also have legal implications (see  for a discussion of this topic in relation to Deep Brain Stimulation).
Also, BCI use could lead to accidents. For example, who is liable if a BCI mistakenly interprets a wheelchair or prosthesis command and causes a user to hit someone or damage something or cross a street against a red light [8, 61, 63]?
Sixty-five percent of the respondents mostly or completely agree that BCI users are responsible for the actions they execute and the messages they transmit with this device (See Table 7), although many respondents (21.5%) don’t know and commented that it would depend on many factors such as 1) the accuracy with which the BCI can decode the user’s intentions, 2) the knowledge of the user about the unreliability of the system, 3) state of functionality at the time of an accident or ‘adverse’ event, 4) the competence of the user, and 5) the psychological health or state of the user at the time of the accident or ‘adverse’ event. Respondents are also unsure (37.1%) whether BCIs as assistive technology would lead to behaviors uncharacteristic of the user’s identity and comment that even if it would change personal identity, this might not be necessarily negative. For example, neurofeedback has been hypothesized to reduce the symptoms of autism and anti-personality disorder [49, 59] and may change a person’s identity in fundamental but desirable ways.
Also, few comments demonstrate that some BCI researchers are worried that ethical guidelines will superimpose a particular moral perspective on patients: “perhaps a BCI user’s “identity” would change once they had used the system for a while. But it would be beyond arrogant to tell them ‘I think this might change your identity, so I am not allowing you to use this technology’”. In addition to this very basic ethical question, the possibility of BCI induced changes in cognitive capacities, psychological continuity or personal identity needs to be considered to assess issues concerning informed consent and/or personal liability.
Finally, respondents again commented that these issues should be investigated empirically, with the explicit consideration of the many factors influencing BCI use and likely outcomes. We agree and thus recommend that future clinical trials involving BCI systems investigate personality changes over time.
Interaction with the Media
BCI research, whether non-invasive or invasive, receives a great deal of media attention (e.g. [1, 11, 21, 46, 65]). The media in turn is read by policy makers and stakeholders and may influence their opinions and expectancies, which, in turn, might affect the availability of funding for BCI research. Here we asked BCI researchers how BCI researchers should disseminate results to the media.
Over 80% of the respondents agreed that BCI scientists have a responsibility to check whether journalists accurately separate factual from fictitious statements (See Table 8). However, as one respondent commented: “We can try our best to get correct info out there and ask to review anything a reporter writes before it goes to press, but sometimes it is simply out of our control”. A similar majority agreed that BCI scientists should actively speak out against inaccurate media statements and should moderate enthusiasm when speaking to the media. Respondents did not agree on whether BCI scientists should restrict themselves to discussing only current or near-future applications of BCI. One respondent commented: “Scientists have the duty to tell facts. But that doesn’t mean they cannot be enthusiastic about their field and have a vision”.
Thus, there seems to be a consensus among BCI scientists to moderate enthusiasm when speaking to the media and to actively check and correct representations in the media whenever needed and/or possible. However, BCI scientists disagree on whether they should restrict themselves in speaking about what is currently possible, or may speak about their expectations for future BCIs. Schermer points out that future brain-machine interaction technologies may entail political and ideological functions, since they help to secure research funds and to create a certain image of these developments, thus steering the public opinion . We do recommend that scientists realistically portray their findings to the media and to academic journals. BCI developers should also thoroughly and accurately report methods in scientific papers, such as stating whether they include time between selections of targets in the calculation of the communication rate [4, 35, 62]. Another good practice for industrial BCI developers would be to realistically describe how much of the product relies on brain signal and how much on muscle signals.
Urgent Matters in the BCI Community
First, 79% of the respondents (N = 143) indicated a standard BCI definition should be clarified within 5 years. However, those who disagreed often had strong opinions, with one respondent commenting: “I don’t see a real reason to have a stand alone definition.... for BCI. Science these days is very interdisciplinary and trying to define borders is somewhat artificial (and not necessarily beneficial)”. Another respondent commented: “not to be incendiary, but who cares, really?” Another example is: “it seems kind of ridiculous to argue over what is and isn’t a BCI. It is more important to argue about what methods, technology, therapies, interventions etc. are useful and which ones aren’t. A product should be measured on how much it can help a person rather than whether or not it meets some technical definition of a BCI”. Finally, one person said: “I am categorically against categorization. We can certainly waste our breath classifying things as BCI or not BCI, but please let’s not try to build towers of logic that build upon that distinction as one of its foundations. That’s what philosophers do—philosophy is a fine leisure pastime, but it hinders us more than it helps us in solving concrete practical problems”.
Although we authors do not all agree on whether a standard definition is necessary for most stakeholders, we do all agree, as indicated before, that having great variance in the definition of a BCI can be detrimental to the clarity of the ethical debate. Policy makers and the general public will need a clarification of how differences in interpretation bear upon the ethical discussion. Second, 86% of the respondent would like to see ethical guidelines specific to BCI research and BCI use within 5 years. More than half of the respondents (57%) would like to see these guidelines within only 2 years. One respondent cautiously added: “Ethical guidelines for BCI research and use might be useful, but could be detrimental if the guidelines are not comprehensive and thorough”. Also Nordmann and Rip pointed out that the field of neural engineering, which is still in its infancy, should avoid the trap of “speculative ethics” . The neuroethical debate should be grounded on thorough knowledge about the technologies under discussion.
Yet, some people do not consider ethical guidelines necessary, since they already exist: “At least the US has well-vetted certification processes for conducting human subjects research. This is a non-issue.... The global rules applied to all human research (including research with locked in patients). Nothing special is needed for BCIs”.
Third, we asked respondents if and when a certification process should be set up to determine if a BCI scientist is qualified to work with patients. Sixty-five percent of the respondents think such a certification process should be set up within the next 5 years. This result may reflect the respondents’ doubt about which kind of person(s) would be appropriate to communicate with the patient and who should be responsible for that (see section “Informed Consent”).
Fourth, we asked respondents if and when a certification process should be set up to determine if a product should be dubbed a BCI. More than half of the respondents wanted such a certification process within the next 5 years, but several persons also indicated they either did not know what we meant with a certification process. Additionally persons feel that “BCI researchers don’t need their own special certification. The field is too diverse for that to work anyway’.
Fifth, 29.7% of the respondents would like to have a regular journal devoted solely to BCI research within the next 2 years and 34.1% within the next 5 years. However, another large group (26.1%) do not consider a specific journal as an urgent matter. One respondent commented: “I think the journal is unnecessary — if it’s good work, it will get into bigger, higher volume journals like Nature or Science or Neuroscience, which helps the field as a whole”.
Thus, respondents selected terminological and ethical issues as the most urgent matters from the list we presented to them. Certification procedures for BCI technology and a journal were regarded as less urgent.
Some Thoughts on the Survey
Here we will discuss how our survey was received by the respondents based on the statistics of their responses and some follow up questions asked at the end of the survey.
First, half of the attendees of the conferences took the time to complete the survey. Several respondents commented at the conference site that they appreciated this study. Some also said the survey itself triggered their awareness about ethical issues in their daily work. Moreover, 103 respondents gave their email address in an optional field of the survey so we could forward any dissemination on these results and 42 skipped this question. Thus, a clear interest among BCI researchers in the issues raised is visible.
Finally, we asked respondents to add any questions they felt we should have included in the survey. These comments help identify the completeness of our survey, and could help improve future efforts. Twenty-eight persons decided to add more questions. 117 skipped this question. We interpret this as a sign we covered relevant issues well. We will discuss some questions respondents suggested us to add. First, one respondent said: “I can’t help but notice that no questions were raised about the moral status of using nonhuman animals in testing various BCIs”. Indeed, the current survey only assessed opinions about ethical issues related to BCIs which are used as AT for humans with disabilities. An ethical debate on all BCI research would also include debates on BCIs which are used to control prostheses (which typically involves research with invasive recording with animals). In addition, as one respondent commented, also no attention was given to “ethical issues for non-patients”. BCI-controlled games are already commercially available and BCI researchers are increasingly applying BCI technologies in gaming or human-computer interaction (HCI) [43, 44, 72]. Ethical, societal and legal issues related to BCI for gaming or HCI may differ greatly from the issues related to BCIs for medical purposes. For example, if BCIs were used to track fatigue levels of air traffic controllers, then issues like workers’ rights and privacy of mind may be more imminent topics.
Finally, one respondent (critically?) noted: “When does a questionnaire need to be given to the scientific community?” Two considerations follow from this. First, should such a questionnaire be given to the scientific community at all? And second, how often should you survey opinions? After all, BCI is a relatively new field, and the ethical debate about its applications and implications is still in its infancy. Therefore BCI researchers may not yet have fully developed well-informed opinions about ethical issues. Likewise, ethicists may not yet have thorough knowledge about neurotechnologies and have therefore difficulties to understand what is and what is not possible. Also, in such a rapidly developing field opinions might well change which leads to the question whether surveys should be repeated and if yes, after how much time.
Despite these reservations, we think this survey was timely, if not a little early, to initiate bridging the gap between the different perspectives existing between neuroengineers (here the BCI community), and also between them and the neuroethicists. Moreover, reflecting on the questions, and the answers they raised, may assist in structuring the growing public debate on BCI. As a caveat, the sample of respondents do not adequately represent all of the researchers working on BCI technologies. For example, no African, South-American or Australian BCI groups were present at the Asilomar conference, although these groups are also much less prominent in the BCI literature. Also, only twelve respondents in our sample began BCI research before 2000, which implies that other well-established and experienced BCI researchers did not complete the survey. Although, as mentioned before, the field of BCI consists of many young researchers, it remains desirable to repeat a questionnaire of this kind in the near future with different stakeholders.
In addition to our suggestions for conduction new surveys with various improvements, we recommend other future directions. Additional collaborative efforts such as workshops, special sessions, web-based meetings and joint publications (of neuroengineers and ethicists) could introduce and encourage a wider view of different issues. These efforts could work toward ethical guidelines or recommendations with broader distribution and more credibility. Legal issues such as liability, privacy and personal identity should also be explored through appropriate eclectic collaboration.
In the introduction, we listed as many as 17 ethical issues that have been identified in the literature. It is not surprising that neurotechnologies like Brain-Computer Interfacing raise so many questions. BCIs, like technologies such as DBS or vagal nerve stimulation, confront humanity with issues of existential nature. Who are we? Are we only our brain, and can our brain and personality really be so easily modulated with technologies? Do we want technologies to be inside of our bodies and brains?
On the 10th of November 2010 a Science and Technology Options Assessment (STOA) conference entitled “making perfect life — bioengineering in the 21st century” was held in the European Parliament. After listening to all the issues that arise with the current merge between information technology, nanotechnology, neuroscience and biology, member of parliament Vitorrio Prodi remarked: “We are living in an era of change where we really need to think ahead in order to protect human dignity.” Indeed, while neuroengineering leaps ahead, neuroethical considerations should not lag behind. We strongly support a thorough and continuing ethical debate on neurotechnologies that involves contributors from neuroengineering, neuroscience, neuroethics, philosophy, politics, journalism and the general public. Resources should be made available for this ethical debate. Van Keulen and Schuijff comment: “it is remarkable that, unlike with emerging technologies like synthetic biology and nanotechnology, the EU is not yet funding any large ethical, legal and/or sociological project in neurosciences, or in neural engineering for that matter” (p. 123;). We recognize that there are many issues that need further exploration even after this survey, but hope our paper encourages such further discussion.
Nijboer and Broermann, the latter author being a locked-in patient, responded to Philips’ question with another question: “When you can communicate with a locked-in patient, why should you not do it?” .
Passive BCI may be applied to enhance human-computer interaction. For example, when a user with disabilities is working with assistive technology, but the passive BCI detects sleep spindles in the brain pattern of the user, the system could switch to standby mode or dim the lights.
Offline BCI systems measure brain activity, but relevant features are, unlike with online BCIs, not extracted and “translated” to commands in real time. Rather, relevant features in the signals are only extracted and classified after the experiment.
The authors gratefully acknowledge the support of the BrainGain Smart Mix Program of the Ministry of Economic Affairs and the Ministry of Education, Culture and Science of the Netherlands, the Netherlands. This work was also supported by the Information and Communication Technologies Coordination and Support action “FutureBNCI”, Project number ICT- 2010-248320. We would like to thank the staff of Fatronik-Tecnalia and the BrainGain members, in particular Rutger Vlek, at the Radboud University (Nijmegen), many of whom not only took the time to answer all questions, but in addition gave many useful comments. Most strongly, of course, we thank all respondents who took the time to complete the survey in Asilomar. We appreciate that you gave your time and effort even though several social events were taking place in non-conference time. Also many thanks to the organizers of the 4th international BCI conference, Theresa Vaughan, Mary-Jane Schneider and Jonathan Wolpaw, for allowing us to recruit respondents at the conference and to the anonymous reviewer for helpful comments.
This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
- 1.Alleyne, R. 2010. Mind-reading machine’ can convert thoughts into speech. The Telegraph. http://www.telegraph.co.uk/science/science-news/7987821/Mind-reading-machine-can-convert-thoughts-into-speech.html. Accessed 8 September 2010.
- 3.Allison, B.Z. 2011. The fringes of neurotechnology. In Fringe science, ed. K. Grazier, L. Wilson, and H. Butterfield. Houston: BenBella Press.Google Scholar
- 4.Allison, Brendan Z. 2010. Toward Ubiquitous BCIs. In Brain-computer interfaces, ed. Bernhard Graimann, Gert Pfurtscheller, and Brendan Allison, 357–387. Berlin, Heidelberg: Springer-Verlag Heidelberg.Google Scholar
- 11.Computers that read your mind. 2006. The economist. http://www.economist.com/node/7904258. Accessed 21 September 2006.
- 21.Ghosh, P. 2010. Dream recording device ‘possible’ researcher claims. BBC News Science & Environment. http://www.bbc.co.uk/news/science-environment-11635625. Accessed 27 October 2010.
- 24.Klaming, Laura, and Pim Haselager. 2010. Did My Brain Implant Make Me Do It? Questions Raised by DBS Regarding Psychological Continuity, Responsibility for Action and Mental Competence. Neuroethics 1–13. doi:10.1007/s12152-010-9093-1.
- 26.Kübler, A., S. Winter, and N. Birbaumer. 2003. The Thought Translation Device: Slow cortical potential biofeedback for verbal communication in paralysed patients. In Biofeedback - a practitioner’s guide, ed. M.S. Schwartz and F. Andrasik, 471–481. New York: Guilford Press.Google Scholar
- 32.Lulé, D., S. Hacker, A. Ludolph, N. Birbaumer, and A. Kubler. 2008. Depression and quality of life in patients with amyotrophic lateral sclerosis. Deutsches Arzteblatt international 105(23): 397–403.Google Scholar
- 36.Matuz, T. 2008. Betreuungsstrategien für schwerstgelähmte Patienten: empirische Ethik und neurowissenschaftliche Ansätze Eberhard-Karls-Universität Tübingen, Tübingen.Google Scholar
- 37.Millan, J.D., R. Rupp, G.R. Muller-Putz, R. Murray-Smith, C. Giugliemma, M. Tangermann, C. Vidaurre, et al. 2010. Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges. Frontiers in Neuroscience 4. doi:10.3389/fnins.2010.00161.
- 40.Nijboer, F., J. Clausen, B. Z. Allison, and P. Haselager. in press. Researchers’ opinions about ethically sound dissemination of BCI research to the public media. International Journal of Bioelectromagnetism.Google Scholar
- 41.Nijboer, Femke, Niels Birbaumer, and Andrea Kübler. 2010. The influence of psychological state and motivation on brain-computer interface performance in patients with amyotrophic lateral sclerosis - a longitudinal study. Frontiers in Neuroprosthetics 4. doi:10.3389.fnins.2010.00055.
- 42.Nijboer, Femke, and Ursula Broermann. 2010. Brain– computer interfaces for communication and control in locked-in patients. In Brain-Computer Interfaces, ed. Bernhard Graimann, Gert Pfurtscheller, and Brendan Allison, 185–201. Berlin, Heidelberg: Springer-Verlag Heidelberg.Google Scholar
- 46.New York Times. 2010. Communicating with a patient in a vegetative state. February 4.Google Scholar
- 51.Racine, E., S. Waldman, J. Rosenberg, and J. Illes. 2010. Contemporary neuroscience in the media. Social Science & Medicine. doi:10.1016/j.socscimed.2010.05.017.
- 55.Sellers, E.W., T.M. Vaughan, and J.R. Wolpaw. 2010. A brain-computer interface for long-term independent home use. Amyotrophic Lateral Sclerosis. doi:10.3109/17482961003777470.
- 57.Silvoni, S., C. Volpato, M. Cavinato, M. Marchetti, K. Priftis, A. Merico, P. Tonin, K. Koutsikos, F. Beverina, and F. Piccione. 2009. P300-based brain-computer interface communication: evaluation and follow-up in amyotrophic lateral sclerosis. Frontiers in Neuroscience 3: 60. doi:10.3389/neuro.20.001.2009.Google Scholar
- 62.Townsend, G., B.K. LaPallo, C.B. Boulay, D.J. Krusienski, G.E. Frye, C.K. Hauser, N.E. Schwartz, T.M. Vaughan, J.R. Wolpaw, and E.W. Sellers. 2010. A novel P300-based brain-computer interface stimulus presentation paradigm: moving beyond rows and columns. Clinical Neurophysiology 121(7): 1109–1120. doi:10.1016/j.clinph.2010.01.030.CrossRefGoogle Scholar
- 63.van Est, R., D. Stemerding, I. van Keulen, I. Geesink, and M. Schuijff. 2010. Making perfect life - bioengineering (in) the 21st century, Interim Study Monitoring report - Phase II, ed. Legislative coordinations and conciliations: ETAG.Google Scholar
- 65.Walsh, F. 2010. Vegetative state patients can respond to questions BBC News Health. http://news.bbc.co.uk/2/hi/8497148.stm. Accessed 3 February 2010.
- 67.Walter, W.G. 1964. The contingent negative variation: an electrocortical sign of significant association in the human brain. Science 146: 434.Google Scholar
- 72.Zander, Thorsten O., Christian Kothe, Sabine Jatzev, and Matti Gaertner. 2010. Enhancing human-computer interaction with input from active and passive brain-computer interfaces. In Brain-Computer Interfaces, ed. D.S. Tan and A. Nijholt, 181–199. Human-Computer Interaction Series: Springer London.CrossRefGoogle Scholar