Abstract
The Thought Translation Device (TTD) is a brain-computer interface based on the self-regulation of slow cortical potentials (SCPs) and enables completely paralyzed patients to communicate using their brain potentials. Here, an extended version of the TTD is presented that has an auditory and a combined visual and auditory feedback modality added to the standard visual feedback. This feature is necessary for locked-in patients who are no longer able to focus their gaze. In order to test performance of physiological regulation with auditory feedback 54 healthy participants were randomly assigned to visual, auditory or combined visual-auditory feedback of slow cortical potentials. The training consisted of three sessions with 500 trials per session with random assignment of required cortical positivity or negativity in half of the trials. The data show that physiological regulation of SCPs can be learned with auditory and combined auditory and visual feedback although the performance of auditory feedback alone was significantly worse than with visual feedback alone.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Birbaumer N, Elbert T, Canavan AGM, Rockstroh B (1990) Slow potentials of the cerebral cortex and behaviour. Physiol Rev 70:1–41
Birbaumer N, Flor H, Ghanayim N, Hinterberger T, Iverson I, Taub E, Kotchoubey B, Kübler A, Perelmouter J (1999) A brain-controlled spelling device for the completely paralyzed. Nature 398:297–298
Birbaumer N, Kübler A, Ghanayim N, Hinterberger T, Perelmouter J, Kaiser J, Iversen I, Kotchoubey B, Neumann N, Flor H (2000a) The thought translation device (TTD) for completely paralyzed patients. IEEE Trans Rehabil Eng 8:190–193
Birbaumer N, Kübler A, Hinterberger T (2000b) Ein Hirn-Computer-Interface zur Kommunikation nach vollständigem oder teilweisem Ausfall der Motorik (“thought-translation-device” TTD). Management of neuromuscular diseases. Sonderheft September 2000, 2–3
Brener JM (1982) Psychobiological mechanisms in biofeedback. In: White L, Tursky B (eds) Clinical biofeedback: efficacy and mechanisms. Guilford, New York, pp 24–47
Hinterberger T (1999) Entwicklung und Optimierung eines Gehirn-Computer-Interfaces mit langsamen Hirnpotentialen. Dissertation in der Fakultät für Physik an der Eberhard-Karls-Universität Tübingen, Schwäbische Verlagsgesellschaft
Hinterberger T, Kotchoubey B, Kaiser J, Kübler A, Neumann N, Perelmouter J, Strehl U, Birbaumer N (2000) Anwendungen der Selbstkontrolle langsamer kortikaler Potentiale. Verhaltenstherapie 10:219–227
Hinterberger T, Kübler A, Kaiser J, Neumann N, Birbaumer N (2003a) A brain-computer-interface (BCI) for the locked-in: comparison of different EEG classifications for the Thought Translation Device (TTD). Clin Neurophysiol 114:416–425
Hinterberger T, Mellinger J, Birbaumer N (2003b) The Thought Translation Device: structure of a multimodal brain-computer communication system. Proceedings of the 1st International IEEE EMBS Conference on Neural Engineering, 2003, pp 603–606
Hinterberger T, Veit R, Strehl U, Erb M, Kotchoubey B, Flor H, Birbaumer N (in press) The relationship between BOLD-signal of fMRI with slow cortical potentials. Exp Brain Res
Kaiser J, Perelmouter J, Iversen I, Neumann N, Ghanayim N, Hinterberger T, Kübler A, Kotchoubey B, Birbaumer N (2001) Self-initiation of EEG-based communication in paralyzed patients. Clin Neurophysiol 112:551–554
Kaiser J, Kübler A, Hinterberger T, Neumann N, Birbaumer N (2002) A non-invasive communication device for the paralyzed: a case report. Minimal Inv Neurosurg 45:19–23
Kotchoubey B, Schleichert H, Lutzenberger W, Birbaumer N (1997) A new method for self-regulation of slow cortical potentials in a timed paradigm. Appl Psychophysiol Biofeedback 22:77–93
Kotchoubey B, Strehl U, Holzapfel S, Blankenhorn V, Fröscher W, Birbaumer N (1999) Negative potential shifts in the prediction of the outcome of neurofeedback therapy in epilepsy. Clin Neurophysiol 110:683–686
Kübler A, Kotchoubey B, Ghanayim N, Hinterberger T, Perelmouter J, Schauer M, Fritsch C, Birbaumer N (1998) A thought translation device for brain computer communication. Studia Psychol 40:17–31
Kübler A, Kotchoubey B, Hinterberger T, Ghanayim N, Perelmouter J, Schauer M, Fritsch C, Taub E, Birbaumer N (1999) The thought-translation-device: a neurophysiological approach to communication in total motor paralysis. Exp Brain Res 124:223–232
Kübler A, Neumann N, Kaiser J, Kotchoubey B, Hinterberger T, Birbaumer N (2001a) Brain-computer communication: self-regulation of slow cortical potentials for verbal communication. Arch Phys Med Rehabil 82:1533–1539
Kübler A, Kotchoubey B, Kaiser J, Wolpaw JR, Birbaumer N (2001b) Brain-computer communication: unlocking the locked-in. Psychol Bull 127:358–375
Lal SKL, Henderson RJ, Carter N, Bath A, Hart MG, Langeluddecke P, Hunyor SN (1998) Effect of feedback signal and psychological characteristics on blood pressure self-manipulation capability. Psychophysiology 35:405–412
Llinas RR (2001) I of the vortex: from neurons to self. MIT Press, Cambridge, MA
Mishkin M, Malamut B, Bachevalier J (1984) Memories and habits’ two neural systems. In: Squire L, Batters N (eds) Neurobiology of human learning and memory. Guilford, New York, pp 65–77
Neumann N, Birbaumer N (in press) Predictors of successful self-control during brain-computer communication. J Neurol Neurosurg Psychiatry
Neumann N, Kübler A, Kaiser J, Hinterberger N, Birbaumer N (2003) Conscious perception of brain states: mental strategies for brain-computer communication. Neuropsychologia 41:1028–1036
Neuper C, Müller GR, Kübler A, Birbaumer N, Pfurtscheller G (2003) Clinical application of an EEG-based brain-computer interface: a case study in a patient with severe motor impairment. Clin Neurophysiol 114:399–409
Newell A, Rosenbloom PS (1981) Mechanisms of skill acquisition and the law of practice. In: Anderson JR (ed) Cognitive skills and their acquisition. Erlbaum, Hillsdale, NJ, pp 1–55
Nicolelis MAL (2001) Actions from thoughts. Nature 409:403–407
Perelmouter J, Kotchoubey B, Kübler A, Birbaumer N (1999) Language support program for thought-translation devices. Automedica 18:67–84
Rockstroh B, Elbert T, Canavan A, Lutzenberger W, Birbaumer N (1989) Slow cortical potentials and behavior. Urban & Schwarzenberg, Baltimore
Rolls ET (1999) The brain and emotion. Oxford University Press, Oxford
Teitelbaum P, Schallert T, Whishaw IQ (1983) Sources of spontaneity in “motivated” behavior. In: Satinoff E, Teitelbaum P (eds) Handbook of behavioral neurobiology, vol 6. Plenum, New York, pp 23–65
Wenger MA, Cullen TD (1972) Studies of autonomic balance in children and adults. In: Greenfield N, Sternbach RA (eds) Handbook of psychophysiology. Holt, Rinehart and Winston, New York
Author information
Authors and Affiliations
Corresponding author
Additional information
This study was supported by the Deutsche Forschungsgemeinschaft (DFG) SFB 550/B5, and the National Institute of Health (NIH)
Rights and permissions
About this article
Cite this article
Hinterberger, T., Neumann, N., Pham, M. et al. A multimodal brain-based feedback and communication system. Exp Brain Res 154, 521–526 (2004). https://doi.org/10.1007/s00221-003-1690-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00221-003-1690-3