Abstract
Many people have neuromuscular conditions or disorders that impair the neural pathways that control muscles. Those most severely affected lose all voluntary muscle control and hence lose the ability to communicate. Brain-computer interfaces (BCIs) might be able to restore some communication or control functions for these people by creating a new communication channel – directly from the brain to an output device. Many studies over the past two decades have shown that such BCI communication is possible and that it can serve useful functions. This paper reviews the different sensor methodologies that have been explored in these studies.
Chapter PDF
Similar content being viewed by others
References
Wolpaw, J.R., Birbaumer, N., McFarland, D.J., Pfurtscheller, G., Vaughan, T.M.: Brain-computer interfaces for communication and control. Clin. Neurophysiol. 113, 767–791 (2002)
Allison, B.Z., Wolpaw, E.W., Wolpaw, J.R.: Brain-computer interface systems: progress and prospects. Expert Rev. Med. Devices 4, 463–474 (2007)
Kumar, M., Paepcke, A., Winograd, T.: EyePoint: practical pointing and selection using gaze and keyboard. In: Proceedings of the SIGCHI conference on Human factors in computing systems. San Jose, CA, pp. 421–430 (2007)
Damper, R.I., Burnett, J.W., Gray, P.W., Straus, L.P., Symes, R.A.: Hand-Held Text-to-Speech Device for the Non-Vocal Disabled. J. Biomed. Eng. 9, 332–340 (1987)
Fels, S.S., Hinton, G.E.: Glove-TalkII-a neural-network interface which maps gestures to parallel formant speech synthesizer controls. IEEE Trans. Neural Netw. 9, 205–212 (1998)
Fels, S.S.: Using normalized RBF networks to map hand gestures to speech. In: Radial basis function networks 2: new advances in design, pp. 59–101. Physica-Verlag GmbH, Heidelberg (2001)
Kubota, M., Sakakihara, Y., Uchiyama, Y., Nara, A., Nagata, T., Nitta, H., Ishimoto, K., Oka, A., Horio, K., Yanagisawa, M.: New Ocular Movement Detector System As a Communication Tool in Ventilator-Assisted Werdnig-Hoffmann Disease. Dev. Med. Child Neurol. 42, 61–64 (2000)
Chen, Y.L., Tang, F.T., Chang, W.H., Wong, M.K., Shih, Y.Y., Kuo, T.S.: The New Design of an Infrared-Controlled Human-Computer Interface for the Disabled. IEEE Trans. Rehabil. Eng. 7, 474–481 (1999)
LaCourse, J.R., Hludik, F.C.: An Eye Movement Communication-Control System for the Disabled. IEEE Trans. Biomed. Eng. 37, 1215–1220 (1990)
Peckham, P.H., Keith, M.W., Kilgore, K.L., Grill, J.H., Wuolle, K.S., Thrope, G.B., Gorman, P., Hobby, J., Mulcahey, M.J., Carroll, S., Hentz, V.R., Wiegner, A.: Efficacy of an implanted neuroprosthesis for restoring hand grasp in tetraplegia: a multicenter study. Arch. Phys. Med. Rehabil. 82, 1380–1388 (2001)
Hoffer, J.A., Stein, R.B., Haugland, M.K., Sinkjaer, T., Durfee, W.K., Schwartz, A.B., Loeb, G.E., Kantor, C.: Neural Signals for Command Control and Feedback in Functional Neuromuscular Stimulation: a Review. J. Rehabil. Res. Dev. 33, 145–157 (1996)
Ferguson, K.A., Polando, G., Kobetic, R., Triolo, R.J., Marsolais, E.B.: Walking With a Hybrid Orthosis System. Spinal. Cord. 37, 800–804 (1999)
Kilgore, K.L., Peckham, P.H., Keith, M.W., Thrope, G.B., Wuolle, K.S., Bryden, A.M., Hart, R.L.: An Implanted Upper-Extremity Neuroprothesis: Follow-Up of Five Patients. J. Bone Joint Surg. 79-A, 533–541 (1997)
Wolpaw, J.R., Loeb, G.E., Allison, B.Z., Donchin, E., do Nascimento, O.F., Heetderks, W.J., Nijboer, F., Shain, W.G., Turner, J.N.: BCI Meeting 2005–workshop on signals and recording methods. IEEE Trans. Neural Syst. Rehabil. Eng. 14, 138–141 (2006)
Wolpaw, J.R., Birbaumer, N.: Brain-computer interfaces for communication and control. In: Selzer, M.E., Clarke, S., Cohen, L.G., Duncan, P., Gage, F.H. (eds.) Textbook of Neural Repair and Rehabilitation; Neural Repair and Plasticity, pp. 602–614. Cambridge University Press, Cambridge (2006)
Srinivasan, R., Nunez, P.L., Silberstein, R.B.: Spatial Filtering and Neocortical Dynamics: Estimates of EEG Coherence. IEEE Trans. Biomed. Eng. 45, 814–826 (1998)
Freeman, W.J., Holmes, M.D., Burke, B.C., Vanhatalo, S.: Spatial Spectra of Scalp EEG and EMG From Awake Humans. Clin. Neurophysiol. 114, 1053–1068 (2003)
Wolpaw, J.R., McFarland, D.J.: Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. Proc. Natl. Acad. Sci. U.S.A. 101, 17849–17854 (2004)
McFarland, D., Krusienski, D., Sarnacki, W., Wolpaw, J.: Emulation of computer mouse control with a noninvasive brain–computer interface. J. Neural Eng. 5, 101–110 (2008)
Heetderks, W.J., Schmidt, E.M.: Chronic, Multiple Unit Recording of Neural Activity With Micromachined Silicon Electrodes (1995)
Ikeda, A., Shibasaki, H.: Invasive Recording of Movement-Related Cortical Potentials in Humans. J. Clin. Neurophysiol. 9, 509–520 (1992)
Schmidt, E.M.: Single Neuron Recording From Motor Cortex As a Possible Source of Signals for Control of External Devices. Ann. Biomed. Eng. 8, 339–349 (1980)
Levine, S.P., Huggins, J.E., BeMent, S.L., Kushwaha, R.K., Schuh, L.A., Rohde, M.M., Passaro, E.A., Ross, D.A., Elisevich, K.V., Smith, B.J.: A Direct Brain Interface Based on Event-Related Potentials. IEEE Trans. Rehabil. Eng. 8, 180–185 (2000)
Huggins, L., BeMent, K., Schuh, P., Rohde, R., Elisevich, S.: Detection of event-related potentials for development of a direct brain interface. J. Clin. Neurophysiol. 16, 448–455 (1999)
Wilson, J.A., Felton, E.A., Garell, P.C., Schalk, G., Williams, J.C.: ECoG factors underlying multimodal control of a brain-computer interface. IEEE transactions on neural systems and rehabilitation engineering: a publication of the IEEE Engineering in Medicine and Biology Society 14, 246–250 (2006)
Leuthardt, E.C., Miller, K.J., Schalk, G., Rao, R.P., Ojemann, J.G.: Electrocorticography-based brain computer interface–the Seattle experience. IEEE transactions on neural systems and rehabilitation engineering: a publication of the IEEE Engineering in Medicine and Biology Society 14, 194–198 (2006)
Leuthardt, E.C., Schalk, G., Wolpaw, J.R., Ojemann, J.G., Moran, D.W.: A brain-computer interface using electrocorticographic signals in humans. Journal of Neural Engineering 1, 63–71 (2004)
Felton, E.A., Wilson, J.A., Williams, J.C., Garell, P.C.: Electrocorticographically controlled brain-computer interfaces using motor and sensory imagery in patients with temporary subdural electrode implants. Report of four cases. J. Neurosurg. 106, 495–500 (2007)
Schalk, G., Miller, K., Anderson, N., Wilson, J., Smyth, M., Ojemann, J., Moran, D., Wolpaw, J., Leuthardt, E.: Two-dimensional movement control using electrocorticographic signals in humans. J. Neural Eng. 5, 75–84 (2008)
Velliste, M., Perel, S., Spalding, M.C., Whitford, A.S., Schwartz, A.B.: Cortical control of a prosthetic arm for self-feeding. Nature 453, 1098–1101 (2008)
Hochberg, L., Serruya, M., Friehs, G., Mukand, J., Saleh, C.A., Branner, C., Penn, R., Donoghue, J.: Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 442, 164–171 (2006)
Santhanam, G., Ryu, S.I., Yu, B.M., Afshar, A., Shenoy, K.V.: A high-performance brain-computer interface. Nature 442, 195–198 (2006)
Lebedev, M.A., Carmena, J.M., O’Doherty, J.E., Zacksenhouse, M., Henriquez, C.S., Principe, J.C., Nicolelis, M.A.: Cortical ensemble adaptation to represent velocity of an artificial actuator controlled by a brain-machine interface. J. Neurosci. 25, 4681–4693 (2005)
Andersen, R.A., Burdick, J.W., Musallam, S., Pesaran, B., Cham, J.G.: Cognitive neural prosthetics. Trends Cogn. Sci (Regul. Ed.) 8, 486–493 (2004)
Shenoy, K.V., Meeker, D., Cao, S., Kureshi, S.A., Pesaran, B., Buneo, C.A., Batista, A.P., Mitra, P.P., Burdick, J.W., Andersen, R.A.: Neural prosthetic control signals from plan activity. Neuroreport 14, 591–596 (2003)
Serruya, M., Hatsopoulos, N., Paninski, L., Fellows, M., Donoghue, J.: Instant neural control of a movement signal. Nature 416, 141–142 (2002)
Taylor, D.M., Tillery, S.I., Schwartz, A.B.: Direct cortical control of 3D neuroprosthetic devices. Science 296, 1829–1832 (2002)
Georgopoulos, A.P., Schwartz, A.B., Kettner, R.E.: Neuronal population coding of movement direction. Science 233, 1416–1419 (1986)
Shain, W., Spataro, L., Dilgen, J., Haverstick, K., Retterer, S., Isaacson, M., Saltzman, M., Turner, J.: Controlling Cellular Reactive Responses Around Neural Prosthetic Devices Using Peripheral and Local Intervention Strategies. IEEE Trans. Neural Syst. Rehabil. Eng. 11, 186–188 (2003)
Schalk, G.: Brain-computer symbiosis. J. Neural Eng. 15, P1–P15 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schalk, G. (2009). Sensor Modalities for Brain-Computer Interfacing. In: Jacko, J.A. (eds) Human-Computer Interaction. Novel Interaction Methods and Techniques. HCI 2009. Lecture Notes in Computer Science, vol 5611. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02577-8_67
Download citation
DOI: https://doi.org/10.1007/978-3-642-02577-8_67
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02576-1
Online ISBN: 978-3-642-02577-8
eBook Packages: Computer ScienceComputer Science (R0)