Abstract
Bagging, boosting and random subspace are three popular ensemble learning methods, which have already shown effectiveness in many practical classification problems. For electroencephalogram (EEG) signal classification arising in recent brain-computer interface (BCI) research, however, there are almost no reports investigating their feasibilities. This paper systematically evaluates the performance of these three ensemble methods for their new application on EEG signal classification. Experiments are conducted on three BCI subjects with k-nearest neighbor and decision tree as base classifiers. Several valuable conclusions are derived about the feasibility and performance of ensemble methods for classifying EEG signals.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Nicolelis, M.A.L.: Actions from Thoughts. Nature 409, 403–407 (2001)
Wolpaw, J.R., et al.: Brain-Computer Interfaces for Communication and Control. Clin. Neurophysiol. 113, 767–791 (2002)
Ebrahimi, T., Vesin, J.M., Garcia, G.: Brain-Computer Interface in Multimedia Communication. IEEE Signal Proc. Mag. 20, 14–24 (2003)
Wolpaw, J.R., et al.: Brain-Computer Interface Technology: a Review of the First International Meeting. IEEE Trans. Rehab. Eng. 8, 164–173 (2000)
Vaughan, T.M.: Guest Editorial Brain-Computer Interface Technology: a Review of the Second International Meeting. IEEE Trans. Neural Syst. Rehabil. Eng. 11, 94–109 (2003)
Garrett, D., et al.: Comparion of Linear, Nonlinear, and Feature Selection Methods for EEG Signal Classification. IEEE Trans. Neural Syst. Rehabil. Eng. 11, 141–144 (2003)
Müller, K.-R., Anderson, C.W., Birch, G.E.: Linear and Nonlinear Methods for Brain-Computer Interfaces. IEEE Trans. Neural Syst. Rehabil. Eng. 11, 165–169 (2003)
Obermaier, B., et al.: Asymmetric Hemisphere Modeling in an Offline Brain-Computer Interface. IEEE Trans. Syst. Man Cybern. Part C-Appl. Rev. 31, 536–540 (2001)
Millán, J.R., et al.: Brain-Actuated Interaction. Artif. Intell. 159, 241–259 (2004)
Sun, S., Zhang, C.: Learning On-Line Classification via Decorrelated LMS Algorithm: Application to Brain-Computer Interfaces. In: Hoffmann, A., Motoda, H., Scheffer, T. (eds.) DS 2005. LNCS (LNAI), vol. 3735, pp. 215–226. Springer, Heidelberg (2005)
Sun, S., Zhang, C.: Adaptive Feature Extraction for EEG Signal Classification. Medical & Biological Engineering & Computing 44, 931–935 (2006)
Kamousi, B., Liu, Z., He, B.: Classification of Motor Imagery Tasks for Brain-Computor Interface Applications by Means of Two Equivalent Dipoles Analysis. IEEE Trans. Neural Syst. Rehabil. Eng. 13, 166–171 (2005)
Dietterich, T.G.: Machine Learning Research - Four Current Directions. AI Mag. 18, 97–136 (1997)
Breiman, L.: Bagging predictors. Mach. Learn. 24, 123–140 (1996)
Freund, Y., Shapire, R.E.: A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting. J. Comput. Syst. Sci. 55, 119–139 (1997)
Ho, T.K.: The Random Subspace Method for Constructing Decision Forests. IEEE Trans. Pattern Anal. Mach. Intell. 20, 832–844 (1998)
Dietterich, T.G.: An Experiemental Comparison of Three Methods for Constructing Ensembles of Decision Trees: Bagging, Boosting, and Randomization. Mach. Learn. 40, 139–157 (2000)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. John Wiley & Sons, New York (2000)
Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools and Techniques, 2nd edn. Morgan Kaufmann, San Francisco (2005)
Tsymbal, A., Pechenizkiy, M., Cunningham, P.: Diversity in Search Strategies for Ensemble Feature Selection. Information Fusion 6, 83–98 (2005)
Millán, J.R.: On the Need for On-Line Learning in Brain-Computer Interfaces. In: Proc. 2004 Int. Joint Conf. Neural Networks, vol. 4, pp. 2877–2882 (2004)
Chiappa, S., Millán, J.R.: Data set V <mental imagery, multi-class> (2005), Available at http://ida.first.fraunhofer.de/projects/bci/competition_iii/desc_V.html
Bauer, E., Kohavi, R.: An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants. Mach. Learn. 36, 105–139 (1999)
Breiman, L.: Random Forests. Mach. Learn. 45, 5–32 (2001)
Breiman, L.: Heuristics of Instability and Stabilization in Model Selection. Ann. Stat. 24, 2350–2383 (1996)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Sun, S. (2007). Ensemble Learning Methods for Classifying EEG Signals. In: Haindl, M., Kittler, J., Roli, F. (eds) Multiple Classifier Systems. MCS 2007. Lecture Notes in Computer Science, vol 4472. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72523-7_12
Download citation
DOI: https://doi.org/10.1007/978-3-540-72523-7_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72481-0
Online ISBN: 978-3-540-72523-7
eBook Packages: Computer ScienceComputer Science (R0)