Predicting EEG Sample Size Required for Classification Calibration
This study considers an important problem of predicting required calibration sample size for electroencephalogram (EEG)-based classification in brain computer interaction (BCI). We propose an adaptive algorithm based on learning curve fitting to learn the relationship between sample size and classification performance for each individual subject. The algorithm can always provide the predicted result in advance of reaching the baseline performance with an average error of 17.4 %. By comparing the learning curve of different classifiers, the algorithm can also recommend the best classifier for a BCI application. The algorithm also learns a sample size upper bound from the prior datasets and uses it to detect subject outliers that potentially need excessive amount of calibration data. The algorithm is applied to three EEG-based BCI datasets to demonstrate its utility and efficacy. A Matlab package with GUI is also developed and available for downloading at https://github.com/ZijingMao/LearningCurveFittingForSampleSizePrediction. Since few algorithms are yet available to predict performance for BCIs, our algorithm will be an important tool for real-life BCI applications.
KeywordsSample size prediction Calibration Brain computer interface EEG Rapid serial visual presentation Driver’s fatigue
Research was sponsored in part by the Army Research Laboratory and was accomplished under Cooperative Agreement Number W911NF-10-2-0022. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implies, of the Army Research Laboratory or the U.S. Government. The U.S. Government is authorized to reproduce and distribute reprints for the Government purposes notwithstanding any copyright notation herein. This work received computational support from Computational System Biology Core at the University of Texas at San Antonio, funded by the National Institute on Minority Health and Health Disparities (G12MD007591) from the National Institutes of Health.
- 4.Sun, S., Zhou, J.: A review of adaptive feature extraction and classification methods for EEG-based brain-computer interfaces. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp. 1746–1753 (2014)Google Scholar
- 9.Zodpey, S.P.: Sample size and power analysis in medical research. Indian J. Dermatol. Venereol. Leprology 70, 123 (2004)Google Scholar
- 11.Cortes, C., Jackel, L.D., Solla, S.A., Vapnik, V., Denker, J.S.: Learning curves: asymptotic values and rate of convergence. Adv. Neural Inf. Process. Syst. 6, 327–334 (1994)Google Scholar
- 13.U.S. Department of the Army. Use of volunteers as subjects of research. AR 70–25 Washington DC. Government Printing Office (1990)Google Scholar
- 14.U.S Department of Defense Office of the Secretary of Defense, Code of federal regulations, protection of human subjects. 32 CFR 219, vol. 32 CFR 219 (1999)Google Scholar