A new nonparametric approach for multiplicity control:Optimal Subset procedures
A new approach for multiplicity control (Optimal Subset) is presented. This is based on the selection of the best subset of partial (univariate) hypotheses producing the minimal p-value. In this work, we show how to perform this new procedure in the permutation framework, choosing suitable combining functions and permutation strategies. The optimal subset approach can be very useful in exploratory studies because it performs a weak control for multiplicity which can be a valid alternative to the False Discovery Rate (FDR). A comparative simulation study and an application to neuroimaging real data shows that it is particularly useful in presence of a high number of hypotheses. We also show how stepwise regression may be a special case of Optimal Subset procedures and how to adjust the p-value of the selected model taking into account for the multiplicity arising from the possible different models selected by a stepwise regression.
KeywordsFDR FWE multiple tests neuroimaging permutation tests stepwise regression
Unable to display preview. Download preview PDF.
- Finos, L., Pesarin, F., Salmaso, L. (2003). Combined tests for controlling multiplicity by closed testing procedures.Italian Journal of Applied Statistics, 15, 301–329.Google Scholar
- Fisher, R.A. (1955).Statistical methods and scientific inference. Edinburgh: Oliver &: Boyd.Google Scholar
- Pascual-Marqui, R. D., 1999. Review of Methods for Solving the EEG Inverse Problem.International Journal of Bioelectromagnetism, 1 (1), 75–86.Google Scholar
- Pesarin, F. (2001),Multivariate permutation tests with application to biostatistics. Wiley, Chichester.Google Scholar
- Sherlin, L., Congedo, M. (2003). Obsessive Compulsive Disorder localized using Low-Resolution Electromagnetic Tomography, 34th annual meeting of the Association for Applied Psychophysiology & Biofeedback, March 27–30, Jacksonville, FL, USA.Google Scholar