Studies in conservation genetics often attempt to determine genetic differentiation between two or more temporally or geographically distinct sample collections. Pairwise p-values from Fisher’s exact tests or contingency Chi-square tests are commonly reported with a Bonferroni correction for multiple tests. While the Bonferroni correction controls the experiment-wise α, this correction is very conservative and results in greatly diminished power to detect differentiation among pairs of sample collections. An alternative is to control the false discovery rate (FDR) that provides increased power, but this method only maintains experiment-wise α when none of the pairwise comparisons are significant. Recent modifications to the FDR method provide a moderate approach to determining significance level. Simulations reveal that critical values of multiple comparison tests with both the Bonferroni method and a modified FDR method approach a minimum asymptote very near zero as the number of tests gets large, but the Bonferroni method approaches zero much more rapidly than the modified FDR method. I compared pairwise significance from three published studies using three critical values corresponding to Bonferroni, FDR, and modified FDR methods. Results suggest that the modified FDR method may provide the most biologically important critical value for evaluating significance of population differentiation in conservation genetics.␣Ultimately, more thorough reporting of statistical significance is needed to allow interpretation of biological significance of genetic differentiation among populations.
This manuscript was improved following reviews from Vincent Buonaccorsi, Rishi Sharma, and two anonymous reviewers.
Abbot CL, Double MC (2003) Genetic structure, conservation genetics and evidence of speciation by range expansion in shy and white capped albatrosses. Mol. Ecol. 12: 2953–2962PubMedCrossRefGoogle Scholar
Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Stat. Soc. B 57: 289–300Google Scholar
Benjamini Y, Yekutieli D (2001) The control of false discovery rate under dependency. Ann. Stat 29: 1165–1188CrossRefGoogle Scholar
Bickel D (2004) Degrees of differential gene expression: detecting biologically significant expression differences and estimating their magnitudes. Bioinformatics 20: 682–688PubMedCrossRefGoogle Scholar
Clegg SM, Hale P, Moritz C (1998) Molecular population genetics of the red kangaroo (Macropus rufus): mtDNA variation. Mol. Ecol 7, 679–686PubMedCrossRefGoogle Scholar
Garcia LV (2004) Escaping the Bonferroni iron claw in ecological studies. OIKOS 105: 657–663CrossRefGoogle Scholar
Genovese CR, Lazar NA, Nichols T (2002) Thresholding of statistical maps in functional neuroimage analysis using the false discovery rate. Neuroimage 15: 870–878PubMedCrossRefGoogle Scholar
Hochberg Y (1988) A sharper Bonferroni procedure for multiple tests of significance. Biometrika 75: 800–803CrossRefGoogle Scholar
Holm S (1979) A simple sequential rejective multiple test procedure. Scand. J. Stat 6: 65–70Google Scholar
Ludbrook J (1991) On making multiple comparisons in clinical and experimental pharmacology and physiology. Clin. Exp. Pharmacol. Physiol 18: 379–392PubMedGoogle Scholar
Narum SR, Contor C, Talbot A, Powell M (2004) Genetic divergence of sympatric resident and anadromous forms of Oncorhynchus mykiss in the Walla Walla River and Columbia River Basin,U.S.A.. J.Fish Bio 65: 471–488CrossRefGoogle Scholar
Reiner A, Yekutieli D, Benjamini Y (2003) Identifying differentially expressed genes using false discovery rate controlling procedures. Bioinformatics 19: 368–375PubMedCrossRefGoogle Scholar