Abstract
This work presents a comparison of relative efficiency of fourteen statistical tests to detect outliers in normally distributed samples. These tests include deviation/spread, Grubbs-type, Dixon-type, and high-order moment statistics. Performance for the statistical tests is evaluated using Geochemical Reference Material databases from the United States Geological Survey. Test efficiency is compared for the first application of statistics in version k = 1 and k = 2, as well as for tests in version k = 1 applied consecutively against block procedures in which k = 2, 3, or 4 values are evaluated at the same time. In both evaluations, the sensitivity of the statistical tests shows a general strong dependence on sample size. The best performance is observed for the block procedures compared to consecutive statistical tests affected by masking effects.
Similar content being viewed by others
REFERENCES
Abbey, S., 1992, Evaluation and application of reference materials for the analysis of rocks and minerals: Chemical Geology, v. 95, nos. 1/2, p. 123–130.
Abbey, S., and Rousseau, R. M., 1985, Pragmatism vs. rigour: A debate on the resolution of disparate analytical data of Canadian iron-formation reference samples: Geostandards Newsletter, v. 9, no. 1, p. 1–16.
Barnett, V., and Lewis, T., 1994, Outliers in statistical data: John Wiley & Sons, New York, 584 p.
Dixon, W. J., 1950, Analysis of extreme values: Annals of Mathematical Statistics, v. 21, no. 4, p. 488–506.
Dixon, W. J., 1951, Ratios involving extreme values: Annals of Mathematical Statistics, v. 22, no. 1, p. 67–78.
Dybczynsky, R., 1980, Comparison of the effectiveness of various procedures for the rejection of outlying results and assigning consensus values in interlaboratory programs involving determination of trace elements or radionuclides: Analytica Chimica Acta, v. 117, no. 5, p. 53–70.
Dybczynsky, R., Tugsavil, A., and Suschny, O., 1979, Soil-5, a new IAEA certified reference material for trace element determinations: Geostandards Newsletter, v. 3, no. 1, p. 61–87.
Ferguson, T. S., 1961a, On the rejection of outliers: Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, v. 1, no. 1, p. 253–287.
Ferguson, T. S., 1961b, Rules for rejection of outliers: Reviews of Institute of Statistics, v. 29, no. 1, p. 29–43.
Flanagan, F. J., 1986, Reference samples in geology and geochemistry: Geostandards Newsletter, v. 10, no. 1, p. 191–264.
Gladney, E. S., and Roelandts, I., 1988a, 1987 compilation of elemental concentration data for USGS BHVO-1,MAG-1, QLO-1, RGM-1, SCo-1, SDC-1, SGR-1 and STM-1: Geostandards Newsletter, v. 12, no. 2, p. 253–362.
Gladney, E. S., and Roelandts, I., 1988b, 1987 compilation of elemental concentration data for USGS BIR-1, DNC-1 and W-2: Geostandards Newsletter, v. 12, no. 1, p. 63–118.
Gladney, E. S., Jones, E. A., Nickell, E. J., and Roelandts, I., 1991, 1988 compilation of elemental concentration data for USGS DTS-1, G-1, PCC-1 andW-1: Geostandards Newsletter, v. 15, no. 2, p. 199–396.
Gladney, E. S., Jones, E. A., Nickell, E. J., and Roelandts, I., 1992, 1988 compilation of elemental concentration data for USGS AGV-1, GSP-1 and G-2: Geostandards Newsletter, v. 16, no. 2, p. 111–300.
Grubbs, F. E., 1950, Sample criteria for testing outlying observations: Annals of Mathematical Statistics, v. 21, no. 1, p. 27–58.
Grubbs, F. E., 1969, Procedures for detecting outlying observations in samples: Technometrics, v. 11, no. 1, p. 1–21.
Iglewicz, B., and Martinez, J., 1982, Outlier detection using robust measures of scale: Jour. Statist. Comput. Simul., v. 15, no. 2, p. 285–293.
International Standards Organisation, 1989, Guide 35: Certification of reference materials-General and statistical principles: Committee on Reference Materials (REMCO), Geneva, 32 p.
Jain, R. B., 1981, Percentage points of many-outlier detection procedures: Technometrics, v. 23, no. 1, p. 71–75.
Jensen, J. L., Lake, L.W., Corbett, P.W. M., and Goggin, D. J., 1997, Statistics for petroleum engineers and geoscientists: Prentice-Hall, Upper Saddle River, 390 p.
Kane, J. S., 1992, Reference samples for use in analytical geochemistry: Their availability, preparation, and appropiate use: Jour. Geochem. Explor., v. 44, no. 1, p. 37–63.
King, E. P., 1953, Onsome procedures for the rejection of suspected data: Journal of American Statistical Association, v. 48, no. 263, p. 531–533.
Lister, B., 1982, Evaluation of analytical data: A practical guide for geoanalysts: Geostandards Newsletter, v. 6, no. 2, p. 175–205.
McMillan, R. G., 1971, Tests for one or two outliers in normal samples with unknown variance: Technometrics, v. 13, no. 1, p. 87–100.
Pearson, E. S., and Hartley, H. O., 1976, Biometrika tables for statisticians: Biometrika Trust, London, 270 p.
Potts, P. J., Tindle, A. G., and Webb, P. C., 1992, Geochemical Reference Material Compositions: Whittles Publishing Services, CRC Press, Caithness, 313 p.
Prescott, P., 1976, Comparison of tests for normality using stylized sensitivity surfaces: Biometrika, v. 63, no. 2, p. 285–289.
Prescott, P., 1978, Examination of the behaviour of tests for outliers when more than one outlier is present: Applied Statistics, v. 27, no. 1, p. 10–25.
Prescott, P., 1979, Critical values for a sequential test for many outliers: Applied Statistics, v. 28, no. 1, p. 36–39.
Ramsey, P. P., and Ramsey, P. H., 1990, Simple tests of normality in small samples: Jour. Quality Technology, v. 22, no. 4, p. 299–309.
Taylor, J. K., 1990, Statistical techniques for data analysis: Lewis Publishers, Chelsea, 200 p.
Tietjen, G. L., and Moore, R. H., 1972, Some Grubbs-type statistics for the detection of several outliers: Technometrics, v. 14, no. 3, p. 583–597.
Velasco, F., and Verma, S. P., 1998, Importance of Skewness and Kurtosis statistical tests for outlier detection and elimination in evaluation of geochemical reference materials: Math. Geology, v. 30, no. 1, p. 109–128.
Verma, S. P., 1997, Sixteen statistical tests for outlier detection and rejection in evaluation of international geochemical reference materials: Example of microgabbro PM-S: Geostandards Newsletter: Jour. Geostand. Geoanal., v. 21, no. 1, p. 59–75.
Verma, S. P., 1998, Improved concentration data in two international geochemical reference materials (USGS basalt BIR-1 and GSJ peridotite JP-1) by outlier rejection: Geofisica Internacional, v. 37, no. 3, p. 215–250.
Verma, S. P., Besch, T., Guevara, M., and Schulz-Dobrich, B., 1992, Determination of twelve trace elements in twenty-seven and ten major elements in twenty-three geochemical reference samples by X-ray fluorescence spectrometry: Geostandards Newsletter, v. 16, no. 2, p. 301–309.
Verma, S. P., Orduña-Galván, L. J., and Guevara, M., 1999, SIPVADE: A new computer program with seventeen statistical tests for outlier detection in evaluation of international geochemical reference materials and its application to Whin Sill dolerite WS-E from England and Soil-5 from Peru: Geostandards Newsletter: Jour. Geostand. Geoanal., v. 22, no. 2, p. 209–234.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Velasco, F., Verma, S.P. & Guevara, M. Comparison of the Performance of Fourteen Statistical Tests for Detection of Outlying Values in Geochemical Reference Material Databases. Mathematical Geology 32, 439–464 (2000). https://doi.org/10.1023/A:1007573815959
Issue Date:
DOI: https://doi.org/10.1023/A:1007573815959