Skip to main content
Log in

Comparison of the Performance of Fourteen Statistical Tests for Detection of Outlying Values in Geochemical Reference Material Databases

  • Published:
Mathematical Geology Aims and scope Submit manuscript

Abstract

This work presents a comparison of relative efficiency of fourteen statistical tests to detect outliers in normally distributed samples. These tests include deviation/spread, Grubbs-type, Dixon-type, and high-order moment statistics. Performance for the statistical tests is evaluated using Geochemical Reference Material databases from the United States Geological Survey. Test efficiency is compared for the first application of statistics in version k = 1 and k = 2, as well as for tests in version k = 1 applied consecutively against block procedures in which k = 2, 3, or 4 values are evaluated at the same time. In both evaluations, the sensitivity of the statistical tests shows a general strong dependence on sample size. The best performance is observed for the block procedures compared to consecutive statistical tests affected by masking effects.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

REFERENCES

  • Abbey, S., 1992, Evaluation and application of reference materials for the analysis of rocks and minerals: Chemical Geology, v. 95, nos. 1/2, p. 123–130.

    Google Scholar 

  • Abbey, S., and Rousseau, R. M., 1985, Pragmatism vs. rigour: A debate on the resolution of disparate analytical data of Canadian iron-formation reference samples: Geostandards Newsletter, v. 9, no. 1, p. 1–16.

    Google Scholar 

  • Barnett, V., and Lewis, T., 1994, Outliers in statistical data: John Wiley & Sons, New York, 584 p.

    Google Scholar 

  • Dixon, W. J., 1950, Analysis of extreme values: Annals of Mathematical Statistics, v. 21, no. 4, p. 488–506.

    Google Scholar 

  • Dixon, W. J., 1951, Ratios involving extreme values: Annals of Mathematical Statistics, v. 22, no. 1, p. 67–78.

    Google Scholar 

  • Dybczynsky, R., 1980, Comparison of the effectiveness of various procedures for the rejection of outlying results and assigning consensus values in interlaboratory programs involving determination of trace elements or radionuclides: Analytica Chimica Acta, v. 117, no. 5, p. 53–70.

    Google Scholar 

  • Dybczynsky, R., Tugsavil, A., and Suschny, O., 1979, Soil-5, a new IAEA certified reference material for trace element determinations: Geostandards Newsletter, v. 3, no. 1, p. 61–87.

    Google Scholar 

  • Ferguson, T. S., 1961a, On the rejection of outliers: Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, v. 1, no. 1, p. 253–287.

    Google Scholar 

  • Ferguson, T. S., 1961b, Rules for rejection of outliers: Reviews of Institute of Statistics, v. 29, no. 1, p. 29–43.

    Google Scholar 

  • Flanagan, F. J., 1986, Reference samples in geology and geochemistry: Geostandards Newsletter, v. 10, no. 1, p. 191–264.

    Google Scholar 

  • Gladney, E. S., and Roelandts, I., 1988a, 1987 compilation of elemental concentration data for USGS BHVO-1,MAG-1, QLO-1, RGM-1, SCo-1, SDC-1, SGR-1 and STM-1: Geostandards Newsletter, v. 12, no. 2, p. 253–362.

    Google Scholar 

  • Gladney, E. S., and Roelandts, I., 1988b, 1987 compilation of elemental concentration data for USGS BIR-1, DNC-1 and W-2: Geostandards Newsletter, v. 12, no. 1, p. 63–118.

    Google Scholar 

  • Gladney, E. S., Jones, E. A., Nickell, E. J., and Roelandts, I., 1991, 1988 compilation of elemental concentration data for USGS DTS-1, G-1, PCC-1 andW-1: Geostandards Newsletter, v. 15, no. 2, p. 199–396.

    Google Scholar 

  • Gladney, E. S., Jones, E. A., Nickell, E. J., and Roelandts, I., 1992, 1988 compilation of elemental concentration data for USGS AGV-1, GSP-1 and G-2: Geostandards Newsletter, v. 16, no. 2, p. 111–300.

    Google Scholar 

  • Grubbs, F. E., 1950, Sample criteria for testing outlying observations: Annals of Mathematical Statistics, v. 21, no. 1, p. 27–58.

    Google Scholar 

  • Grubbs, F. E., 1969, Procedures for detecting outlying observations in samples: Technometrics, v. 11, no. 1, p. 1–21.

    Google Scholar 

  • Iglewicz, B., and Martinez, J., 1982, Outlier detection using robust measures of scale: Jour. Statist. Comput. Simul., v. 15, no. 2, p. 285–293.

    Google Scholar 

  • International Standards Organisation, 1989, Guide 35: Certification of reference materials-General and statistical principles: Committee on Reference Materials (REMCO), Geneva, 32 p.

  • Jain, R. B., 1981, Percentage points of many-outlier detection procedures: Technometrics, v. 23, no. 1, p. 71–75.

    Google Scholar 

  • Jensen, J. L., Lake, L.W., Corbett, P.W. M., and Goggin, D. J., 1997, Statistics for petroleum engineers and geoscientists: Prentice-Hall, Upper Saddle River, 390 p.

    Google Scholar 

  • Kane, J. S., 1992, Reference samples for use in analytical geochemistry: Their availability, preparation, and appropiate use: Jour. Geochem. Explor., v. 44, no. 1, p. 37–63.

    Google Scholar 

  • King, E. P., 1953, Onsome procedures for the rejection of suspected data: Journal of American Statistical Association, v. 48, no. 263, p. 531–533.

    Google Scholar 

  • Lister, B., 1982, Evaluation of analytical data: A practical guide for geoanalysts: Geostandards Newsletter, v. 6, no. 2, p. 175–205.

    Google Scholar 

  • McMillan, R. G., 1971, Tests for one or two outliers in normal samples with unknown variance: Technometrics, v. 13, no. 1, p. 87–100.

    Google Scholar 

  • Pearson, E. S., and Hartley, H. O., 1976, Biometrika tables for statisticians: Biometrika Trust, London, 270 p.

  • Potts, P. J., Tindle, A. G., and Webb, P. C., 1992, Geochemical Reference Material Compositions: Whittles Publishing Services, CRC Press, Caithness, 313 p.

    Google Scholar 

  • Prescott, P., 1976, Comparison of tests for normality using stylized sensitivity surfaces: Biometrika, v. 63, no. 2, p. 285–289.

    Google Scholar 

  • Prescott, P., 1978, Examination of the behaviour of tests for outliers when more than one outlier is present: Applied Statistics, v. 27, no. 1, p. 10–25.

    Google Scholar 

  • Prescott, P., 1979, Critical values for a sequential test for many outliers: Applied Statistics, v. 28, no. 1, p. 36–39.

    Google Scholar 

  • Ramsey, P. P., and Ramsey, P. H., 1990, Simple tests of normality in small samples: Jour. Quality Technology, v. 22, no. 4, p. 299–309.

    Google Scholar 

  • Taylor, J. K., 1990, Statistical techniques for data analysis: Lewis Publishers, Chelsea, 200 p.

    Google Scholar 

  • Tietjen, G. L., and Moore, R. H., 1972, Some Grubbs-type statistics for the detection of several outliers: Technometrics, v. 14, no. 3, p. 583–597.

    Google Scholar 

  • Velasco, F., and Verma, S. P., 1998, Importance of Skewness and Kurtosis statistical tests for outlier detection and elimination in evaluation of geochemical reference materials: Math. Geology, v. 30, no. 1, p. 109–128.

    Google Scholar 

  • Verma, S. P., 1997, Sixteen statistical tests for outlier detection and rejection in evaluation of international geochemical reference materials: Example of microgabbro PM-S: Geostandards Newsletter: Jour. Geostand. Geoanal., v. 21, no. 1, p. 59–75.

    Google Scholar 

  • Verma, S. P., 1998, Improved concentration data in two international geochemical reference materials (USGS basalt BIR-1 and GSJ peridotite JP-1) by outlier rejection: Geofisica Internacional, v. 37, no. 3, p. 215–250.

    Google Scholar 

  • Verma, S. P., Besch, T., Guevara, M., and Schulz-Dobrich, B., 1992, Determination of twelve trace elements in twenty-seven and ten major elements in twenty-three geochemical reference samples by X-ray fluorescence spectrometry: Geostandards Newsletter, v. 16, no. 2, p. 301–309.

    Google Scholar 

  • Verma, S. P., Orduña-Galván, L. J., and Guevara, M., 1999, SIPVADE: A new computer program with seventeen statistical tests for outlier detection in evaluation of international geochemical reference materials and its application to Whin Sill dolerite WS-E from England and Soil-5 from Peru: Geostandards Newsletter: Jour. Geostand. Geoanal., v. 22, no. 2, p. 209–234.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Velasco, F., Verma, S.P. & Guevara, M. Comparison of the Performance of Fourteen Statistical Tests for Detection of Outlying Values in Geochemical Reference Material Databases. Mathematical Geology 32, 439–464 (2000). https://doi.org/10.1023/A:1007573815959

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1007573815959

Navigation