Skip to main content

M-Estimators of the Correlation Coefficient for Bivariate Independent Component Distributions

  • Chapter
Modern Nonparametric, Robust and Multivariate Methods

Abstract

A few historical remarks on the notion of correlation, as well as a brief review of robust estimators of the correlation coefficient are given. A family of M-estimators of the correlation coefficient for bivariate independent component distributions is proposed. Consistency and asymptotic normality of these estimators are established, and the explicit expression for their asymptotic variance is obtained. A minimax variance (in the Huber sense) M-estimator of the correlation coefficient for \(\varepsilon\)-contaminated bivariate normal distributions is designed. Although the structure of this new result generally is similar to the former minimax variance M-estimator of the correlation coefficient proposed by Shevlyakov and Vilchevski (Stat. Probab. Lett. 57, 91–100, 2002b), the efficiency of this new estimator is considerably greater than that of the former one as it generalizes the maximum likelihood estimator of the correlation coefficient of the bivariate normal distribution. Furthermore, highly efficient and robust estimators of correlation are obtained by applying highly efficient and robust estimators of scale. Under the \(\varepsilon\)-contaminated bivariate normal, t- and independent component Cauchy distributions, the proposed robust estimators dominate over the sample correlation coefficient. The comparative analytical and Monte Carlo study of various robust estimators confirm the effectiveness of the proposed M-estimator of the correlation coefficient.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Blomqvist, N.: On a measure of dependence between two random variables. Ann. Math. Stat. 21(4), 593–600 (1950)

    Article  MathSciNet  MATH  Google Scholar 

  • Devlin, S.J., Gnanadesikan, R., Kettenring, J.R.: Robust estimation and outlier detection with correlation coefficients. Biometrika 62(3), 531–545 (1975)

    Article  MATH  Google Scholar 

  • Galton, F.: Family likeness in stature. Proc. R. Soc. Lond. 40, 42–73 (1886)

    Article  MATH  Google Scholar 

  • Gnanadesikan, R., Kettenring, J.R.: Robust estimates, residuals, and outlier detection with multiresponse data. Biometrics 28(1), 81–124 (1972)

    Article  Google Scholar 

  • Hampel, F.R., Ronchetti, E.M., Rousseeuw, P.J., Stahel, W.A.: Robust Statistics: The Approach Based on Influence Functions. Wiley, New York (1986)

    MATH  Google Scholar 

  • Huber, P.J.: Robust estimation of a location parameter. Ann. Math. Stat. 35(1), 73–101 (1964)

    Article  MathSciNet  MATH  Google Scholar 

  • Huber, P.J.: Robust Statistics. Wiley, New York (1981)

    Book  MATH  Google Scholar 

  • Kendall, M.G., Stuart, A.: The Advanced Theory of Statistics. Inference and Relationship. Griffin, London (1963)

    MATH  Google Scholar 

  • Pasman, V.R., Shevlyakov, G.L.: Robust methods of estimation of a correlation coefficient. Autom. Remote Control 48, 332–340 (1987)

    MATH  Google Scholar 

  • Pearson, K.: Contributions to the mathematical theory of evolution. Philos. Trans. R. Soc. Lond. 185, 77–110 (1894)

    Article  MATH  Google Scholar 

  • Pearson, K.: Notes on the history of correlations. Biometrika 13, 25–45 (1920)

    Article  Google Scholar 

  • Pearson, K.: Karl Pearson’s Early Statistical Papers. Cambridge University Press, Cambridge (1948)

    Google Scholar 

  • Rousseeuw, P.J.: Least median of squares regression. J. Am. Stat. Assoc. 79(388), 871–880 (1984)

    Article  MathSciNet  MATH  Google Scholar 

  • Rousseeuw, P.J., Croux, C.: Alternatives to the median absolute deviation. J. Am. Stat. Assoc. 88(424), 1273–1283 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  • Shevlyakov, G.L., Smirnov, P.O.: Robust estimation of the correlation coefficient: an attempt of survey. Austrian J. Stat. 40(1/2), 147–156 (2011)

    Google Scholar 

  • Shevlyakov, G.L., Vilchevski, N.O.: Robustness in Data Analysis: Criteria and Methods. VSP, Utrecht (2002a)

    Google Scholar 

  • Shevlyakov, G.L., Vilchevsky, N.O.: Minimax variance estimation of a correlation coefficient for epsilon-contaminated bivariate normal distributions. Stat. Probab. Lett. 57, 91–100 (2002b)

    Article  MathSciNet  MATH  Google Scholar 

  • Shevlyakov, G.L., Smirnov, P.O., Shin, V.I., Kim, K.: Asymptotically minimax bias estimation of the correlation coefficient for bivariate independent component distributions. J. Multivar. Anal. 111, 59–65 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  • Smirnov, P.O., Shevlyakov, G.L.: Fast highly efficient and robust one-step M-estimators of scale based on FQ n . Comput. Stat. Data Anal. 78, 153–158 (2014)

    Article  MathSciNet  Google Scholar 

  • Stigler, S.M.: The History of Statistics. Harvard University Press, Cambridge (1986)

    MATH  Google Scholar 

  • Tukey, J.W.: A survey of sampling from contaminated distributions. Contributions to Probability and Statistics, vol. 2, pp. 448–485. Stanford University Press, Stanford (1960)

    Google Scholar 

Download references

Acknowledgements

Here it is the right place to thank Prof. Hannu Oja who recommended one of the coauthors of this paper to use the term “independent component distributions” for the corresponding family of bivariate distributions. Also we thank him for the support of our research on robust correlation.

Furthermore, we thank the reviewers whose comments and remarks helped us much to improve our paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Georgy Shevlyakov .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Shevlyakov, G., Smirnov, P. (2015). M-Estimators of the Correlation Coefficient for Bivariate Independent Component Distributions. In: Nordhausen, K., Taskinen, S. (eds) Modern Nonparametric, Robust and Multivariate Methods. Springer, Cham. https://doi.org/10.1007/978-3-319-22404-6_9

Download citation

Publish with us

Policies and ethics