Skip to main content

Robustification of the MLE without Loss of Efficiency

  • Chapter
  • 1873 Accesses

Part of the book series: Understanding Complex Systems ((UCS))

Summary

A robust procedure, which produces the maximum likelihood estimator when the data are in conformity with the parametric model, and generates the outlier deleted maximum likelihood estimator under the presence of extreme outliers, has obvious intuitive appeal to the practising scientist. None of the currently available robust estimators achieves this automatically. Here we propose a density-based divergence belonging to the family of disparities ([7]) where the corresponding weighted likelihood estimator ([10], [11]) exhibits this desirable behavior for proper choices of tuning parameters. Some properties of the corresponding estimation procedure are discussed and illustrated through examples.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Agostinelli, C., Markatou, M.: Test of hypotheses based on the Weighted Likelihood Methodology. Statistica Sinica 11, 499–514 (2001)

    MATH  MathSciNet  Google Scholar 

  2. Ali, S.M., Silvey, S.D.: A general class of coefficients of divergence of one distribution from another. J. Royal Statist. Soc. Ser. B 28, 131–142 (1966)

    MATH  MathSciNet  Google Scholar 

  3. Basu, A., Lindsay, B.G.: Minimum disparity estimation in the continuous case: efficiency, distributions, robustness. Ann. Inst. Statist. Math. 46, 683–705 (1994)

    Article  MATH  MathSciNet  Google Scholar 

  4. Basu, A., Sarkar, S., Vidyashankar, A.N.: Minimum negative exponential disparity estimation in parametric models. J. Statist. Plan. Infer. 58, 349–370 (1997)

    Article  MATH  MathSciNet  Google Scholar 

  5. Beran, R.J.: Minimum Hellinger distance estimates for parametric models. Ann. Statist. 5, 445–463 (1977)

    Article  MATH  MathSciNet  Google Scholar 

  6. Csiszár, I.: Eine informationstheoretische Ungleichung und ihre Anwendung auf den Beweis der Ergodizitat von Markoffschen Ketten. Publ. Math. Inst. Hungar. Acad. Sci. 3, 85–107 (1963)

    Google Scholar 

  7. Lindsay, B.G.: Efficiency versus robustness: the case for minimum Hellinger distance and related methods. Ann. Statist. 22, 1081–1114 (1994)

    Article  MATH  MathSciNet  Google Scholar 

  8. Mandal, A.: Minimum Disparity Inference: Strategies for Improvement in Efficiency. PhD Thesis, Indian Statistical Institute, Kolkata, India (2010)

    Google Scholar 

  9. Mandal, A., Bhandari, S.K., Basu, A.: Minimum disparity estimation based on combined disparities: Asymptotic results. J. Statist. Plan. Infer. 141, 701–710 (2011)

    Article  MATH  MathSciNet  Google Scholar 

  10. Markatou, M., Basu, A., Lindsay, B.G.: Weighted likelihood estimating equations: the discrete case with applications to logistic regression. J. Statist. Plan. Infer. 57, 215–232 (1997)

    Article  MATH  MathSciNet  Google Scholar 

  11. Markatou, M., Basu, A., Lindsay, B.G.: Weighted likelihood equations with bootstrap root search. J. Amer. Statist. Assoc. 93, 740–750 (1998)

    Article  MATH  MathSciNet  Google Scholar 

  12. Pardo, L.: Statistical Inference Based on Divergence Measures. Chapman & Hall/CRC, New York (2006)

    MATH  Google Scholar 

  13. Simpson, D.G.: Minimum Hellinger distance estimation for the analysis of count data. J. Amer. Statist. Assoc. 82, 802–807 (1987)

    Article  MATH  MathSciNet  Google Scholar 

  14. Stigler, S.M.: Do robust estimators work with real data? Ann. Statist. 5, 1055–1098 (1977)

    Article  MATH  MathSciNet  Google Scholar 

  15. Tamura, R.N., Boos, D.D.: Minimum Hellinger distance estimation for multivariate location and covariance. J. Amer. Statist. Assoc. 81, 223–229 (1986)

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Chakraborty, B., Sarkar, S., Basu, A. (2011). Robustification of the MLE without Loss of Efficiency. In: Pardo, L., Balakrishnan, N., Gil, M.Á. (eds) Modern Mathematical Tools and Techniques in Capturing Complexity. Understanding Complex Systems. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-20853-9_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-20853-9_29

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-20852-2

  • Online ISBN: 978-3-642-20853-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics