Skip to main content
Log in

A small sample study of the moments and distribution of the log likelihood ratio statistic

  • Publications
  • Published:
Metrika Aims and scope Submit manuscript

Abstract

A study of the first four moments of the log likelihood ratio statistic suggests that a transformed Beta ranks as a serious competitor to the Chi-square as an approximating distribution for certain multinomials. An error analysis of the series approximations of these moments indicates that the equiprobable case is not of sufficient generality for the study of multinomial type statistics.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Baker GA Jr (1975) Essentials of Padé approximants. Academic Press, New York

    MATH  Google Scholar 

  • Bouver H, Bargmann RE (1975) Computational algorithms and modules for the evaluation of statistical distribution functions. University of Georgia, Department of Statistics and Computer Science. Technical Report Number 110

  • Chapman JW (1976) A comparison of theX 2, −2 logR and multinomial probability criteria for significance tests when expected frequencies are small. Journal of the American Statistical Association 71:845–863

    Article  Google Scholar 

  • Craig CC (1936) A new exposition and chart for the Pearson system of frequency curves. The Annals of Mathematical Statistics 7:16–28

    Google Scholar 

  • Fisher RA (1938) Statistical methods for research workers, 7th ed. Oliver and Boyd, Edinburgh London

    MATH  Google Scholar 

  • Good IJ (1953) The population frequencies of species and the estimation of population parameters. Biometrika 40:237–264

    MATH  MathSciNet  Google Scholar 

  • Good IJ, Gover TM, Mitchel GJ (1970) Exact distributions forX 2 and for the likelihood ratio statistic for the equiprobable multinomial distribution. Journal of the American Statistical Association 65:267–283

    Article  Google Scholar 

  • Hutcheson K (1977) Some exact moments of minus twice the logarithm of the likelihood ratio for multinomial distributions. Journal of Statistical Computation and Simulation 6:149–152

    MathSciNet  Google Scholar 

  • Hutcheson K, Lyons NI (1979) The mean and variance of the likelihood ratio criterion for the multinomial distribution. Metrika 26:57–61

    Article  MATH  Google Scholar 

  • Kallenberg WCM, Oosterhoff J, Schriever BF (1985) The number of classes in chi-squared goodness-of-fit tests. Journal of the American Statistical Association 80:959–968

    Article  MATH  MathSciNet  Google Scholar 

  • Koehler KJ, Larntz K (1980) An empirical investigation of goodness of fit statistics for sparse multinomials. Journal of the American Statistical Association 75:336–342

    Article  MATH  Google Scholar 

  • Larntz K (1978) Small sample comparisons of exact levels for chi-squared goodness of fit statistics. Journal of the American Statistical Association 73:253–263

    Article  MATH  Google Scholar 

  • Neyman J, Pearson ES (1931) Further notes on theX 2 distribution. Biometrika 22:296–305

    Google Scholar 

  • Neyman J (1949) Contributions to the theory of theX 2-test. Proceedings of the Berkeley Symposium, pp 239–273

  • Pearson K (1900) On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling. Philosophical Magazine. No 5. 50:157–172

    Google Scholar 

  • Schäffer KA (1957) The likelihood test for fit. Mittbl Math Statistic 9:27–54

    Google Scholar 

  • Shenton LR, Bowman KO (1977) Maximum likelihood estimation in small samples. MacMillan, New York

    MATH  Google Scholar 

  • Smith PJ, Rae DS, Manderscheid RW, Silbergeld S (1981) Approximating the moments and distribution of the likelihood ratio statistic for multinomial goodness of fit. Journal of the American Statistical Association 76:737–740

    Article  MATH  Google Scholar 

  • Sugg MN, Hutcheson K (1976) Gauss-Krawtchouk quadrature approximations for moments of multinomial type distributions. Biometrika 63:395–400

    Article  MATH  MathSciNet  Google Scholar 

  • Uppuluri VR, Rao, Bowman KO (1966) Likelihood ratio test criterion for small samples from multinomial distributions. ORNL-3991

  • West EN, Kempthorne O (1972) A comparison of the Chi2 and likelihood ratio tests for composite alternatives. Journal of Statistical Computation and Simulation 1:1–33

    MATH  MathSciNet  Google Scholar 

  • Wilks SS (1938) The large-sample distribution of the likelihood ratio for testing composite hypotheses. The Annals of Mathematical Statistics 9:60–62

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

This research was partially supported by the Air Force Office of Scientific Research under grant number AFOSR-85-0161.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lyons, N.I., Hutcheson, K. & Sugg, M.N. A small sample study of the moments and distribution of the log likelihood ratio statistic. Metrika 36, 195–207 (1989). https://doi.org/10.1007/BF02614092

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02614092

Key words

Navigation