Abstract
Powerful entropy-based tests for normality, uniformity and exponentiality have been well addressed in the statistical literature. The density-based empirical likelihood approach improves the performance of these tests for goodness-of-fit, forming them into approximate likelihood ratios. This method is extended to develop two-sample empirical likelihood approximations to optimal parametric likelihood ratios, resulting in an efficient test based on samples entropy. The proposed and examined distribution-free two-sample test is shown to be very competitive with well-known nonparametric tests. For example, the new test has high and stable power detecting a nonconstant shift in the two-sample problem, when Wilcoxon’s test may break down completely. This is partly due to the inherent structure developed within Neyman-Pearson type lemmas. The outputs of an extensive Monte Carlo analysis and real data example support our theoretical results. The Monte Carlo simulation study indicates that the proposed test compares favorably with the standard procedures, for a wide range of null and alternative distributions.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Albers, W., Kallenberg, W.C.M., Martini, F.: Data-driven rank tests for classes of tail alternatives. J. Am. Stat. Assoc. 96, 685–696 (2001)
Arizono, I., Ohta, H.: A test for normality based on Kullback-Leibler information. Am. Stat. 43, 20–22 (1989)
Birnbaum, Z.W., Hall, R.A.: Small sample distributions for multi-sample statistics of the Smirnov type. Ann. Math. Stat. 31, 710–720 (1960)
Canner, P.L.: A simulation study of one-and two-sample Kolmogorov-Smirnov statistics with a particular weight function. J. Am. Stat. Assoc. 70, 209–211 (1975)
Dudewicz, E.J., Van Der Meulen, E.C.: Entropy-based tests of uniformity. J. Am. Stat. Assoc. 76, 967–974 (1981)
Ebrahami, N., Habibullah, M., Soofi, E.S.: Testing exponentiality based on Kullback-Leibler information. J. R. Stat. Soc. B 54, 739–748 (1992)
Hall, P., Welsh, A.H.: A test for normality based on the empirical characteristic function. Biometrika 70, 485–489 (1983)
Lazar, N.A., Mykland, P.A.: An evaluation of the power and conditionality properties of empirical likelihood. Biometrika 85, 523–534 (1998)
Lehmann, E.L., Romano, J.P.: Testing Statistical Hypotheses, 3rd edn. Springer, New York (2005)
Massey, F.: The distribution of the maximum deviation between two sample cumulative step functions. Ann. Math. Stat. 22, 125–128 (1951)
Mudholkar, G.S., Tian, L.: An entropy characterization of the inverse Gaussian distribution and related goodness-of-fit test. J. Stat. Plan. Inference 102, 211–221 (2002)
Mudholkar, G.S., Tian, L.: A test for homogeneity of ordered means of inverse Gaussian populations. J. Stat. Plan. Inference 118, 37–49 (2004)
Owen, A.B.: Empirical Likelihood. Chapman and Hall/CRC, London (2001)
Schisterman, E.F., Faraggi, D., Browne, R., Freudenheim, J., Dorn, J., Muti, P., Armstrong, D., Reiser, B., Trevisan, M.: TBARS and cardiovascular disease in a population-based sample. J. Cardiovasc. Risk 8, 219–225 (2001)
Serfling, R.J.: Approximation Theorems of Mathematical Statistics. Wiley, New York (1980)
Tusnady, G.: On asymptotically optimal tests. Ann. Stat. 5, 385–393 (1977)
van Es, B.: Estimating functionals related to a density by a class of statistics based on spacings. Scand. J. Stat. 19, 61–72 (1992)
Vasicek, O.: A test for normality based on sample entropy. J. R. Stat. Soc. B 38, 54–59 (1976)
Vexler, A., Gurevich, G.: Empirical likelihood ratios applied to goodness-of-fit tests based on sample entropy. Comput. Stat. Data Anal. 54, 531–545 (2010)
Vexler, A., Liu, A., Schisterman, E.F., Wu, C.: Note on distribution-free estimation of maximum linear separation of two multivariate distributions. J. Nonparametr. Stat. 18, 145–158 (2006)
Vexler, A., Wu, C., Yu, K.F.: Optimal hypothesis testing: from semi to fully Bayes factors. Metrika 71, 125–138 (2010)
Yu, J., Vexler, A., Tian, L.: Analyzing incomplete data subject to a threshold using empirical likelihood methods: an application to a pneumonia risk study in an ICU setting. Biometrics 66, 123–130 (2010)
Zhang, J.: Powerful goodness-of-fit tests based on the likelihood ratio. J. R. Stat. Soc. B 64, 281–294 (2002)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gurevich, G., Vexler, A. A two-sample empirical likelihood ratio test based on samples entropy. Stat Comput 21, 657–670 (2011). https://doi.org/10.1007/s11222-010-9199-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11222-010-9199-7