Summary
The Neyman-Pearson Lemma describes a test for two simple hypotheses that, for a given sample size, is most powerful for its level. It is usually implemented by choosing the smallest sample size that achieves a prespecified power for a fixed level. The Lemma does not describe how to select either the level or the power of the test. In the usual Wald decision-theoretic structure there exists a sampling cost function, an initial prior over the hypothesis space and various payoffs to right/wrong hypothesis selections. The optimal Wald test is a Bayes decision rule that maximizes the expected payoff net of sampling costs. This paper shows that the Wald-optimal test and the Neyman-Pearson test can be the same and how the Neyman-Pearson test, with fixed level and power, can be viewed as a Wald test subject to restrictions on the payoff vector, cost function and prior distribution.
Similar content being viewed by others
References
Berger JO (1985) Statistical decision theory and Bayesian analysis, 2nd edn. Springer-Verlag, New York
Cressie N, Morgan PB (1986) The VPRT: A sequential testing procedure dominating the SPRT. Preprint 86-17, Statistical Laboratory, Iowa State University
DeGroot MH (1970) Optimal statistical decisions. McGraw-Hill, New York
Hald A (1981) Statistical theory of sampling inspection by attributes. Academic Press, London
Lehmann EL (1958) Significance level and power. The Annals of Mathematical Statistics 29: 1167–1176
Neyman J, Pearson ES (1933) On the problem of the most efficient tests of statistical hypotheses. Philosophical Transactions of the Royal Society, A 231: 140–185
Wald A (1950) Statistical decision functions. Wiley, New York
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Cressie, N., Morgan, P.B. Design considerations for neyman-pearson and wald hypothesis testing. Metrika 36, 317–325 (1989). https://doi.org/10.1007/BF02614105
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02614105