Abstract
By means of second-order asymptotic approximation, the paper clarifies the relationship between the Fisher information of first-order asymptotically efficient estimators and their decision-theoretic performance. It shows that if the estimators are modified so that they have the same asymptotic bias, the information amount can be connected with the risk based on convex loss functions in such a way that the greater information loss of an estimator implies its greater risk. The information loss of the maximum likelihood estimator is shown to be minimal in a general set-up. A multinomial model is used for illustration.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Akahira, M. and Takeuchi, K. (1981). Asymptotic Efficiency of Statistical Estimators: Concept and Higher Order Asymptotic Efficiency, Lecture Notes in Statistics, Springer, New York.
Akahira, M., Hirakawa, F. and Takeuchi, K. (1988). Second and Third Order Asymptotic Completeness of the Class of Estimators, Probability Theory and Mathematical Statistics, Lecture Notes in Mathematics 1299, 11–27, Springer, New York.
Bickel, P. J., Götze, F. and Van, Zwet, W. R. (1985). A simple analysis of third-order efficiency of estimates, Proc. Berkeley Conference in Honor of J. Neyman and J. Kiefer, Vol. II, (eds. L. M.Le, Cam and R. A., Olshen), 749–768, Wadsworth, Monterey.
Efron, B. (1982). Maximum likelihood and decision theory, Ann. Statist., 10, 340–356.
Fisher, R. A. (1925). Theory of statistical estimation. Proc. Camb. Phil. Soc., 22, 700–725.
Ghosh, J. K. and Subramanyam, K. (1974). Second order efficiency of maximum likelihood estimators, Sankhyā Ser. A., 36, 325–358.
Ghosh, J. K., Sinha, B. K. and Wieand, H. S. (1980). Second-order efficiency of the MLE with respect to any bowl-shaped loss function, Ann. Statist., 8, 506–521.
Hosoya, Y. (1979). High-order efficiency in the estimation of linear processes, Ann. Statist., 7, 516–530.
Hosoya, Y. (1988). The second-order Fisher information. Biometrika, 75, 265–274.
Kullback, S. (1959). Information Theory and Statistics, Wiley, New York.
Peers, H. W. (1978). Second-order sufficiency and statistical invariants, Biometrika, 65, 489–496.
Pfanzagl, J. and Wefelmeyer, W. (1978). A third-order optimum property of the maximum likelihood estimator. J.Multivariate Anal., 8, 1–29.
Rao, C. R. (1962). Efficient estimates and optimum inference procedures in large sample. J. Roy. Statist. Soc. Ser. B, 24, 26–72.
Takeuchi, K. (1982). Higher order asymptotic efficiency of estimators in decision procedures, Proc. III Purdue Symp. Decision Theory and Related Topics, Vol. II, 351–361, Academic Press.
Author information
Authors and Affiliations
About this article
Cite this article
Hosoya, Y. Information amount and higher-order efficiency in estimation. Ann Inst Stat Math 42, 37–49 (1990). https://doi.org/10.1007/BF00050777
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF00050777