Abstract
We calculate the limiting behavior of relative Rényi entropy between adjacent two probability distribution in a non-regular location-shift family which is generated by a probability distribution whose support is an interval or a half-line. This limit can be regarded as a generalization of Fisher information, and seems closely related to information geometry and large deviation theory.
Similar content being viewed by others
References
Akahira M. (1996) Loss of information of a statistic for a family of non-regular distributions. Annals of the Institute of Statistical Mathematics 48(2): 349–364
Akahira, M., Takeuchi, K. (1995). Non-regular Statistical Estimation Lecture Notes in Statistics (Vol. 107). New York, Springer.
Amari S. (1984) Non-regular probability family and Finsler geometry. RIMS koukyuroku 6: 27 (in Japanese)
Amari S., Nagaoka H. (2000) Methods of Information Geometry. AMS and Oxford University Press, Providence
Chernoff H. (1952) A measure of asymptotic efficiency for tests of a hypothesis based on the sum of observations. Annals of Mathematical Statistics 23: 493–507
Csiszár I. (1967) On topological properties of f-divergence. Studia Scientiarum Mathematicarum Hungarica 2: 329–339
Hayashi, M. (2006). Two non-regular extensions of the large deviation bound, http://arxiv.org/abs/math.PR/0212076.
Hoeffding W. (1965) Asymptotically optimal test for multinomial distributions. Annals of Mathematical Statistics 36: 369–400
Ibragimov I.A., Has’minskii R.Z. (1981) Statistical Estimation. Springer, New York
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Hayashi, M. Limiting behavior of relative Rényi entropy in a non-regular location shift family. Ann Inst Stat Math 62, 547–569 (2010). https://doi.org/10.1007/s10463-008-0182-4
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10463-008-0182-4