Some Results on a χ-divergence, an Extended Fisher Information and Generalized Cramér-Rao Inequalities

  • Jean-François Bercher
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8085)

Abstract

We propose a modified χβ-divergence, give some of its properties, and show that this leads to the definition of a generalized Fisher information. We give generalized Cramér-Rao inequalities, involving this Fisher information, an extension of the Fisher information matrix, and arbitrary norms and power of the estimation error. In the case of a location parameter, we obtain new characterizations of the generalized q-Gaussians, for instance as the distribution with a given moment that minimizes the generalized Fisher information. Finally we indicate how the generalized Fisher information can lead to new uncertainty relations.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Abe, S.: Geometry of escort distributions. Physical Review E 68(3), 031101 (2003)CrossRefGoogle Scholar
  2. 2.
    Amari, S.I.: α-divergence is unique, belonging to both f-divergence and Bregman divergence classes. IEEE Transactions on Information Theory 55(11), 4925–4931 (2009)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Barankin, E.W.: Locally best unbiased estimates. The Annals of Mathematical Statistics 20(4), 477–501 (1949)MathSciNetMATHCrossRefGoogle Scholar
  4. 4.
    Beck, C., Schloegl, F.: Thermodynamics of Chaotic Systems. Cambridge University Press (1993)Google Scholar
  5. 5.
    Bercher, J.F.: Source coding with escort distributions and Rényi entropy bounds. Physics Letters A 373(36), 3235–3238 (2009)MathSciNetMATHCrossRefGoogle Scholar
  6. 6.
    Bercher, J.F.: Some properties of generalized Fisher information in the context of nonextensive thermostatistics. Physica A: Statistical Mechanics and its Applications 392(15), 3140–3154 (2013), http://hal.archives-ouvertes.fr/hal-00766699 Google Scholar
  7. 7.
    Bercher, J.F.: On multidimensional generalized Cramér-Rao inequalities, uncertainty relations and characterizations of generalized q-Gaussian distributions. Journal of Physics A: Mathematical and Theoretical 46(9), 095303 (2013), http://hal-upec-upem.archives-ouvertes.fr/hal-00766695 Google Scholar
  8. 8.
    Chhabra, A., Jensen, R.V.: Direct determination of the f(f(α)) singularity spectrum. Physical Review Letters 62(12), 1327 (1989)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Cordero-Erausquin, D., Nazaret, B., Villani, C.: A mass-transportation approach to sharp Sobolev and Gagliardo-Nirenberg inequalities. Advances in Mathematics 182(2), 307–332 (2004)MathSciNetMATHCrossRefGoogle Scholar
  10. 10.
    Del Pino, M., Dolbeault, J.: Best constants for Gagliardo-Nirenberg inequalities and applications to nonlinear diffusions. Journal de Mathématiques Pures et Appliquées 81(9), 847–875 (2002)MATHCrossRefGoogle Scholar
  11. 11.
    Liese, F., Miescke, K.J.: Statistical Decision Theory: Estimation, Testing, and Selection. Springer (June 2008)Google Scholar
  12. 12.
    Lutwak, E., Lv, S., Yang, D., Zhang, G.: Extensions of Fisher information and Stam’s inequality. IEEE Transactions on Information Theory 58(3), 1319–1327 (2012)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Lutz, E.: Anomalous diffusion and Tsallis statistics in an optical lattice. Physical Review A 67(5), 051402 (2003)Google Scholar
  14. 14.
    Ohara, A., Matsuzoe, H., Amari, S.I.: A dually flat structure on the space of escort distributions. Journal of Physics: Conference Series 201, 012012 (2010)Google Scholar
  15. 15.
    Schwämmle, V., Nobre, F.D., Tsallis, C.: q-Gaussians in the porous-medium equation: stability and time evolution. The European Physical Journal B-Condensed Matter and Complex Systems 66(4), 537–546 (2008)Google Scholar
  16. 16.
    Tsallis, C.: Introduction to Nonextensive Statistical Mechanics. Springer (April 2009)Google Scholar
  17. 17.
    Vajda, I.: χ a-divergence and generalized Fisher information. In: Transactions of the Sixth Prague Conference on Information Theory, Statistical Decision Functions and Random Processes, pp. 873–886 (1973)Google Scholar
  18. 18.
    Vázquez, J.L.: Smoothing and Decay Estimates for Nonlinear Diffusion Equations: Equations of Porous Medium Type. Oxford University Press, USA (2006)Google Scholar
  19. 19.
    Weinstein, E., Weiss, A.: A general class of lower bounds in parameter estimation. IEEE Transactions on Information Theory 34(2), 338–342 (1988)MathSciNetMATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Jean-François Bercher
    • 1
  1. 1.Laboratoire d’Informatique Gaspard Monge, UMR 8049Université Paris-Est, ESIEENoisy-le-Grand CedexFrance

Personalised recommendations