Abstract
Many stochastic complex systems are characterized by the fact that their configuration space doesn’t grow exponentially as a function of the degrees of freedom. The use of scaling expansions is a natural way to measure the asymptotic growth of the configuration space volume in terms of the scaling exponents of the system. These scaling exponents can, in turn, be used to define universality classes that uniquely determine the statistics of a system. Every system belongs to one of these classes. Here we derive the information geometry of scaling expansions of sample spaces. In particular, we present the deformed logarithms and the metric in a systematic and coherent way. We observe a phase transition for the curvature. The phase transition can be well measured by the characteristic length r, corresponding to a ball with radius 2r having the same curvature as the statistical manifold. Increasing characteristic length with respect to size of the system is associated with sub-exponential sample space growth which is related to strongly constrained and correlated complex systems. Decreasing of the characteristic length corresponds to super-exponential sample space growth that occurs for example in systems that develop structure as they evolve. Constant curvature means exponential sample space growth that is associated with multinomial statistics, and traditional Boltzmann-Gibbs, or Shannon statistics applies. This allows us to characterize transitions between statistical manifolds corresponding to different families of probability distributions.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
S. Thurner, R. Hanel, P. Klimek,Introduction to the Theory of Complex Systems (Oxford University Press, Oxford, UK, 2018)
S. Thurner, B. Corominas-Murtra, R. Hanel, Phys. Rev. E 96, 032124 (2017)
N. Ay, J. Jost, H.V. Le, L. Schwachhöfer,Information Geometry (Springer, Berlin, Germany, 2017)
S.-I. Amari,Information Geometry and Its Applications (Springer, Japan, 2016)
W. Janke, D.A. Johnston, R. Kenna, Physica A 336, 181 (2004)
C. Tsallis, J. Stat. Phys. 52, 479 (1988)
C. Tsallis, M. Gell-Mann, Y. Sato, Proc. Natl. Acad. Sci. USA 102, 15377 (2005)
G. Kaniadakis, Phys. Rev. E 66, 056125 (2002)
P. Jizba, T. Arimitsu, Ann. Phys. 312, 17 (2004)
C. Tsallis, L.J. Cirto, Eur. Phys. J. C 73, 2487 (2013)
T.S. Biró, V.G. Czinner, H. Iguchi, P. Ván, Phys. Lett. B 782, 228 (2018)
C.E. Shannon, Bell Syst. Tech. J. 27, 379 (1948)
C.E. Shannon, Bell Syst. Tech. J. 27, 623 (1948)
A.I. Khinchin,Mathematical Foundations of Information Theory (Dover, New York, 1957)
S. Abe, Phys. Lett. A 271, 74 (2000)
V.M. Ilić, M.S. Stanković, Physica A 411, 138 (2014)
P. Tempesta, Phys. Rev. E 84, 021121 (2011)
P. Jizba, J. Korbel, Phys. Rev. Lett. 122, 120601 (2019)
R. Hanel, S. Thurner, Europhys. Lett. 93, 2006 (2011)
R. Hanel, S. Thurner, Europhys. Lett. 96, 50003 (2011)
C. Anteneodo, A.R. Plastino, J. Phys. A 32, 1089 (1999)
H.J. Jensen, R.H. Pazuki, G. Pruessner, P. Tempesta, J. Phys. A 51, 375002 (2018)
J. Korbel, R. Hanel, S. Thurner, New J. Phys. 20, 093007 (2018)
E.T. Copson,Asymptotic Expansions, Cambridge Tracts in Mathematics (Cambridge University Press, 1965)
J. Naudts, Physica A 316, 323 (2002)
J. Naudts,Generalised thermostatistics (Springer Science & Business Media, 2011)
J. Korbel, R. Hanel, S. Thurner, Entropy 21, 112 (2019)
C. Beck, F. Schögl,Thermodynamics of chaotic systems: an introduction (Cambridge University Press, 1995)
C. Beck, E.D.G. Cohen, Physica A 322, 267 (2003)
C. Tsallis, A.M.C. Souza, Phys. Rev. E 67, 026106 (2003)
R. Hanel, S. Thurner, M. Gell-Mann, Proc. Natl. Acad. Sci. USA 109, 19151 (2012)
S. Abe, Phys. Rev. E 68, 031101 (2003)
A. Ohara, H. Matsuzoe, S.-I. Amari, J. Phys.: Conf. Ser. 201, 012012 (2010)
S.-I. Amari, A. Ohara, H. Matsuzoe, Physica A 391, 4308 (2012)
D.P.K. Ghikas, F.D. Oikonomou, Physica A 496, 384 (2018)
J. Naudts, Rev. Math. Phys. 16, 809 (2004)
F. Caruso, C. Tsallis, Phys. Rev. E 78, 021102 (2008)
J.A. Carrasco, F. Finkel, A. González-López, M.A. Rodríguez, P. Tempesta, J. Stat. Mech. Theor. Exp. 2016, 033114 (2016)
J. Zhang, Neural Comput. 16, 159 (2004)
S.-I. Amari,Differential-Geometrical Methods in Statistics. Lecture Notes in Statistics (Springer Science & Business Media, 2012), Vol. 28
B. Corominas-Murtra, R. Hanel, S. Thurner, Proc. Natl. Acad. Sci. USA 112, 5348 (2015)
B. Corominas-Murtra, R. Hanel, S. Thurner, New J. Phys. 18, 093010 (2016)
B. Corominas-Murtra, R. Hanel, S. Thurner, Sci. Rep. 7, 11223 (2017)
R. Hanel, S. Thurner, Entropy 20, 838 (2018)
J. Naudts, J. Zhang, Inf. Geometry 1, 79 (2018)
G. Ruppeiner, Rev. Mod. Phys. 67, 605 (1995)
G.E. Crooks, Phys. Rev. Lett. 99, 100602 (2007)
R. Hanel, S. Thurner, Physica A 351, 260 (2005)
S. Ito, Phys. Rev. Lett. 121, 030605 (2018)
Acknowledgments
Open access funding provided by Medical University of Vienna.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Korbel, J., Hanel, R. & Thurner, S. Information geometry of scaling expansions of non-exponentially growing configuration spaces. Eur. Phys. J. Spec. Top. 229, 787–807 (2020). https://doi.org/10.1140/epjst/e2020-900190-x
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1140/epjst/e2020-900190-x