Abstract.
We study how statistical complexity depends on the system size and how the complexity of the whole system relates to the complexity of its subsystems. We study this size dependence for two well-known complexity measures, the excess entropy of Grassberger and the neural complexity introduced by Tononi, Sporns and Edelman. We compare these results to properties of complexity measures that one might wish to impose when seeking an axiomatic characterization. It turns out that those two measures do not satisfy all those requirements, but a renormalized version of the TSE-complexity behaves reasonably well.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
L. Löfgren, Int. J. Gen. Syst. 3, 197 (1977)
M. Li, P.M.B. Vitányi, An Introduction to Kolmogorov Complexity and its Applications, 2nd edn. (Springer, 1997)
J.P. Crutchfield, K. Young, Phys. Rev. Lett. 63, 105 (1989)
P. Grassberger, Int. J. Theor. Phys. 25, 907 (1986)
N. Ay, E. Olbrich, N. Bertschinger, J. Jost, A unifying framework for complexity measures of finite systems, Working Paper 06-08-028, Santa Fe Institute, Proceedings of ECCS'06 (2006)
J.P. Crutchfield, D.P. Feldman, Chaos 13, 25 (2003)
G. Tononi, O. Sporns, G.M. Edelman, PNAS 91, 5033 (1994)
T.M. Cover, J.A. Thomas, Elements of Information Theory, Wiley series in telecommunications (Wiley, New York, 1991)
W. Bialek, I. Nemenman, N. Tishby, Neural Computation 13, 2409 (2001)
G. Tononi, O. Sporns, G.M. Edelman, PNAS 96, 3257 (1999)
G. Tononi, G.M. Edelman, Science 282, 1846 (1998)
G. Tononi, BMC Neurosci 5, 42 (2004)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Olbrich, E., Bertschinger, N., Ay, N. et al. How should complexity scale with system size?. Eur. Phys. J. B 63, 407–415 (2008). https://doi.org/10.1140/epjb/e2008-00134-9
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1140/epjb/e2008-00134-9