Information Dynamics at a Phase Transition
We propose a new way of investigating phase transitions in the context of information theory. We use an information-entropic measure of spatial complexity known as configurational entropy (CE) to quantify both the storage and exchange of information in a lattice simulation of a Ginzburg–Landau model with a scalar order parameter coupled to a heat bath. The CE is built from the Fourier spectrum of fluctuations around the mean-field and reaches a minimum at criticality. In particular, we investigate the behavior of CE near and at criticality, exploring the relation between information and the emergence of ordered domains. We show that as the temperature is increased from below, the CE displays three essential scaling regimes at different spatial scales: scale free, turbulent, and critical. Together, they offer an information-entropic characterization of critical behavior where the storage and fidelity of information processing is maximized at criticality.
KeywordsInformation theory Complexity Phase transitions Critical phenomena Configurational entropy
DS was supported by a Hull Fellowship at Dartmouth College. MG was supported in part by a US Department of Energy Grant DE-SC001038.
- 1.Shannon, C.E.: The mathematical theory of communication. Bell Syst. Techn. J. 27:379–423, 623–656 (1948)Google Scholar
- 6.ibid.: Thermodynamics, statistics, and information. Am. J. Phys. 29, 318–328 (1961)Google Scholar
- 8.Leff, H.S., Rex, A.F. (eds.): Maxwell’s Demon: Entropy, Information, Computing. Princeton University Press, Princeton (1990)Google Scholar
- 18.Goldenfeld, N.: Lectures on Phase Transitions and The Renormalization Group. Frontiers in Physics, vol. 85. Addison-Wesley, New York (1992)Google Scholar
- 19.Landau, L.: On the theory of phase transitions. Zh. Eksp. Teor. Fiz. 7, 19–32 (1937)Google Scholar
- 20.Hunt, J.C.R., Philips, O.M., Williams, D. (eds.): Turbulence and Stochastic Processes: Kolmogorov’s Ideas 50 Years On, vol. 434, pp. 1–240. The Royal Society, London (1991)Google Scholar
- 21.Langer, J.S.: An introduction to the kinetics of first-order phase transitions. In: Godrche, G. (ed.) Solids Far from Equilibrium. Cambridge University Press, Cambridge (1992)Google Scholar