Abstract
The word “entropy” was coined by the German physicist R. Clausius (1822–1888), who introduced it in thermodynamics in 1865 to measure the amount of energy in a system that cannot produce work. The fact that the entropy of an isolated system never decreases constitutes the second law of thermodynamics and clearly shows the central role of entropy in many-particle physics. The direction of time is then explained as a consequence of the increase of entropy in all irreversible processes. Later on the concept of entropy was given a microscopic interpretation in the foundational works of L. Boltzmann (1844–1906) on gas kinetics and statistical mechanics [184]. The celebrated Boltzmann’s equation reads in the usual physical notation
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
J.M. Amigó, J. Szczepanski, E. Wajnryb, and M.V. Sanchez-Vives, Estimating the entropy of spike trains via Lempel-Ziv complexity, Neural Computation 16 (2004) 717–736.
C. Bandt and B. Pompe, Permutation entropy: A natural complexity measure for time series, Physical Review Letters 88 (2002) 174102.
C. Bandt, G. Keller, and B. Pompe, Entropy of interval maps via permutations. Nonlinearity 15 (2002) 1595–1602.
M. Buhl and M.B. Kennel, Statistically relaxing to generating partitions for observed time-series data, Physical Review E 71 (2005) 046213: 1–14.
Y. Cao, W. Tung, J.B. Gao, V.A. Protopopescu, and L.M. Hively, Detecting dynamical changes in time series using the permutation entropy, Physical Review E 70 (2004) 046217.
G.H. Choe, Computational Ergodic Theory. Springer Verlag, Berlin, 2005.
T.M. Cover and J.A. Thomas, Elements of Information Theory, 2nd edition. New York, John Wiley & Sons, 2006.
K. Denbigh, How subjective is entropy. In: H.S. Leff and A.F. Rex (Ed.), Maxwell’s Demon, Entropy, Information, Computing, pp. 109–115. Princeton University Press, Princeton, 1990.
R.M. Gray, Entropy and Information Theory. Springer Verlag, New York, 1990.
A. Katok and B. Hasselbaltt, Introduction to the Theory of Dynamical Systems. Cambridge University Press, Cambridge, 1998.
M.B. Kennel and A.I. Mees, Context-tree modeling of observed symbolic dynamics, Physical Review E 66 (2002) 056209.
M.B. Kennel, J. Shlens, H.D.I. Abarbanel, and E.J. Chichilnisky, Estimating entropy rates with Bayesian confidence intervals, Neural Computation 17 (2005) 1531–1576.
A.N. Kolmogorov, Entropy per unit time as a metric invariant of automorphism, Doklady of Russian Academy of Sciences 124 (1959) 754–755.
I. Kontoyiannis, P.H. Algoet, Y.M. Suhov, and A.J. Wyner, Nonparametric entropy estimation for stationary processes and random fields, with applications to English text. IEEE Transactions on Information Theory 44 (1998) 1319–1327.
A. Lempel and J. Ziv, On the complexity of an individual sequence, IEEE Transactions on Information Theory IT-22 (1976) 75–78.
L. Paninski, Estimation of entropy and mutual information, Neural Computation 15 (2003) 1191–1253.
R. Sexl and J. Blackmore (Eds.), Ludwig Boltzmann - Ausgewahlte Abhandlungen (Ludwig Boltzmann Gesamtausgabe, Band 8). Vieweg, Braunschweig, 1982.
C.E. Shannon, A mathematical theory of communication, Bell System Technical Journal 27 (1948) 379–423, 623–653.
Y.G. Sinai, On the Notion of Entropy of a Dynamical System, Doklady of Russian Academy of Sciences 124 (1959) 768–771.
S.P. Strong, R. Koberle, R.R. de Ruyter van Steveninck, and W. Bialek, Entropy and information in neural spike trains. Physical Review Letters 80 (1998) 197–200.
J. Ziv and A. Lempel, Compression of individual sequences via variable-rate coding IEEE Transactions on Information Theory IT-24 (1978) 530–536.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Amigó, J.M. (2010). Metric Permutation Entropy. In: Permutation Complexity in Dynamical Systems. Springer Series in Synergetics. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04084-9_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-04084-9_6
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04083-2
Online ISBN: 978-3-642-04084-9
eBook Packages: Physics and AstronomyPhysics and Astronomy (R0)