Dynamic information theory and information description of dynamic systems

Abstract

In this paper, we develop dynamic statistical information theory established by the author. Starting from the ideas that the state variable evolution equations of stochastic dynamic systems, classical and quantum nonequilibrium statistical physical systems and special electromagnetic field systems can be regarded as their information symbol evolution equations and the definitions of dynamic information and dynamic entropy, we derive the evolution equations of dynamic information and dynamic entropy that describe the evolution laws of dynamic information. These four kinds of evolution equations are of the same mathematical type. They show in unison when information transmits in coordinate space outside the systems that the time rate of change of dynamic information densities originates from their drift, diffusion and dissipation in state variable space inside the systems and coordinate space in the transmission processes, and that the time rate of change of dynamic entropy densities is caused by their drift, diffusion and production in state variable space inside the systems and coordinate space in the transmission processes. When space noise can be neglected, an information wave will appear. If we only consider the information change inside the systems, dynamic information evolution equations reduce to information equations corresponding to the dynamic equations which describe evolution laws of the above dynamic systems. This reveals that the evolution laws of respective dynamic systems can be described by information equations in a unified fashion. Hence, the evolution processes of these dynamic systems can be abstracted as the evolution processes of information. Furthermore, we present the formulas for information flow, information dissipation rate, and entropy production rate. We prove that the information production probably emerges in a dynamic system with internal attractive interaction between the elements, and derive a formula for this information production rate. Thereby, we obtain an expression for the time rate of total information change of a dynamic system, which is equal to the algebraic sum of the formulas for information dissipation rate, information production rate and information inflow rate, and which exhibits a unified information description for the evolution including degradation and self-organizing evolution of dynamic systems.