Memory systems, computation, and the second law of thermodynamics
- David H. Wolpert
- … show all 1 hide
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.Get Access
A memory is a physical system for transferring information from one moment in time to another, where that information concerns something external to the system itself. This paper argues on information-theoretic and statistical mechanical grounds that useful memories must be of one of two types, exemplified by memory in abstract computer programs and by memory in photographs. Photograph-type memories work by exploiting a collapse of state space flow to an attractor state. (This attractor state is the “initialized” state of the memory.) The central assumption of the theory of reversible computation tells us that inany such collapsing, regardless of whether the collapsing proceeds from the past to the future or vice versa, the collapsing must increase the entropy of the system. In concert with the second law, this establishes the logical necessity of the empirical observation that photograph-type memories are temporally asymmetric (they can tell us about the past but not about the future). Under the assumption that human memory is a photograph-type memory, this result also explains why we humans can remember only our past and not our future. In contrast to photograph-type memories, computer-type memories do not require any initialization, and therefore are not directly affected by the second law. As a result, computer memories can be of the future as easily as of the past, even if the program running on the computer is logically irreversible. This is entirely in accord with the well-known temporal reversibility of the process of computation. This paper ends by arguing that the asymmetry of the psychological arrow of time is a direct consequence of the asymmetry of human memory. With the rest of this paper, this explains, explicitly and rigorously, why the psychological and thermodynamic arrows of time are correlated with one another.
- Bennett, C. H. (1982).International Journal of Theoretical Physics,21, 905.
- Bennett, C. H. (1988).IBM Journal of Research and Development,19(1), 16–24.
- Bitbol, M. (1988).Philosophy of Science,55, 349–375.
- Davies, P. C. W. (1974).The Physics of Time Asymmetry, University of California Press, Berkeley, California.
- Everett III, H. (1957).Review of Modem Physics,29, 454–462.
- Fredkin, E., and Toffoli, T. (1982).International Jorunal of Theoretical Physics,21, 219.
- Gold, T. (ed.) (1967).The Nature of Time, Cornell University Press, Ithaca, New York.
- Hawking, S. W. (1988). Cambridge University Report, 2/88 (no report number).
- Jaynes, E. T. (1957a).Physical Review,106, 620–630.
- Jaynes, E. T. (1957b).Physical Review,108, 171–190.
- Jaynes, E. T. (1982).Proceedings of the IEEE,70, 939–952.
- Landauer, R. (1961).IBM Journal of Research and Development,5, 183.
- Landauer, R. (1985).Annals of New York Academy of Sciences,426, 2.1.
- Layzer, D. (1976).Astrophysical Journal,206, 559–569.
- Pearl, J., and Crolotte, A. (1980).IEEE Transactions on Information Theory,26, 633.
- Penrose, R. (1989).The Emperor's New Mind, Oxford University Press, Oxford.
- Popper, K. (1965).Nature,207, 233–234.
- Skilling, J. (1989a). Classic maximum entropy, inMaximum Entropy and Bayesian Methods, J. Skilling, ed., Kluwer, Dordrecht, Holland.
- Skilling, J. (ed.) (1989b).Maximum Entropy and Bayesian Methods, Kluwer, Dordrecht, Holland.
- Smith, C. R., and Erickson, G. (1989). From rationality and consistency to Bayesian probability, inMaximum Entropy and Bayesian Methods, Kluwer, Dordrecht, Holland.
- Wheeler, J. A., and Zurek, W. H. (1983).Quantum Theory and Measurement, Princeton University Press, Princeton, New Jersey, pp. 785–786.
- Wolpert, D. (1988).Nature,335, 595.
- Wolpert, D. (1989). A consistent statistics for proving the second law of thermodynamics, Los Alamos National Laboratory Report LA-UR-90-954.
- Wolpert, D. H. (1990). The relationship between logical erasure and thermodynamic irreversibility, Loss Alamos National Laboratory report LA-UR-90-4108.
- Memory systems, computation, and the second law of thermodynamics
International Journal of Theoretical Physics
Volume 31, Issue 4 , pp 743-785
- Cover Date
- Print ISSN
- Online ISSN
- Kluwer Academic Publishers-Plenum Publishers
- Additional Links
- Industry Sectors
- David H. Wolpert (1)
- Author Affiliations
- 1. Theoritical Division and Center for Non-liner Studies, MS B213, Los Alamos National Laboratory, 87545, Los Alamos, New Mexico