Skip to main content

Explanation, prediction, description, and information theory

Abstract

The distinction between explanation and prediction has received much attention in recent literature, but the equally important distinction between explanation and description (or between prediction and description) remains blurred. This latter distinction is particularly important in the social sciences, where probabilistic models (or theories) often play dual roles as explanatory and descriptive devices. The distinction between explanation (or prediction) and description is explicated in the present paper in terms of information theory. The explanatory (or predictive) power of a probabilistic model is identified with information taken from (or transmitted by) the environment (e.g., the independent, experimentally manipulated variables), while the descriptive power of a model reflects additional information taken from (or transmitted by) the data. Although information is usually transmitted by the data in the process of estimating parameters, it turns out that the number of free parameters is not a reliable index of transmitted information. Thus, the common practice of treating parameters as ‘degrees-of-freedom’ in testing probabilistic models is questionable. Finally, this information-theoretic analysis of explanation, prediction, and description suggests ways of resolving some recent controversies surrounding the pragmatic aspects of explanation and the so-called structural identity thesis.

This is a preview of subscription content, access via your institution.

Bibliography

  • Bush, R. R., Galanter, E., and Luce, D. R.: 1963, ‘Characterization and Classification of Choice Experiments’, in Handbook of Mathematical Psychology (ed. by R. D. Luce, R. R. Bush, and E. Galanter), Vol. I, Wiley, New York, pp. 77–102.

    Google Scholar 

  • Dray, W.: 1957, Laws and Explanation in History, Oxford University Press, Oxford.

    Google Scholar 

  • Hanna, J. F.: 1966, ‘A New Approach to the Formulation and Testing of Learning Models’, Synthese 16, 344–80.

    Google Scholar 

  • Hanna, J.F.: 1968, ‘An Explication of “Explication”’, Philosophy of Science 35, 28–44.

    Google Scholar 

  • Hanna, J. F.: 1969, ‘Some Information Measures for Testing Stochastic Models’, Journal of Mathematical Psychology 6, 294–311.

    Google Scholar 

  • Hempel, C. G.: 1965, Aspects of Scientific Explanation, and Other Essays in the Philosophy of Science, The Free Press, New York.

    Google Scholar 

  • Hempel, C. G. and Oppenheim, P.: 1948, ‘Studies in the Logic of Explanation’, Philosophy of Science 15, 135–75. Also in Aspects of Scientific Explanation, pp. 245–95.

    Google Scholar 

  • Kullback, S.: 1959, Information Theory and Statistics, Wiley, New York.

    Google Scholar 

  • Popper, K. R.: 1959, The Logic of Scientific Discovery, Hutchinson, London.

    Google Scholar 

  • Scheffler, I.: 1963, The Anatomy of Inquiry, Alfred A. Knopf, New York.

    Google Scholar 

  • Scriven, M.: 1959, ‘Explanation and Prediction in Evolutionary Theory’, Science 130, 447–82.

    Google Scholar 

  • Scriven, M.: 1962, ‘Explanations, Predictions, and Laws’, in Minnesota Studies in the Philosophy of Science (ed. by H. Feigl and G. Maxwell), Vol. III, University of Minnesota Press, Minneapolis.

    Google Scholar 

  • Shanon, C. E. and Weaver, W.: 1949, The Mathematical Theory of Communication, University of Illinois Press, Urbana, Ill.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

This research was supported by NSF Grant GS-1448.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Hanna, J.F. Explanation, prediction, description, and information theory. Synthese 20, 308–334 (1969). https://doi.org/10.1007/BF00413732

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00413732

Keywords

  • Estimate Parameter
  • Social Science
  • Information Theory
  • Free Parameter
  • Probabilistic Model