Statistical and Inductive Inference by Minimum Message Length

  • Authors
  • C.S. Wallace

Part of the Information Science and Statistics book series (ISS)

Table of contents

  1. Front Matter
    Pages i-xv
  2. Pages 1-55
  3. Pages 57-141
  4. Pages 197-219
  5. Pages 305-336
  6. Pages 401-415
  7. Back Matter
    Pages 417-429

About this book


The Minimum Message Length (MML) Principle is an information-theoretic approach to induction, hypothesis testing, model selection, and statistical inference. MML, which provides a formal specification for the implementation of Occam's Razor, asserts that the ‘best’ explanation of observed data is the shortest. Further, an explanation is acceptable

(i.e. the induction is justified) only if the explanation is shorter than the original data.

This book gives a sound introduction to the Minimum Message Length Principle and its applications, provides the theoretical arguments for the adoption of the principle, and shows the development of certain approximations that assist its practical application. MML appears also to provide both a normative and a descriptive basis for inductive reasoning generally, and scientific induction in particular. The book describes this basis and aims to show its relevance to the Philosophy of Science.

Statistical and Inductive Inference by Minimum Message Length will be of special interest to graduate students and researchers in Machine Learning and Data Mining, scientists and analysts in various disciplines wishing to make use of computer techniques for hypothesis discovery, statisticians and econometricians interested in the underlying theory of their discipline, and persons interested in the Philosophy of Science. The book could also be used in a graduate-level course in Machine Learning and Estimation and Model-selection, Econometrics and Data Mining.

C.S. Wallace was appointed Foundation Chair of Computer Science at Monash University in 1968, at the age of 35, where he worked until his death in 2004. He received an ACM Fellowship in 1995, and was appointed Professor Emeritus in 1996. Professor Wallace made numerous significant contributions to diverse areas of Computer Science, such as Computer Architecture, Simulation and Machine Learning. His final research focused primarily on the Minimum Message Length Principle.


Computer Information Sage data mining formal specification learning machine learning

Bibliographic information

  • DOI
  • Copyright Information Springer Science+Business Media, Inc. 2005
  • Publisher Name Springer, New York, NY
  • eBook Packages Mathematics and Statistics
  • Print ISBN 978-0-387-23795-4
  • Online ISBN 978-0-387-27656-4
  • Series Print ISSN 1613-9011
  • Buy this book on publisher's site