Statistics and Computing

, Volume 22, Issue 6, pp 1181–1197

Considerate approaches to constructing summary statistics for ABC model selection

  • Chris P. Barnes
  • Sarah Filippi
  • Michael P. H. Stumpf
  • Thomas Thorne
Article

DOI: 10.1007/s11222-012-9335-7

Cite this article as:
Barnes, C.P., Filippi, S., Stumpf, M.P.H. et al. Stat Comput (2012) 22: 1181. doi:10.1007/s11222-012-9335-7

Abstract

For nearly any challenging scientific problem evaluation of the likelihood is problematic if not impossible. Approximate Bayesian computation (ABC) allows us to employ the whole Bayesian formalism to problems where we can use simulations from a model, but cannot evaluate the likelihood directly. When summary statistics of real and simulated data are compared—rather than the data directly—information is lost, unless the summary statistics are sufficient. Sufficient statistics are, however, not common but without them statistical inference in ABC inferences are to be considered with caution. Previously other authors have attempted to combine different statistics in order to construct (approximately) sufficient statistics using search and information heuristics. Here we employ an information-theoretical framework that can be used to construct appropriate (approximately sufficient) statistics by combining different statistics until the loss of information is minimized. We start from a potentially large number of different statistics and choose the smallest set that captures (nearly) the same information as the complete set. We then demonstrate that such sets of statistics can be constructed for both parameter estimation and model selection problems, and we apply our approach to a range of illustrative and real-world model selection problems.

Keywords

Information theory Model choice Model evidence 

Copyright information

© Springer Science+Business Media, LLC 2012

Authors and Affiliations

  • Chris P. Barnes
    • 1
  • Sarah Filippi
    • 1
  • Michael P. H. Stumpf
    • 1
  • Thomas Thorne
    • 1
  1. 1.Centre for Integrative Systems Biology and BioinformaticsImperial College LondonLondonUK

Personalised recommendations