Adaptive Monte Carlo Maximum Likelihood

  • Błażej Miasojedow
  • Wojciech NiemiroEmail author
  • Jan Palczewski
  • Wojciech Rejchel
Part of the Studies in Computational Intelligence book series (SCI, volume 605)


We consider Monte Carlo approximations to the maximum likelihood estimator in models with intractable norming constants. This paper deals with adaptive Monte Carlo algorithms, which adjust control parameters in the course of simulation. We examine asymptotics of adaptive importance sampling and a new algorithm, which uses resampling and MCMC. This algorithm is designed to reduce problems with degeneracy of importance weights. Our analysis is based on martingale limit theorems. We also describe how adaptive maximization algorithms of Newton-Raphson type can be combined with the resampling techniques. The paper includes results of a small scale simulation study in which we compare the performance of adaptive and non-adaptive Monte Carlo maximum likelihood algorithms.


Maximum likelihood Importance sampling Adaptation MCMC Resampling 



This work was partially supported by Polish National Science Center No. N N201 608 740.


  1. 1.
    Attouch H (1984) Variational convergence of functions and operators. Pitman, BostonGoogle Scholar
  2. 2.
    Besag J (1974) Spatial interaction and the statistical analysis of lattice systems. J R Stat Soc B 36:192–236MathSciNetGoogle Scholar
  3. 3.
    Chow YS (1967) On a strong law of large numbers for martingales. Ann Math Stat 38:610CrossRefzbMATHGoogle Scholar
  4. 4.
    Geyer CJ (1994) On the convergence of Monte Carlo maximum likelihood calculations. J R Stat Soc B 56:261–274MathSciNetzbMATHGoogle Scholar
  5. 5.
    Geyer CJ, Thompson EA (1992) Constrained Monte Carlo maximum likelihood for dependent data. J R Stat Soc B 54:657–699MathSciNetGoogle Scholar
  6. 6.
    Hall P, Heyde CC (1980) Martinagale limit theory and its application. Academic Press, New YorkGoogle Scholar
  7. 7.
    Miasojedow B, Niemiro W (2014) Debiasing MCMC via importance sampling-resampling. In preparationGoogle Scholar
  8. 8.
    Helland IS (1982) Central limit theorems for martingales with discrete or continuous time. Scand J Stat 9:79–94MathSciNetzbMATHGoogle Scholar
  9. 9.
    Huffer FW, Wu H (1998) Markov chain Monte Carlo for autologistic regression models with application to the distribution of plant species. Biometrics 54:509–524CrossRefzbMATHGoogle Scholar
  10. 10.
    Møller BJ, Pettitt AN, Reeves R, Berthelsen KK (2006) An efficient Markov chain Monte Carlo method for distributions with intractable normalising constants. Biometrika 93:451–458Google Scholar
  11. 11.
    Pettitt AN, Weir IS, Hart AG (2002) A conditional autoregressive Gaussian process for irregularly spaced multivariate data with application to modelling large sets of binary data. Stat Comput 12:353–367MathSciNetCrossRefGoogle Scholar
  12. 12.
    Pollard D (1984) Convergence of stochastic processes. Springer, New YorkCrossRefzbMATHGoogle Scholar
  13. 13.
    Rockafellar RT (1970) Convex analysis. Princeton University Press, PrincetonzbMATHGoogle Scholar
  14. 14.
    Rockafellar TJ, Wets RJ-B (2009) Variational analysis, 3rd edn. Springer, New YorkGoogle Scholar
  15. 15.
    Wu H, Huffer FW (1997) Modeling the distribution of plant species using the autologistic regression model. Environ Ecol Stat 4:49–64CrossRefGoogle Scholar
  16. 16.
    Younes L (1988) Estimation and annealing for Gibbsian fields. Annales de l’I H P sec B 24(2):269–294Google Scholar
  17. 17.
    Zalewska M, Niemiro W, Samoliński B (2010) MCMC imputation in autologistic model. Monte Carlo Methods Appl 16:421–438MathSciNetCrossRefzbMATHGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Błażej Miasojedow
    • 1
  • Wojciech Niemiro
    • 1
    • 3
    Email author
  • Jan Palczewski
    • 2
  • Wojciech Rejchel
    • 3
  1. 1.Faculty of Mathematics, Informatics and MechanicsUniversity of WarsawWarsawPoland
  2. 2.School of MathematicsUniversity of LeedsLeedsUK
  3. 3.Faculty of Mathematics and Computer ScienceNicolaus Copernicus UniversityToruńPoland

Personalised recommendations