Convergence and Efficiency of Adaptive Importance Sampling Techniques with Partial Biasing
We propose a new Monte Carlo method to efficiently sample a multimodal distribution (known up to a normalization constant). We consider a generalization of the discrete-time Self Healing Umbrella Sampling method, which can also be seen as a generalization of well-tempered metadynamics. The dynamics is based on an adaptive importance technique. The importance function relies on the weights (namely the relative probabilities) of disjoint sets which form a partition of the space. These weights are unknown but are learnt on the fly yielding an adaptive algorithm. In the context of computational statistical physics, the logarithm of these weights is, up to an additive constant, the free-energy, and the discrete valued function defining the partition is called the collective variable. The algorithm falls into the general class of Wang–Landau type methods, and is a generalization of the original Self Healing Umbrella Sampling method in two ways: (i) the updating strategy leads to a larger penalization strength of already visited sets in order to escape more quickly from metastable states, and (ii) the target distribution is biased using only a fraction of the free-energy, in order to increase the effective sample size and reduce the variance of importance sampling estimators. We prove the convergence of the algorithm and analyze numerically its efficiency on a toy example.
KeywordsWang Landau Self Healing Umbrella Sampling Metadynamics Convergence of stochastic approximation algorithms
We would like to thank Brad Dickson, Alessandro Laio and Michele Parrinello for useful discussions. This work is supported by the European Research Council under the European Union’s Seventh Framework Programme (FP/2007-2013) / ERC Grant Agreement number 614492 and by the French National Research Agency under the grant ANR-14-CE23-0012 (COSMOS). We also benefited from the scientific environment of the Laboratoire International Associé between the Centre National de la Recherche Scientifique and the University of Illinois at Urbana-Champaign.
- 9.Chipot, C., Pohorille, A. (eds): Free-Energy Calculations. Springer Series in Chemical Physics, vol. 86. Springer, Berlin (2007)Google Scholar
- 43.Ruppert, D.: Efficient estimations from a slowly convergent Robbins-Monro process. Technical Report 781, Cornell University Operations Research and Industrial Engineering (1988)Google Scholar