Abstract
Single connected Factorized Distribution Algorithms (FDA-SC) use factorizations of the joint distribution, which are trees, forests or polytrees. At each stage of the evolution they build a polytree from which new points are sampled. We study empirically the relation between the accuracy of the learned model and the quality of the new search points generated. We show that a change of the learned model before sampling might reduce the population size requirements of sampling.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
S. Acid, L. M. de Campos. (1995). Approximations of causal networks by polytrees: an empirical study. Advances in Intelligent Computing. 149–158. B. Bouchon-Meunier, R. R. Yager, L. A. Zadeh. Lecture Notes in Computer Science 945. Springer Verlag, Berlin.
S. Baluja and S. Davies. (1997). Using Optimal Dependency-Trees for Combinatorial Optimization: Learning the structure of the Search Space, (Carnegie Mellon Report, CMU-CS-97-107, 1997a).
C. K. Chow, C. N. Liu. (1968). Approximating discrete probability distribution with dependence trees. IEEE Transantions on Information Theory 14. 462–467.
L. M. de Campos. (1998). Independency relationships and learning algorithms for singly connected networks. Journal of Experimental and Theoretical Ar-tifiacial Intelligence. 511–549. (Also DECSAI-TR-960204).
J.S. De Bonet, C. L. Isbell, and P. Viola. (1997) MIMIC: Finding Optima by Estimating Probability Densities, in M. Jordan and Th. Petsche, eds, Advances in Neural Information Processing Systems, Vol. 9. 424–431.
R. Etxeberria, P. Larranaga. (1999). Global optimization using Bayesian networks. CIMAF 1999, Second International Symposium on Artificial Intelligence, Adaptive Systems. 332–339.
I. J. Good. (1965). The estimation of probabilities. MIT Press.
M. Henrion. (1988). Propagating uncertainty in Bayesian networks by probabilistic logic sampling. Uncertainty in Artificial Intelligence 2. 317–324.
H. Muehlenbein. (1997). The equation for response to selection and its use for prediction. Evolutionary Computation 5. 303–346.
H. Muehlenbein, G. Pass. (1996). From recombination of genes to estimation of distribution I. Binay parameters. Lecture Notes in Computer Science 1411. Parallel Problem Solving from Nature-PPSN IV. 178–187.
H. Muehlenbein, T. Mahnig, A. Ochoa. (1999). Schemata, distributions and graphical models in evolutionay optimization. Journal of Heuristics 5(2). 215–247.
H. Muehlenbein, T. Mahnig. (1999). FDA: A scalable evolutionary algorithm for the optimization of additively decomposed functions. Evolutionary Computation 7(4). 353–376.
H. Muehlenbein, Th. Mahnig. (2000). Evolutionary Algorithms: From Recombination to Search Distributions. in: Theoretical Aspects of Evolutionary Computing. eds. L. Kallel, B. Naudts, A. Rogers, 137–176. Springer Verlag Berlin.
A. Ochoa, M. Soto, R. Santana, J. C. Madera, N. Jorge. (1999). The factorized distribution algorithm and the junction tree: a learning perspective. CIMAF 1999, Second International Symposium on Artificial Intelligence, Adaptive Systems. 368–377.
J. Pearl. (1988). Probabilistic reasoning in intelligent systems: networks of plausible inference. Ronald J. Brachman (AT&T Bell Laboratories). Morgan and Kaufmann.
M. Pelican, H. Muehlenbein. (1999). BMDA: The Bivariate Marginal Distribution Algorithm, in R. Roy, T. Furuhashi, P, K. Chandhory eds., Advances in Soft Computing-Engineering Design and Manufacturing, (1999), London: Springer Verlag, 521–535.
M. Pelican, D. E. Goldberg, E. Cantu-Paz. (1999). BOA: The Bayesian optimization algorithm. Proceedings of the Genetic and Evolutionary Computation Conference GECCO-99 1. 525–532.
M. Soto, A. Ochoa, S. Acid, L. M. de Campos.(1999). Introducing the poly-tree aproximation distribution algorithm. CIMAF 1999, Second International Symposium on Artificial Intelligence, Adaptive Systems. 360–367.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ochoa, A., Muehlenbein, H., Soto, M. (2000). A Factorized Distribution Algorithm Using Single Connected Bayesian Networks. In: Schoenauer, M., et al. Parallel Problem Solving from Nature PPSN VI. PPSN 2000. Lecture Notes in Computer Science, vol 1917. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45356-3_77
Download citation
DOI: https://doi.org/10.1007/3-540-45356-3_77
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41056-0
Online ISBN: 978-3-540-45356-7
eBook Packages: Springer Book Archive