Article PDF
Avoid common mistakes on your manuscript.
References
Shannon C E. A mathematical theory of communication. Bell System Technical Journal, 1948, 27: 379–423, 623–656
Rao C R. Information and accuracy attainable in the estimation of statistical parameters. Bulletin of the Calcutta Mathematical Society, 1945, 37: 81–91
Kullback S, Leibler R A. On information and sufficiency. Annals of Mathematical Statistics, 1951, 22(1): 79–86
Jaynes E T. Information theory and statistical mechanics. Physical Review, 1957, 106(4): 620–630
Shore J, Johnson R. Properties of cross-entropy minimization. IEEE Transactions on Information Theory, 1981, 27(4): 472–482
Chentsov N N. Statistical Decision Rules and Optimal Inference, Translations of Mathematical Monographs; v. 53. American Mathematical Society, 1982
Amari S. Differential-Geometrical Methods in Statistics. Lecture Notes in Statistics, Berlin: Springer-Verlag, 1985
Dempster A P, Laird N M, Rubin D B. Maximum-likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B, 1977, 39(1): 1–38
Yuille A L, Kersten D. Vision as Bayesian inference: Analysis by synthesis? Trends in Cognitive Sciences, 2006, 10(7): 301–308
Xu L. YING-YANG machines: A Bayesian-Kullback scheme for unified learning and new results on vector quantization. In: Proceedings of the International Conference on Neural Information Processing (ICONIP95). 1995, 977–988
Hinton G E, Dayan P, Frey B J, Neal R N. The wake-sleep algorithm for unsupervised learning neural networks. Science, 1995, 268(5214): 1158–1160
Xu L. Temporal BYY learning for state space approach, hidden Markov model and blind source separation. IEEE Transactions on Signal Processing, 2000, 48(7): 2132–2144
Akaike H. A new look at the statistical model identification. IEEE Transactions on Automatic Control, 1974, 19(6): 716–723
Solomonoff R J. A formal theory of inductive inference. Part I. Information and Control, 1964, 7(1): 1–22
Kolmogorov A N. Three approaches to the quantitative definition of information. Problems of Information Transmission, 1965, 1(1): 1–11
Wallace C S, Boulton D M. An information measure for classification. Computer Journal, 1968, 11(2): 185–194
Schwarz G. Estimating the dimension of a model. Annals of Statistics, 1978, 6(2): 461–464
Rissanen J. Modeling by shortest data description. Automatica, 1978, 14: 465–471
MacKay D J C. Bayesian interpolation. Neural Computation, 1992, 4(3): 415–447
McGrory C A, Titterington D M. Variational approximations in Bayesian model selection for finite mixture distributions. Computational Statistics & Data Analysis, 2007, 51(11): 5352–5367
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Xu, L., Li, Y. Emerging themes on information theory and Bayesian approach. Front. Electr. Electron. Eng. China 5, 237–240 (2010). https://doi.org/10.1007/s11460-010-0100-4
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11460-010-0100-4