Abstract
Copulas have become very popular as modelling tools in probability applications. Given a finite number of expectation constraints for functions defined on the unit square, the minimum information copula is that copula which has minimum information (Kullback–Leibler divergence) from the uniform copula. This can be considered the most “independent” copula satisfying the constraints. We demonstrate the existence and uniqueness of such copulas, rigorously establish the relation with discrete approximations, and prove an unexpected relationship between constraint expectation values and the copula density formula.
Similar content being viewed by others
References
Bedford, T. (2002). Interactive expert assessment of minimally informative copulae. In B. Lindqvist (Ed.) Proceedings of mathematical methods in reliability.
Bedford, T., Cooke, R. M. (2002). Vines: a new graphical model for dependent random variables. The Annals of Statistics, 30, 1031–1068.
Bedford, T., Daneshkhah, A., Wilson, K. J. (2013). Approximate uncertainty modelling with vine copulas. European Journal of Operational Research (submitted).
Bedford, T., Meeuwissen, A. M. H. (1997). Minimally informative distributions with given rank correlation for use in uncertainty analysis. Journal of Statistical Computation and Simulation, 57, 143–174.
Bedford, T., Wilson, K.J., Daneshkhah, A. (2012). Uncertainty modelling on coupled models using minimum information methods. In T. Aven (Ed.) Proceedings of PSAM 11 & ESREL 2012.
Borwein, J., Lewis, A. (2006). Convex analysis and nonlinear optimization: theory and examples. Montreal: Canadian Mathematical Society.
Borwein, J., Lewis, A., Nussbaum, R. (1994). Entropy minimization, DAD problems, and doubly stochastic kernels. Journal of Functional Analysis, 123, 264–307.
Jaynes, E. T. (2003). Probability theory: the logic of science. Cambridge: Cambridge.
Jensen, F. V. (1999). An introduction to Bayesian belief networks. London: UCL Press.
Joe, H. (1997). Multivariate models and dependence concepts. London: Chapman and Hall.
Kullback, S. (1959). Information theory and statistics. New York: Wiley.
Kurowicka, D., Cooke, R. (2006). Uncertainty analysis with high dimensional dependence modelling. New York: Wiley.
Kurowicka, D., Joe, H. (2011). Dependence modeling: Vine copula handbook. Singapore: World Scientific.
Lanford, O. E. (1973). Entropy and equilibrium states in classical statistical mechanics. In A. Lenard (Ed.) Statistical mechanics and mathematical problems (pp. 1–113). New York: Springer.
Nelsen, R. (1999). An introduction to copulas. New York: Springer.
Nelsen, R. (2006). An introduction to copulas (2nd ed.). New York: Springer.
Nosowad, P. (1966). On the integral equation \(kf=1/f\) arising from a problem in communication. Journal of Mathematical Analysis and Applications, 14, 484–492.
Nussbaum, R. D. (1989). Iterated nonlinear maps and Hilbert projective metric, II. Providence: American Mathematical Society.
Piantadosi, J., Howlett, P., Borwein, J. (2012). Copulas with maximum entropy. Optimization Letters, 6, 99–125.
Pougaza, D. B., Djafari, A. M. (2011). Maximum entropy copulas. In A. Mohammad-Djafari, J.-F. Bercher, P. Bessiere (Eds.) Bayesian inference and maximum entropy methods in science and engineering (pp. 329–336) New York: American Institute of Physics.
Uffink, J. (1995). Can the maximum entropy principle be explained as a consistency requirement? Studies in the History and Philosophy of Modern Physics, 26, 223–261.
Acknowledgments
We are grateful to the reviewers and the editor for comments and suggestions which improved the paper.
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Bedford, T., Wilson, K.J. On the construction of minimum information bivariate copula families. Ann Inst Stat Math 66, 703–723 (2014). https://doi.org/10.1007/s10463-013-0422-0
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10463-013-0422-0