Abstract
In previous work the authors defined the k-th order simplicial distance between probability distributions which arises naturally from a measure of dispersion based on the squared volume of random simplices of dimension k. This theory is embedded in the wider theory of divergences and distances between distributions which includes Kullback–Leibler, Jensen–Shannon, Jeffreys–Bregman divergence and Bhattacharyya distance. A general construction is given based on defining a directional derivative of a function \(\phi \) from one distribution to the other whose concavity or strict concavity influences the properties of the resulting divergence. For the normal distribution these divergences can be expressed as matrix formula for the (multivariate) means and covariances. Optimal experimental design criteria contribute a range of functionals applied to non-negative, or positive definite, information matrices. Not all can distinguish normal distributions but sufficient conditions are given. The k-th order simplicial distance is revisited from this aspect and the results are used to test empirically the identity of means and covariances.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Change history
12 September 2019
Unfortunately, due to a technical error, the articles published in issues 60:2 and 60:3 received incorrect pagination. Please find here the corrected Tables of Contents. We apologize to the authors of the articles and the readers.
References
Atkinson AC, Donev AN, Tobias RD (2007) Optimum experimental designs, with SAS. Oxford University Press, Oxford
Basseville M (2013) Divergence measures for statistical data processing—an annotated bibliography. Signal Process 93(4):621–633
Bhattacharyya A (1946) On a measure of divergence between two multinomial populations. Sankhyā 7(4):401–406
Björck G (1956) Distributions of positive mass, which maximize a certain generalized energy integral. Arkiv för Matematik 3(21):255–269
Fedorov VV (1972) Theory of optimal experiments. Academic Press, New York
Fedorov VV, Hackl P (1997) Model-oriented design of experiments. Springer, Berlin
Fedorov VV, Leonov SL (2014) Optimal design for nonlinear response models. CRC Press, Boca Raton
Frigyik BA, Srivastava S, Gupta MR (2008) Functional Bregman divergence and Bayesian estimation of distributions. IEEE Trans Inf Theory 54(11):5130–5139
Kiefer J (1974) General equivalence theory for optimum designs (approximate theory). Ann Stat 2(5):849–879
López-Fidalgo J, Rodríguez-Díaz JM (1998) Characteristic polynomial criteria in optimal experimental design. In: Atkinson AC, Pronzato L, Wynn HP (eds) Advances in model-oriented data analysis and experimental design. Proceedings of MODA’5, Marseilles. Physica Verlag, Heidelberg, June 22–26, pp 31–38
Łukaszyk S (2004) A new concept of probability metric and its applications in approximation of scattered data sets. Comput Mech 33(4):299–304
Nielsen F, Boltz S (2011) The Burbea-Rao and Bhattacharyya centroids. IEEE Trans Inf Theory 57(8):5455–5466
Nielsen F, Nock R (2017) Generalizing Jensen and Bregman divergences with comparative convexity and the statistical Bhattacharyya distances with comparable means. arXiv preprint arXiv:1702.04877
Pázman A (1986) Foundations of optimum experimental design. Kluwer group, co-pub. VEDA, Bratislava, Reidel, Dordrecht
Pronzato L, Pázman A (2013) Design of experiments in nonlinear models. Asymptotic normality, optimality criteria and small-sample properties. Springer, LNS 212, New York
Pronzato L, Wynn HP, Zhigljavsky A (2016) Extremal measures maximizing functionals based on simplicial volumes. Stat Pap 57(4):1059–1075 hal-01308116
Pronzato L, Wynn HP, Zhigljavsky A (2017) Extended generalised variances, with applications. Bernoulli 23(4A):2617–2642
Pronzato L, Wynn HP, Zhigljavsky AA (2018) Simplicial variances, potentials and Mahalanobis distances. J Multivar Anal (to appear)
Pukelsheim F (1993) Optimal experimental design. Wiley, New York
Rodríguez-Díaz JM, López-Fidalgo J (2003) A bidimensional class of optimality criteria involving \(\phi _p\) and characteristic criteria. Statistics 37(4):325–334
Schilling RL, Song R, Vondracek Z (2012) Bernstein functions: theory and applications. de Gruyter, Berlin
Sejdinovic S, Sriperumbudur B, Gretton A, Fukumizu K (2013) Equivalence of distance-based and RKHS-based statistics in hypothesis testing. Ann Stat 41(5):2263–2291
Shiryaev AN (1996) Probability. Springer, Berlin
Silvey SD (1980) Optimal design. Chapman & Hall, London
Sriperumbudur BK, Gretton A, Fukumizu K, Schölkopf B, Lanckriet GRG (2010) Hilbert space embeddings and metrics on probability measures. J Mach Learn Res 11(Apr):1517–1561
Székely GJ, Rizzo ML (2013) Energy statistics: a class of statistics based on distances. J Stat Plan Inference 143(8):1249–1272
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Pronzato, L., Wynn, H.P. & Zhigljavsky, A. Bregman divergences based on optimal design criteria and simplicial measures of dispersion. Stat Papers 60, 545–564 (2019). https://doi.org/10.1007/s00362-018-01082-8
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00362-018-01082-8