Abstract
The authors derive the LRT statistic for the test of equality of mean vectors when the covariance matrix has what is called a double exchangeable structure. A second expression for this statistic, based on determinants of Wishart matrices with a block-diagonal parameter matrix, allowed for the expression of the distribution of this statistic as that of a product of independent Beta random variables. Moreover, the split of the LRT statistic into three independent components, induced by this second representation, will then allow for the expression of the exact distribution of the LRT statistic in a very manageable finite closed form for most cases and the obtention of very sharp near-exact distributions for the other cases. Numerical studies show that, as expected, due to the way they are built, these near-exact distributions are indeed asymptotic not only for increasing sample sizes but also for increasing values of all other parameters in the distribution, besides lying very close to the exact distribution even for extremely small samples.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Anderson, T.W.: An Introduction to Multivariate Statistical Analysis, 3rd edn. Wiley, Hoboken (2003)
Arnold, B.C., Coelho, C.A., Marques, F.J.: The distribution of the product of powers of independent uniform random variables - a simple but useful tool to address and better understand the structure of some distributions. J. Multivariate. Anal. 113, 19–36 (2013)
Coelho, C.A.: The Generalized Integer Gamma distribution - a basis for distributions in multivariate statistics. J. Multivariate Anal. 64, 86–102 (1998)
Coelho, C.A.: The generalized near-integer gamma distribution: a basis for “near-exact’’ approximations to the distribution of statistics which are the product of an odd number of independent Beta random variables. J. Multivariate Anal. 89, 191–218 (2004)
Coelho, C.A.: The Likelihood Ratio Test for Equality of Mean Vectors with Compound Symmetric Covariance Matrices. In: Gervasi, O., Murgante, B., Misra, S., Borruso, G., Torre, C.M., Rocha, A.M.A.C., Taniar, D., Apduhan, B.O., Stankova, E., Cuzzocrea, A. (eds.) Computational Science and Its Applications, Part V, pp. 20–32 (2017)
Coelho, C.A., Alberto, R.P.: On the Distribution of the Product of Independent Beta Random Variables – Applications. In: Ghosh, I., Balakrishnan, N., Ng, H.K. (eds.) Advances in Statistics - Theory and Applications: Honoring the Contributions of Barry C. Arnold in Statistical Science, (in print) Springer (2021)
Coelho, C.A., Arnold, B.C.: Finite Form Representations for Meijer G and Fox H Functions - Applied to Multivariate Likelihood Ratio Tests Using Mathematica\(^{\text{\textregistered} }\). MAXIMA and R. Lecture Notes in Statistics. Springer, Cham (2019)
Coelho, C.A., Marques, F.J.: The multi-sample block-scalar sphericity test: exact and near-exact distributions for its likelihood ratio test statistic. Commun. Statist. Theory Methods 42, 1153–1175 (2013)
Coelho, C.A., Roy, A.: Testing the hypothesis of a doubly exchangeable covariance matrix. Metrika 83, 45–68 (2020)
Coelho, C.A., Singull, M.: Testing for double complete symmetry. In: Holgersson, T., Singull, M. (eds.) Recent Developments in Multivariate and Random Matrix Analysis, pp. 17–39 (2020)
Coelho, C.A., Arnold, B.C., Marques, F.J.: Near-exact distributions for certain likelihood ratio test statistics. J. Stat. Theory Pract. 4, 711–725 (2010)
Coelho, C.A., Marques, F.J., Arnold, B.C.: The exact and near-exact distributions of the main likelihood ratio test statistics used in the complex multivariate normal setting. TEST 24, 386–416 (2015)
Kshirsagar, A.M.: Multivariate Analysis. Marcel Dekker, New York (1972)
Marques, F.J., Coelho, C.A., Arnold, B.C.: A general near-exact distribution theory for the most common likelihood ratio test statistics used in Multivariate Analysis. TEST 20, 180–203 (2011)
Pavlenko, T., Roy, A.: Supervised classifiers for high-dimensional higher-order data with locally doubly exchangeable covariance structure. Comm. Statist. Theory Methods 46, 11612–11634 (2017)
Roy, A., Fonseca, M.: Linear models with doubly exchangeable distributed errors. Comm. Statist. Theory Methods 41, 2545–2569 (2012)
Seely, J.: Quadratic subspaces and completeness. Ann. Math. Statist. 42, 710–721 (1971)
Szatrowski, T.D.: Explicit solutions, one iteration convergence and averaging in the multivariate Normal estimation problem for patterned means and covariances. Ann. Inst. Statist. Math. 30, 81–88 (1978)
Szatrowski, T.D.: Necessary and sufficient conditions for explicit solutions in the multivariate Normal estimation problem for patterned means and covariances. Ann. Statist. 8, 802–810 (1980)
Tricomi, F.G., Erdélyi, A.: The asymptotic expansion of a ratio of Gamma functions. Pacific J. Math. 1, 133–142 (1951)
Acknowledgements
This work is funded by Portuguese National Funds through FCT - Fundação para a Ciência e a Tecnologia, I.P., under the scope of the project UIDB/00297/ 2020 (CMA-FCT/UNL – Center for Mathematics and Applications)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Appendices
Appendix A: Proof of Expression (16)
For ease of exposition let us split the proof of (16) in the proof of three consecutive results. First let us prove the following result.
Result 1: The MLE of \(\Sigma \) under \(H_1\), which is \(A^*\) into (8), may be equivalently written as
where, from (7),
and
Proof
The proof is easier if we start from (A.1) and try to end with (8), by using (A.2) and (A.3) to write
which is (8). \(\square \)
We now prove that \(P_{vm}\), \(Q_{vm}\) and \(R_{vm}\) in (A.3) are indeed mutually orthogonal projectors.
Result 2 : \(P_{vm}\), \(Q_{vm}\) and \(R_{vm}\) in (A.3) are mutually orthogonal projectors with \({\mathrm{rank}}(P_{vm})=1\), \({\mathrm{rank}}(Q_{vm})=m-1\), \({\mathrm{rank}}(R_{vm})=m(v-1)\).
Proof
\(P_{vm}\), \(Q_{vm}\) and \(R_{vm}\) in (A.3) are idempotent, since
and they are mutually orthogonal since
Since \(P_{vm}\), \(Q_{vm}\) and \(R_{vm}\) are idempotent, we have
\(\square \)
Setting together the previous two results with the next one, we will finally be able to prove (16).
Result 3 : For the matrix \(A^{**}\) in (14), we may write
Proof
Let \({\mathrm{BTr}}_r(A)\) denote the sum of all \(r{\scriptstyle \times }r\) diagonal blocks of A. Then, for \(U_{|H_1}\), \(V_{|H_1}\) and \(W_{|H_1}\) in (9)–(11) we may write
Then, since from (14) we may write
from (A.2), and from the definition of the matrix \(\Gamma \) in (5), we have
where \(A_1^{**}\) represents the first diagonal block of \(A^{**}\) of dimensions \(r{\scriptstyle \times }r\), since, given the definition of a Helmert matrix, \(\Gamma _m\otimes \Gamma _v\) is a \(vm{\scriptstyle \times }vm\) matrix whose first row is equal to \(\frac{1}{\sqrt{vm}}\underline{1}'_{vm}\), where \(\underline{1}_{vm}\) denotes a vector of 1’s of dimension vm, and as such \((\Gamma _m\otimes \Gamma _v)P_{vm}\) is a \(vm{\scriptstyle \times }vm\) matrix whose first row is equal to \(\frac{1}{\sqrt{vm}}\underline{1}'_{vm}\) and all other rows are null, so that
what implies
Using (A.4), and once again the definition of the matrix \(\Gamma \) in (5), we also have
where \(A_j^{**}\) represents the j-th diagonal block of \(A^{**}\) of dimensions \(r{\scriptstyle \times }r\), since
and as such,
This is so because, given the definition of a Helmert matrix, for a \(v{\scriptstyle \times }v\) Helmert matrix \(\Gamma _v\), we have that \(\Gamma _vJ_v\) is a matrix whose first row is equal to \(\frac{1}{\sqrt{v}}\underline{1}'_v\), and as such we have
so that we have
and as such we may write, using the relation in (A.5),
And finally, using once again (A.4), and the definition of \(R_{vm}\) in (A.3), we have
where, once again, \(A^{**}_j\) represents the j-th diagonal block of \(A^{**}\) of dimensions \(r{\scriptstyle \times }r\).
This is so given that from the definition of \(R_{vm}\) in (A.3) and from (A.5) and (A.6) it is clear that we have
so that
\(\square \)
Finally, expression (16) holds since from Result 1 and the mutual orthogonality of \(P_{vm}\), \(Q_{vm}\) and \(R_{vm}\) proven in Result 2 and yet the rank results therein, we may write
which given the expressions obtained in Result 3 for \(\widehat{\Psi }_{1|H_1}\), \(\widehat{\Psi }_{2|H_1}\) and \(\widehat{\Psi }_{3|H_1}\) yields (16).
Expression (17) would be proven in a completely similar way.
Appendix B: The GIG, EGIG and GNIG distributions
In this appendix we define the GIG (Generalized Integer Gamma), EGIG (Exponentiated Generalized Integer Gamma) and GNIG (Generalized Near-Integer Gamma) distributions and establish the notation used concerning their p.d.f.’s and c.d.f.’s.
We say that the r.v. (random variable) X has a Gamma distribution with shape parameter \({r\,(>0)}\) and rate parameter \({\lambda \,(>0)}\), and we will denote this fact by \(X\sim \Gamma (r,\lambda )\), if the p.d.f. of X is
Let \(X_j\sim \Gamma (r_j,\lambda _j)\) \({(j=1,\dots ,p)}\) be a set of p independent r.v.’s and consider the r.v.
In case all the \(r_j\in \mathbb {N}\), the distribution of W is what we call a GIG distribution (Coelho 1998). If all the \(\lambda _j\) are different, W has a GIG distribution of depth p, with shape parameters \(r_j\) and rate parameters \(\lambda _j\), with p.d.f.
and c.d.f.
for \({w>0}\), where
and
with
and, for \(k=1,\dots ,r_j-1\) and \(j=1,\dots ,p\),
where
In case some of the \(\lambda _j\) assume the same value as other \(\lambda _j\)’s, the distribution of W still is a GIG distribution, but in this case with a reduced depth. In this more general case, let \(\widetilde{\{}\lambda _\ell \widetilde{\}}_{\ell =1:g(\le p)}\) be the set of different \(\lambda _j\)’s and let \({\mathop {\{}\limits ^{\approx }}\!\!r_\ell \!\!{\mathop {\}}\limits ^{\approx }}_{\ell =1:g(\le p)}\) be the set of the corresponding shape parameters, with \(r_\ell \) \((\ell =1,\dots ,g)\) being the sum of all \(r_j\) \({(j\in \{1,\dots ,p\})}\) which correspond to the \(\lambda _j\) assuming the value \(\lambda _\ell \). In this case W will have a GIG distribution of depth g, with shape parameters \(r_\ell \) and rate parameters \(\lambda _\ell \) \({(\ell =1,\dots ,g)}\).
The r.v. \({Z=e^{-W}}\) has then what Arnold et al. (2013) call an Exponentiated Generalized Integer Gamma (EGIG) distribution of depth g, with p.d.f.
and c.d.f.
for
and \(P_\ell (\,\cdot \,)\) and \(P^*_\ell (\,\cdot \,)\) given by (B.1) and (B.2), with j replaced by \(\ell \).
Then let W be a r.v. with a GIG distribution of depth g, with rate parameters \(\widetilde{\{}\lambda _\ell \widetilde{\}}_{\ell =1:g}\) and shape parameters \({\mathop {\{}\limits ^{\approx }}\!\!r_\ell \!\!{\mathop {\}}\limits ^{\approx }}_{\ell =1:g}\) \((\in \mathbb N)\) and let \(W^*\sim \Gamma (r,\lambda )\), with \(r\in {\mathbb R}^+\backslash {\mathbb N}\). Let further W and \(W^*\) be two independent r.v.’s. Then the r.v.
has a Generalized Near-Integer Gamma (GNIG) distribution (Coelho 2004) of depth \({g+1}\), with rate parameters \(\widetilde{\{}\lambda _\ell \widetilde{\}}_{\ell =1:g}\) and \(\lambda \) and corresponding shape parameters \({\mathop {\{}\limits ^{\approx }}\!\!r_\ell \!\!{\mathop {\}}\limits ^{\approx }}_{\ell =1:g}\) \((\in \mathbb N)\) and r, with p.d.f.
and c.d.f.
where \({z>0}\), \(K^{**}=K^*\lambda ^r\), for \(K^*\) in (B.8), \({r^*=r+1}\), and
for \(c_{\ell ,k}\) given by (B.3)–(B.5) with j replaced by \(\ell \), and
is the Kummer confluent hypergeometric function.
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Coelho, C.A., Pielaszkiewicz, J. (2021). The Likelihood Ratio Test of Equality of Mean Vectors with a Doubly Exchangeable Covariance Matrix. In: Arnold, B.C., Balakrishnan, N., Coelho, C.A. (eds) Methodology and Applications of Statistics. Contributions to Statistics. Springer, Cham. https://doi.org/10.1007/978-3-030-83670-2_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-83670-2_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-83669-6
Online ISBN: 978-3-030-83670-2
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)