Abstract
In this paper the authors show how it is possible to establish a common structure for the exact distribution of the main likelihood ratio test (LRT) statistics used in the complex multivariate normal setting. In contrast to what happens when dealing with real random variables, for complex random variables it is shown that it is possible to obtain closed-form expressions for the exact distributions of the LRT statistics to test independence, equality of mean vectors and the equality of an expected value matrix to a given matrix. For the LRT statistics to test sphericity and the equality of covariance matrices, cases where the exact distribution has a non-manageable expression, easy to implement and very accurate near-exact distributions are developed. Numerical studies show how these near-exact distributions outperform by far any other available approximations. As an example of application of the results obtained, the authors develop a near-exact approximation for the distribution of the LRT statistic to test the equality of several complex normal distributions.
Similar content being viewed by others
References
Anderson TW (2003) An introduction to multivariate statistical analysis, 3rd edn. Wiley, New York
Box GEP (1949) A general distribution theory for a class of likelihood criteria. Biometrika 36:317–346
Brillinger DR (2001) Time series: data analysis and theory. SIAM, Philadelphia
Brillinger DR, Krishnaiah PR (eds) (1982) Handbook of statistics. Time series in frequency domain, vol 2. North Holland, Amsterdam
Coelho CA (1998) The generalized integer gamma distribution—a basis for distributions in multivariate statistics. J Multivar Anal 64:86–102
Coelho CA, Marques FJ (2009) The advantage of decomposing elaborate hypotheses on covariance matrices into conditionally independent hypotheses in building near-exact distributions for the test statistics. Linear Algebra Appl 430:2592–2606
Coelho CA, Marques FJ (2012) Near-exact distributions for the likelihood ratio test statistic to test equality of several variance–covariance matrices in elliptically contoured distributions. Comput Stat 27:627–659
Conradsen K (2012) Multivariate analysis of polarimetric SAR images. In: LINSTAT’12-international conference trends and perspectives in linear statistical inference and IWMS’12–21st international workshop on matrices and statistics. Abstract Book, pp 87–88
Conradsen K, Nielsen AA, Schou J, Skiver H (2003) A test statistic in the complex Wishart distribution and its application to change detection in polarimetric SAR data. IEEE Trans Geosci Remote Sens 41:4–19
Fang C, Krishnaiah PR, Nagarsenker BN (1982) Asymptotic distributions of the likelihood ratio test statistics for covariance structures of the complex multivariate normal distributions. J Multivar Anal 12:597–611
Goodman NR (1963a) Statistical analysis based on a certain multivariate complex Gaussian distribution (an introduction). Ann Math Stat 34:152–177
Goodman NR (1963b) The distribution of the determinant of a complex Wishart distributed matrix. Ann Math Stat 34:178–180
Gupta AK (1971) Distribution of Wilks’ likelihood-ratio criterion in the complex case. Ann Inst Stat Math 23:77–87
Gupta AK (1976) Nonnull distribution of Wilks’ statistic for MANOVA in the complex case. Commun Stat Simul Comput 5:177–188
Gupta AK, Rathie PN (1983) Nonnull distributions of Wilks’ Lambda in the complex case. Statistica 43:445–450
Jensen ST (1988) Covariance hypotheses which are linear in both the covariance and the inverse covariance. Ann Stat 16:302–322
Khatri CG (1965) Classical statistical analysis based on a certain multivariate complex Gaussian distribution. Ann Math Stat 36:98–114
Krishnaiah PR, Lee JC, Chang TC (1976) The distributions of the likelihood ratio statistics for tests of certain covariance structures of complex multivariate normal populations. Biometrika 63:543–549
Lehmann NH, Fishler E, Haimovich AM, Blum RS, Chizhik D, Cimini LJ, Valenzuela RA (2007) Evaluation of transmit diversity in MIMO-radar direction finding. IEEE Trans Signal Process 55:2215–2225
Marques FJ, Coelho CA, Arnold BC (2011) A general near-exact distribution theory for the most common likelihood ratio test statistics used in multivariate analysis. Test 20:180–203
Mathai AM (1973) A few remarks about some recent articles on the exact distributions of multivariate test criteria: I. Ann Inst Stat Math 25:557–566
Nagar DK, Jain SK, Gupta AK (1985) Distribution of LRC for testing sphericity of a complex multivariate Gaussian model. Int J Math Math Sci 8:555–562
Nagarsenker BN, Das MM (1975) Exact distribution of sphericity criterion in the complex case and its percentage points. Commun Stat 4:363–374
Nagarsenker BN, Nagarsenker PB (1981) Distribution of the likelihood ratio statistic for testing sphericity structure for a complex normal covariance matrix. Sankhya Ser B 43:352–359
Pannu NS, Coy AJ, Read J (2003) Application of the complex multivariate normal distribution to crystallographic methods with insights into multiple isomorphous replacement phasing. Acta Crystallogr D Biol Crystallogr 59:1801–1808
Pillai KCS, Jouris GM (1971) Some distribution problems in the multivariate complex Gaussian case. Ann Math Stat 42:517–525
Pillai KCS, Nagarsenker BN (1971) On the distribution of the sphericity test criterion in classical and complex normal populations having unknown covariance matrices. Ann Math Stat 42:764–767
Shumway RH, Stoffer DS (2006) Time series analysis and its applications: with R examples, 2nd edn. Springer, New York
Tang J, Gupta AK (1986) Exact distribution of certain general test statistics in multivariate analysis. Aust J Stat 28:107–114
Tricomi FG, Erdélyi A (1951) The asymptotic expansion of a ratio of gamma functions. Pac J Math 1:133–142
Turin GL (1960) The characteristic function of Hermitian quadratic forms in complex normal variables. Biometrika 47:199–201
Wooding RA (1956) The multivariate distribution of complex normal variables. Biometrika 43:212–215
Acknowledgments
Research partially supported by National Funds through FCT-Fundação para a Ciência e a Tecnologia, project PEst-OE/MAT/UI0297/2014 (CMA/UNL). The authors would like to express their gratitude to two anonymous Referees, the Associate Editor and also the Editor-in-Chief, whose suggestions contributed to a more solid and self-contained paper.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Appendix A: Short user’s guide for the computational modules
Appendix A: Short user’s guide for the computational modules
1.1 A.1 Modules for the exact distributions of statistics in Sect. 2
Concerning the modules for the exact distributions of the three LRT statistics addressed in Sect. 2, there are five modules made available for each statistic \(\varLambda _i\). These modules are CFWi, PDFWi, CDFWi, PDFLi and CDFLi, where \(i\) is to be replaced by either 1, 2 or 3. These modules give as output, respectively, the value for the c.f. of \(W_i=-\log \,\varLambda _i\) \({(i=1,2,3)}\), the value for its pdf, the value for its cdf, the value for the pdf of \(\varLambda _i\) and the value for the cdf of \(\varLambda _i\), computed at the value for the running variable.
In the case of the LRT statistic \(\varLambda _1\), the arguments of these five modules are, in this order: (i) a list whose components are the number of variables of each group, (ii) the sample size, (iii) the running variable for the function. For \(\varLambda _2\), the arguments are, in this order: (i) the number of variables (equal for each population), (ii) the number of mean vectors being tested, (iii) the overall sample size, (iv) the running variable for the function. In the case of \(\varLambda _3\), the arguments are (i) the number of variables, (ii) either the rank of the matrix \(D\), in case this matrix is used, or the number of columns of the matrix \(\mu \).
The modules used to compute the pdf and cdf of \(W_i=-\log \varLambda _i\) make use of the modules for the pdf and cdf of the GIG distribution, while the modules for the pdf and cdf of \(\varLambda _i\) make use of the corresponding modules for \(W_i\), using the usual technique of r.v. transformation.
To obtain the computational modules and for a few examples of their use download the Mathematica\(^{{\circledR }}\) file Mathematica_Modules_for_Exact_distr_stats_Sec_2.nb, readily available from the web-page https://sites.google.com/site/nearexactdistributions/complex-normal.
1.2 A.2 Modules for the near-exact distributions of statistics in Sects. 3 and 4
For the statistics \(\varLambda _4\) and \(\varLambda _5\), in Sects. 3 and 4 and whose near-exact distributions are developed in Sect. 5, there are also five modules made available for each statistic. These modules are: NECFWi, NEPDFWi, NECDFWi, NEPDFLi and NECDFLi, where \(i\) is to be replaced by either 4 or 5. These modules give as output, respectively, the value for the near-exact c.f. of \(W_i=-\log \varLambda _i\) \({(i=4,5)}\), the value for its near-exact pdf and cdf and the value for the near-exact pdf and cdf of \(\varLambda _i\), computed at the value for the running variable.
In the case of the LRT statistic \(\varLambda _4\), the arguments of the five modules are, in the following order: (i) the number of variables, (ii) the sample size, (iii) the number of exact moments to be matched, (iv) the running variable for the function and (v) an optional argument which is the number of precision digits used to compute the exact moments to be matched by the near-exact distribution and which has a default value of 100. For \(\varLambda _5\), the arguments are, in the following order: (i) the number of variables, (ii) the number of covariance matrices being tested, (iii) the sample size, (iv) the number of exact moments to be matched, (v) the running variable for the function and (vi) the same optional argument as in (v) for \(\varLambda _4\).
The modules used to compute the near-exact pdf and cdf of \(W_i=-\log \,\varLambda _i\) \({(i=4,5)}\) make use of the modules for the pdf and cdf of the GIG and GNIG distributions, while the modules for the near-exact pdf and cdf of \(\varLambda _i\) make use of the corresponding modules for \(W_i\), by using the usual technique of r.v. transformation.
To obtain the computational modules and for a few examples of their use download the Mathematica\(^{{\circledR }}\) file Mathematica_Modules_for_Near-Exact_distr_stats_Sec_3_4.nb, readily available from the web-page https://sites.google.com/site/nearexactdistributions/complex-normal.
Rights and permissions
About this article
Cite this article
Coelho, C.A., Arnold, B.C. & Marques, F.J. The exact and near-exact distributions of the main likelihood ratio test statistics used in the complex multivariate normal setting. TEST 24, 386–416 (2015). https://doi.org/10.1007/s11749-014-0418-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11749-014-0418-y
Keywords
- Covariance matrix
- Equality of covariance matrices
- Equality of mean vectors
- Fourier transforms
- Generalized integer gamma (GIG) distribution
- Generalized near-integer gamma (GNIG) distribution
- Independence
- Mixtures
- Expected value matrix
- Sphericity
- Statistical distributions (distribution functions)