Skip to main content
SpringerLink
Log in

The Basic Ideas of Obtaining MLEs: Unknown Dispersion

  • Chapter
  • First Online:
Book cover Bilinear Regression Analysis

Part of the book series: Lecture Notes in Statistics ((LNS,volume 220))

  • 1450 Accesses

Abstract

Maximum likelihood estimators of all parameters in the bilinear and extended bilinear regression models are obtained. The basic idea is to use decompositions of the tensor space where within-individuals spaces also have an inner product which has to be estimated. All obtained estimators have explicit forms. A short literature review of bilinear regression models is given.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Anderson, T. W., & Olkin, I. (1985). Maximum-likelihood estimation of the parameters of a multivariate normal distribution. Linear Algebra and Its Applications, 70, 147–171.

    Article  MathSciNet  Google Scholar 

  • Andersson, S. A., Marden, J. I., & Perlman, M. D. (1993). Totally ordered multivariate linear models. Sankhy \(\bar {a}\) , Series A, 55, 370–394.

    MathSciNet  Google Scholar 

  • Andersson, S. A., & Perlman, M. D. (1993). Lattice models for conditional independence in a multivariate normal distribution. The Annals of Statistics, 21, 1318–1358.

    Article  MathSciNet  Google Scholar 

  • Baksalary, J. K., Corsten, L. C. A., & Kala, R. (1978). Reconciliation of two different views on estimation of growth curve parameters. Biometrika, 65, 662–665.

    Article  MathSciNet  Google Scholar 

  • Banken, L. (1984a). On the reduction of the general MANOVA model. Technical report. University of Trier, Trier.

    Google Scholar 

  • Banken, L. (1984b). Eine Verallgemeinerung des GMANOVA-Modells. Dissertation, University of Trier, Trier.

    MATH  Google Scholar 

  • Chinchilli, V. M., & Elswick, R. K. (1985). A mixture of the MANOVA and GMANOVA models. Communications in Statistics A—Theory Methods, 14, 3075–3089.

    Article  MathSciNet  Google Scholar 

  • Drton, M., Andersson, S. A., & Perlman, M. D. (2006). Conditional independence models for seemingly unrelated regressions with incomplete data. Journal of Multivariate Analysis, 97, 385–411.

    Article  MathSciNet  Google Scholar 

  • Elswick, R. K. (1985). The Missing Data Problem as Applied to the Extended Version of the GMANOVA Model. Dissertation, Virginia Commonwealth University, Richmond.

    Google Scholar 

  • Fang, K.-T., Wang, S.-G., & von Rosen, D. (2006). Restricted expected multivariate least squares. Journal of Multivariate Analysis, 97, 619–632.

    Article  MathSciNet  Google Scholar 

  • Fearn, T. (1975). A Bayesian approach to growth curves. Biometrika, 62, 89–100.

    Article  MathSciNet  Google Scholar 

  • Fearn, T. (1977). A two-stage model for growth curves which leads to Rao’s covariance adjusted estimators. Biometrika, 64, 141–143.

    Article  MathSciNet  Google Scholar 

  • Filipiak, K., & von Rosen, D. (2012). On MLEs in an extended multivariate linear growth curve model. Metrika, 75, 1069–1092.

    Article  MathSciNet  Google Scholar 

  • Fujikoshi, Y., Kanda, T., & Ohtaki, M. (1999). Growth curve model with hierarchical within-individuals design matrices. Annals of the Institute of Statistical Mathematics, 51, 707–721.

    Article  MathSciNet  Google Scholar 

  • Fujikoshi, Y., & Rao, C. R. (1991). Selection of covariables in the growth curve model. Biometrika, 78, 779–785.

    Article  MathSciNet  Google Scholar 

  • Fujikoshi, Y., & Satoh, K. (1996). Estimation and model selection in an extended growth curve model. Hiroshima Mathematical Journal, 26, 635–647.

    Article  MathSciNet  Google Scholar 

  • Geisser, S. (1970). Bayesian analysis of growth curves. Sankhy \(\bar {a}\) , Series A, 32, 53–64.

    MathSciNet  MATH  Google Scholar 

  • Geisser, S. (1980). Growth curve analysis. In P. R. Krishnaiah (Ed.), Handbook of statistics (Vol. 1, pp. 89–115). New York: North-Holland.

    Google Scholar 

  • Ghosh, M., Reid, N., & Fraser, D. A. S. (2010). Ancillary statistics: A review. Statistica Sinica, 20, 1309–1332.

    MathSciNet  MATH  Google Scholar 

  • Gleser, L. J., & Olkin, I. (1970). Linear models in multivariate analysis. In Essays in probability and statistics (pp. 267–292). Chapel Hill: University of North Carolina Press.

    Google Scholar 

  • Gleser, L. J., & Olkin, I. (1972). Estimation for a regression model with an unknown covariance matrix. In Proceedings of the Sixth Berkeley Symposium on Mathematical Statistics and Probability (University of California, Berkeley, 1970/1971), I: Theory of Statistics (pp. 541–568). Berkeley: University of California Press.

    Google Scholar 

  • Grizzle, J. E, & Allen, D. M. (1969). Analysis of growth and dose response curves. Biometrics, 25, 357–381.

    Article  Google Scholar 

  • He, D., & Xu, K. (2014). Reference priors for the growth curve model with general covariance structures. Chinese Journal of Applied Probability and Statistics, 30, 57–71.

    MathSciNet  MATH  Google Scholar 

  • Hu, J., Liu, F., & Ahmed, S. E. (2012a). Estimation of parameters in the growth curve model via an outer product least squares approach for covariance. Journal of Multivariate Analysis, 108, 53–66.

    Article  MathSciNet  Google Scholar 

  • Hu, J., Liu, F., & You, J. (2012b). Estimation of parameters in a generalized GMANOVA model based on an outer product analogy and least squares. Journal of Statistical Planning and Inference, 142, 2017–2031.

    Article  MathSciNet  Google Scholar 

  • Hu, J., & Yan, G. (2008). Asymptotic normality and consistency of a two-stage generalized least squares estimator in the growth curve model. Bernoulli, 14, 623–636.

    Article  MathSciNet  Google Scholar 

  • Hu, J., Yan, G., & You, J. (2011). Estimation for an additive growth curve model with orthogonal design matrices. Bernoulli, 17, 1400–1419.

    Article  MathSciNet  Google Scholar 

  • Kabe, D. G. (1981). MANOVA double linear hypothesis with double linear restrictions. Communications in Statistics A—Theory Methods, 10, 2545–2550.

    Article  MathSciNet  Google Scholar 

  • Kabe, D. G. (1992). Equivalence of GMANOVA and SUR models. Industrial Mathematics, 41, 53–60.

    MathSciNet  MATH  Google Scholar 

  • Kanda, T., Ohtaki. M., & Fujikoshi, Y. (2002). Simultaneous confidence regions in an extended growth curve model with k hierarchical within-individuals design matrices. Communications in Statistics—Theory and Methods, 31, 1605–1616.

    Google Scholar 

  • Kariya, T. (1978). The general MANOVA problem. The Annals of Statistics, 6, 200–214.

    Article  MathSciNet  Google Scholar 

  • Kariya, T. (1985). Testing in the multivariate general linear model. Tokyo: Kinokuniya.

    Google Scholar 

  • Kariya, T. (1989). Equivariant estimation in a model with an ancillary statistic. The Annals of Statistics, 17, 920–928.

    Article  MathSciNet  Google Scholar 

  • Kariya, T., Konno, Y., & Strawderman, W. E. (1996). Double shrinkage estimators in the GMANOVA model. Journal of Multivariate Analysis, 56, 245–258.

    Article  MathSciNet  Google Scholar 

  • Kariya, T., Konno, Y., & Strawderman, W. E. (1999). Construction of shrinkage estimators for the regression coefficient matrix in the GMANOVA model. Statistical inference and data analysis (Tokyo, 1997). Communications in Statistics—Theory and Methods, 28, 597–611.

    Article  MathSciNet  Google Scholar 

  • Kariya, T., & Kurata, H. (2004). Generalized least squares. Wiley series in probability and statistics. Chichester: Wiley.

    Book  Google Scholar 

  • Kariya, T., & Sinha, B. K. (1989). Robustness of statistical tests. Statistical modeling and decision science. Boston: Academic.

    MATH  Google Scholar 

  • Kenward, M. G. (1985). The use of fitted higher-order polynomial coefficients as covariates in the analysis of growth curves. Biometrics, 41, 19–28.

    Article  MathSciNet  Google Scholar 

  • Khatri, C. G. (1966). A note on a MANOVA model applied to problems in growth curves. Annals of the Institute of Statistical Mathematics, 18, 75–86.

    Article  MathSciNet  Google Scholar 

  • Klein, D., & Žežula, I. (2015). Maximum likelihood estimators for extended growth curve model with orthogonal between-individual design matrices. Statistical Methodology, 23, 59–72.

    Article  MathSciNet  Google Scholar 

  • Kollo, T., & von Rosen, D. (2005). Advanced multivariate statistics with matrices: Vol. 579. Mathematics and its applications. Dordrecht: Springer.

    Book  Google Scholar 

  • Kubokawa, T., Saleh, A. K. Md. E., & Morita, K. (1992). Improving on MLE of coefficient matrix in a growth curve model. Journal of Statistical Planning and Inference, 31, 169–177.

    Google Scholar 

  • Kubokawa, T., & Srivastava, M. S. (2001). Robust improvement in estimation of a mean matrix in an elliptically contoured distribution. Journal of Multivariate Analysis, 76, 138–152.

    Article  MathSciNet  Google Scholar 

  • Lee, J. C., & Geisser, S. (1972). Growth curve prediction. Sankhy \(\bar {a}\) , Series A, 34, 393–412.

    MathSciNet  MATH  Google Scholar 

  • Lee, J. C., & Geisser, S. (1975). Applications of growth curve prediction. Sankhy \(\bar {a}\) , Series A, 37, 239–256.

    MathSciNet  Google Scholar 

  • Lewis, C., & van Knippenberg, C. (1984). Estimation and model comparisons for repeated measures data. Psychological Bulletin, 96, 182–194.

    Article  Google Scholar 

  • Liu, F., Hu, J., & Chu, G. (2015). Estimation of parameters in the extended growth curve model via outer product least squares for covariance. Linear Algebra and Its Applications, 473, 236–260.

    Article  MathSciNet  Google Scholar 

  • Mikulich, S. K., Zerbe, G. O., Jones, R. H., & Crowley, T. J. (1999). Relating the classical covariance adjustment techniques of multivariate growth curve models to modern univariate mixed effects models. Biometrics, 55, 957–964.

    Article  Google Scholar 

  • Potthoff, R. F., & Roy, S. N. (1964). A generalized multivariate analysis of variance model useful especially for growth curve problems. Biometrika, 51, 313–326.

    Article  MathSciNet  Google Scholar 

  • Rao, C. R. (1965). The theory of least squares when the parameters are stochastic and its application to the analysis of growth curves. Biometrika, 52, 447–458.

    Article  MathSciNet  Google Scholar 

  • Rao, C. R. (1966). Covariance adjustment and related problems in multivariate analysis. In P. R. Krishnaiah (Ed.), Multivariate analysis (pp. 87–103). New York: Academic.

    Google Scholar 

  • Rao, C. R. (1967). Least squares theory using an estimated dispersion matrix and its application to measurement of signals. In Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability (Berkeley, CA, 1965/66), I: Statistics (pp. 355–372). Berkeley: University of California Press.

    Google Scholar 

  • Soler, J. M. P., & Singer, J. M. (2000). Optimal covariance adjustment in growth curve models. Computational Statistics and Data Analysis, 33, 101–110.

    Article  Google Scholar 

  • Srivastava, M. S. (2002). Nested growth curve models. Selected articles from San Antonio Conference in honour of C. Radhakrishna Rao (San Antonio, TX, 2000). Sankhy \(\bar {a}\) , Series A, 64, 379–408.

    Google Scholar 

  • Srivastava, M. S., & Khatri, C. G. (1979). An introduction to multivariate statistics. New York: North-Holland.

    MATH  Google Scholar 

  • Srivastava, M. S., & von Rosen, D. (2002). Regression models with unknown singular covariance matrix. Linear Algebra and Its Applications, 354, 255–273.

    Article  MathSciNet  Google Scholar 

  • Stanek, E. J. III, & Koch, G. G. (1985). The equivalence of parameter estimates from growth curve models and seemingly unrelated regression models. The American Statistician, 39, 149–152.

    Article  Google Scholar 

  • Takane, Y., & Zhou, L. (2012). On two expressions of the MLE for a special case of the extended growth curve models. Linear Algebra and Its Applications, 436, 2567–2577.

    Article  MathSciNet  Google Scholar 

  • Tan, M. (1991). Improved estimators for the GMANOVA problem with application to Monte Carlo simulation. Journal of Multivariate Analysis, 38, 262–274.

    Article  MathSciNet  Google Scholar 

  • Timm, N. H. (1997). The CGMANOVA model. Communications in Statistics—Theory and Methods, 26, 1083–1098.

    Article  MathSciNet  Google Scholar 

  • Tubbs, J. D., Lewis, T. O., & Duran, B. S. (1975). A note on the analysis of the MANOVA model and its application to growth curves. Communications in Statistics, 4, 643–653.

    Article  MathSciNet  Google Scholar 

  • Vasdekis, V. G. S. (2008). A comparison of REML and covariance adjustment method in the estimation of growth curve models. Communications in Statistics—Theory and Methods, 37, 3287–3297.

    Article  MathSciNet  Google Scholar 

  • Verbyla, A. P. (1986). Conditioning in the growth curve model. Biometrika, 73, 475–483.

    Article  MathSciNet  Google Scholar 

  • Verbyla, A. P., & Venables, W. N. (1988). An extension of the growth curve model. Biometrika, 75, 129–138.

    Article  MathSciNet  Google Scholar 

  • von Rosen, D. (1985). Multivariate Linear Normal Models with Special References to the Growth Curve Model. Dissertation, Stockholm University.

    Google Scholar 

  • von Rosen, D. (1989). Maximum likelihood estimators in multivariate linear normal models. Journal of Multivariate Analysis, 31, 187–200.

    Article  MathSciNet  Google Scholar 

  • Wong, C. S., & Cheng, H. (2001). Estimation in a growth curve model with singular covariance. Journal of Statistical Planning and Inference, 97, 323–342.

    Article  MathSciNet  Google Scholar 

  • Wong, C. S., Masaro, J., & Deng, W. C. (1995). Estimating covariance in a growth curve model. Linear Algebra and Its Applications, 214, 103–118.

    Article  MathSciNet  Google Scholar 

  • Wu, Q.-G. (1998). Existence conditions of the uniformly minimum risk unbiased estimators in extended growth curve models. Journal of Statistical Planning and Inference, 69, 101–114.

    Article  MathSciNet  Google Scholar 

  • Wu, Q.-G. (2000). Some results on parameter estimation in extended growth curve models. Journal of Statistical Planning and Inference, 88, 285–300.

    Article  MathSciNet  Google Scholar 

  • Wu, X., Zou, G., & Chen, J. (2006). Unbiased invariant minimum norm estimation in generalized growth curve model. Journal of Multivariate Analysis, 97, 1718–1741.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Energy and Technology, Swedish University of Agricultural Sciences, Uppsala, Sweden

    Dietrich von Rosen

Authors
  1. Dietrich von Rosen
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

von Rosen, D. (2018). The Basic Ideas of Obtaining MLEs: Unknown Dispersion. In: Bilinear Regression Analysis. Lecture Notes in Statistics, vol 220. Springer, Cham. https://doi.org/10.1007/978-3-319-78784-8_3

Download citation

Publish with us

Policies and ethics

Search

Navigation