Skip to main content

Permissible Covariance Structures for Simultaneous Retention of BLUEs in Small and Big Linear Models

  • Chapter
  • First Online:
Applied Linear Algebra, Probability and Statistics

Abstract

In this article, we consider the partitioned linear model \(\mathscr {M}_{12}({\textbf {V}}_{0}) = \{ {\textbf {y}}, \, {\textbf {X}}_{1}\boldsymbol{\beta }_{1} + {\textbf {X}}_{2}\boldsymbol{\beta }_{2}, \, {\textbf {V}}_{0} \}\) and the corresponding small model \(\mathscr {M}_{1}({\textbf {V}}_{0}) = \{ {\textbf {y}}, \, {\textbf {X}}_{1} \boldsymbol{\beta }_{1}, \, {\textbf {V}}_{0} \} .\) Following Rao [14, Sect. 5], we can characterize the set \(\mathscr {V}_{12}\) of nonnegative definite matrices \({\textbf {V}}\) such that every representation of the best linear unbiased estimator, BLUE, of \(\boldsymbol{\mu } = {\textbf {X}}\boldsymbol{\beta }\) under \(\mathscr {M}_{12}({\textbf {V}}_{0}) \) remains BLUE under \(\mathscr {M}_{12}({\textbf {V}}) \). Correspondingly, we can characterize the set \(\mathscr {V}_{1}\) of matrices \({\textbf {V}}\) such that every BLUE of \(\boldsymbol{\mu }_{1} = {\textbf {X}}_{1}\boldsymbol{\beta }_{1}\) under \(\mathscr {M}_{1}({\textbf {V}}_{0}) \) remains BLUE under \(\mathscr {M}_{1}({\textbf {V}}) \). In the first three sections of this paper, we focus on the mutual relations between the sets \(\mathscr {V}_{1}\) and \(\mathscr {V}_{12}\). In Section 5, we assume that under the small model \(\mathscr {M}_{1}\) the ordinary least squares estimator, OLSE, of \(\boldsymbol{\mu }_{1} \) equals the \(\textrm{BLUE}\) of \(\boldsymbol{\mu }_{1} \) and give several characterizations for the continuation of the equality of OLSE and BLUE when more X-variables are added.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Baksalary OM, Trenkler G (2013) On column and null spaces of functions of a pair of oblique projectors. Linear Multilinear Algebra 61:1116–1129. https://doi.org/10.1080/03081087.2012.731055

  2. Baksalary OM, Trenkler G, Liski E (2013) Let us do the twist again. Stat Pap 54:1109–1119. https://doi.org/10.1007/s00362-013-0512-3

  3. Haslett SJ (2021) The role of block diagonal matrices in conditions for equality of BLUEs in linear models. In: Online talk given in the 28th international workshop on matrices and statistics, Manipal Academy of Higher Education, India. https://carams.in/events/iwms2021/

  4. Haslett SJ, Puntanen S (2010) Effect of adding regressors on the equality of the BLUEs under two linear models. J Stat Plann Inference 140:104–110. http://dx.doi.org/10.1016/j.jspi.2009.06.010

  5. Haslett SJ, Markiewicz A, Puntanen S (2022) Properties of BLUEs in full versus small linear models. Commun Stat Theory Methods. https://doi.org/10.1080/03610926.2022.2052899

  6. Isotalo J, Puntanen S (2009) A note on the equality of the OLSE and the BLUE of the parametric function in the general Gauss–Markov model. Stat Pap 50:185–193. http://dx.doi.org/10.1007/s00362-007-0055-6

  7. Isotalo J, Puntanen S, Styan GPH (2007) Effect of adding regressors on the equality of the OLSE and BLUE. Int J Stat Sci 6:193–201. http://people.uta.fi/~simo.puntanen/Isotalo-Puntanen-Styan-IJSS-2007.pdf

  8. Krämer W (1980) A note on the equality of ordinary least squares and Gauss-Markov estimates in the general linear model. Sankhyā, Ser A 42:130–131. https://www.jstor.org/stable/25050222

  9. Mathew T, Bhimasankaram P (1983) On the robustness of LRT in singular linear models. Sankhyā Ser A 45:301–312. https://www.jstor.org/stable/25050442

  10. Mitra SK, Moore BJ (1973) Gauss–Markov estimation with an incorrect dispersion matrix. Sankhyā, Ser A 35:139–152. https://www.jstor.org/stable/25049864

  11. Puntanen S, Styan GPH, Isotalo J (2011) Matrix tricks for linear statistical models: our personal top twenty. Springer, Heidelberg. http://dx.doi.org/10.1007/978-3-642-10473-2

  12. Rao CR (1967) Least squares theory using an estimated dispersion matrix and its application to measurement of signals. In: Lucien M, Cam L, Neyman J (eds) Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, vol 1, University of California Press, Berkeley, pp 355–372. https://projecteuclid.org/euclid.bsmsp/1200512997

  13. Rao CR (1968) A note on a previous lemma in the theory of least squares and some further results. Sankhyā, Ser A 30:259–266. https://www.jstor.org/stable/25041357

  14. Rao CR (1971) Unified theory of linear estimation. Sankhyā, Ser A 33:371–394. https://www.jstor.org/stable/25049750

  15. Rao CR (1973) Representations of best linear estimators in the Gauss–Markoff model with a singular dispersion matrix. J Multivar Anal 3:276–292. http://dx.doi.org/10.1016/0047-259X(73)90042-0

  16. Zyskind G (1967) On canonical forms, non-negative covariance matrices and best and simple least squares linear estimators in linear models. Ann Math Stat 38:1092–1109. https://www.jstor.org/stable/2238829

Download references

Acknowledgements

This research has its origin in the first author’s online talk, see Haslett [3], considering the related problems from a different perspective, in the 28th International Workshop on Matrices and Statistics, Manipal Academy of Higher Education, India, 13–15 December 2021. Thanks go to the anonymous referee for constructive remarks.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Simo Puntanen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Haslett, S.J., Isotalo, J., Markiewicz, A., Puntanen, S. (2023). Permissible Covariance Structures for Simultaneous Retention of BLUEs in Small and Big Linear Models. In: Bapat, R.B., Karantha, M.P., Kirkland, S.J., Neogy, S.K., Pati, S., Puntanen, S. (eds) Applied Linear Algebra, Probability and Statistics. Indian Statistical Institute Series. Springer, Singapore. https://doi.org/10.1007/978-981-99-2310-6_11

Download citation

Publish with us

Policies and ethics