Abstract
In this article, we consider the partitioned linear model \(\mathscr {M}_{12}({\textbf {V}}_{0}) = \{ {\textbf {y}}, \, {\textbf {X}}_{1}\boldsymbol{\beta }_{1} + {\textbf {X}}_{2}\boldsymbol{\beta }_{2}, \, {\textbf {V}}_{0} \}\) and the corresponding small model \(\mathscr {M}_{1}({\textbf {V}}_{0}) = \{ {\textbf {y}}, \, {\textbf {X}}_{1} \boldsymbol{\beta }_{1}, \, {\textbf {V}}_{0} \} .\) Following Rao [14, Sect. 5], we can characterize the set \(\mathscr {V}_{12}\) of nonnegative definite matrices \({\textbf {V}}\) such that every representation of the best linear unbiased estimator, BLUE, of \(\boldsymbol{\mu } = {\textbf {X}}\boldsymbol{\beta }\) under \(\mathscr {M}_{12}({\textbf {V}}_{0}) \) remains BLUE under \(\mathscr {M}_{12}({\textbf {V}}) \). Correspondingly, we can characterize the set \(\mathscr {V}_{1}\) of matrices \({\textbf {V}}\) such that every BLUE of \(\boldsymbol{\mu }_{1} = {\textbf {X}}_{1}\boldsymbol{\beta }_{1}\) under \(\mathscr {M}_{1}({\textbf {V}}_{0}) \) remains BLUE under \(\mathscr {M}_{1}({\textbf {V}}) \). In the first three sections of this paper, we focus on the mutual relations between the sets \(\mathscr {V}_{1}\) and \(\mathscr {V}_{12}\). In Section 5, we assume that under the small model \(\mathscr {M}_{1}\) the ordinary least squares estimator, OLSE, of \(\boldsymbol{\mu }_{1} \) equals the \(\textrm{BLUE}\) of \(\boldsymbol{\mu }_{1} \) and give several characterizations for the continuation of the equality of OLSE and BLUE when more X-variables are added.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Baksalary OM, Trenkler G (2013) On column and null spaces of functions of a pair of oblique projectors. Linear Multilinear Algebra 61:1116–1129. https://doi.org/10.1080/03081087.2012.731055
Baksalary OM, Trenkler G, Liski E (2013) Let us do the twist again. Stat Pap 54:1109–1119. https://doi.org/10.1007/s00362-013-0512-3
Haslett SJ (2021) The role of block diagonal matrices in conditions for equality of BLUEs in linear models. In: Online talk given in the 28th international workshop on matrices and statistics, Manipal Academy of Higher Education, India. https://carams.in/events/iwms2021/
Haslett SJ, Puntanen S (2010) Effect of adding regressors on the equality of the BLUEs under two linear models. J Stat Plann Inference 140:104–110. http://dx.doi.org/10.1016/j.jspi.2009.06.010
Haslett SJ, Markiewicz A, Puntanen S (2022) Properties of BLUEs in full versus small linear models. Commun Stat Theory Methods. https://doi.org/10.1080/03610926.2022.2052899
Isotalo J, Puntanen S (2009) A note on the equality of the OLSE and the BLUE of the parametric function in the general Gauss–Markov model. Stat Pap 50:185–193. http://dx.doi.org/10.1007/s00362-007-0055-6
Isotalo J, Puntanen S, Styan GPH (2007) Effect of adding regressors on the equality of the OLSE and BLUE. Int J Stat Sci 6:193–201. http://people.uta.fi/~simo.puntanen/Isotalo-Puntanen-Styan-IJSS-2007.pdf
Krämer W (1980) A note on the equality of ordinary least squares and Gauss-Markov estimates in the general linear model. Sankhyā, Ser A 42:130–131. https://www.jstor.org/stable/25050222
Mathew T, Bhimasankaram P (1983) On the robustness of LRT in singular linear models. Sankhyā Ser A 45:301–312. https://www.jstor.org/stable/25050442
Mitra SK, Moore BJ (1973) Gauss–Markov estimation with an incorrect dispersion matrix. Sankhyā, Ser A 35:139–152. https://www.jstor.org/stable/25049864
Puntanen S, Styan GPH, Isotalo J (2011) Matrix tricks for linear statistical models: our personal top twenty. Springer, Heidelberg. http://dx.doi.org/10.1007/978-3-642-10473-2
Rao CR (1967) Least squares theory using an estimated dispersion matrix and its application to measurement of signals. In: Lucien M, Cam L, Neyman J (eds) Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, vol 1, University of California Press, Berkeley, pp 355–372. https://projecteuclid.org/euclid.bsmsp/1200512997
Rao CR (1968) A note on a previous lemma in the theory of least squares and some further results. Sankhyā, Ser A 30:259–266. https://www.jstor.org/stable/25041357
Rao CR (1971) Unified theory of linear estimation. Sankhyā, Ser A 33:371–394. https://www.jstor.org/stable/25049750
Rao CR (1973) Representations of best linear estimators in the Gauss–Markoff model with a singular dispersion matrix. J Multivar Anal 3:276–292. http://dx.doi.org/10.1016/0047-259X(73)90042-0
Zyskind G (1967) On canonical forms, non-negative covariance matrices and best and simple least squares linear estimators in linear models. Ann Math Stat 38:1092–1109. https://www.jstor.org/stable/2238829
Acknowledgements
This research has its origin in the first author’s online talk, see Haslett [3], considering the related problems from a different perspective, in the 28th International Workshop on Matrices and Statistics, Manipal Academy of Higher Education, India, 13–15 December 2021. Thanks go to the anonymous referee for constructive remarks.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Haslett, S.J., Isotalo, J., Markiewicz, A., Puntanen, S. (2023). Permissible Covariance Structures for Simultaneous Retention of BLUEs in Small and Big Linear Models. In: Bapat, R.B., Karantha, M.P., Kirkland, S.J., Neogy, S.K., Pati, S., Puntanen, S. (eds) Applied Linear Algebra, Probability and Statistics. Indian Statistical Institute Series. Springer, Singapore. https://doi.org/10.1007/978-981-99-2310-6_11
Download citation
DOI: https://doi.org/10.1007/978-981-99-2310-6_11
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-2309-0
Online ISBN: 978-981-99-2310-6
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)