Abstract
In this article we consider the linear sufficiency of statistic \(\mathbf {F}\mathbf {y}\) when estimating the estimable parametric function of \(\varvec{\beta }\) under the linear model \( \mathscr {A}= \{\mathbf {y}, \mathbf {X}\varvec{\beta }, \mathbf {V}\}\). We review some properties that have not been received much attention in the literature and provide some new results and insight into the meaning of the linear sufficiency . In particular, we consider the best linear unbiased estimation (\(\mathrm {BLUE})\) under the transformed model \( \mathscr {A}_{t}= \{ \mathbf {F}\mathbf {y}, \mathbf {F}\mathbf {X}\varvec{\beta }, \mathbf {F}\mathbf {V}\mathbf {F}' \}\) and study the possibilities to measure the relative linear sufficiency of \(\mathbf {F}\mathbf {y}\) by comparing the \(\mathrm {BLUE}\)s under \(\mathscr {A}\) and \(\mathscr {A}_{t}\). We also consider some new properties of the Euclidean norm of the distance of the BLUEs under \(\mathscr {A}\) and \(\mathscr {A}_{t}\). The concept of linear sufficiency was essentially introduced in early 1980s by Baksalary, Kala and Drygas, but to our knowledge the concept of relative linear sufficiency nor the Euclidean norm of the difference between the \(\mathrm {BLUE}\)s under \(\mathscr {A}\) and \(\mathscr {A}_{t}\) have not appeared in the literature. To make the article more self-readable we go through some basic concepts related to linear sufficiency . We also provide a rather extensive list of relevant references.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aitken, A.C.: On least squares and linear combination of observations. Proc. R. Soc. Edinburgh Sect. A 55, 42–49 (1935)
Arendacká, B., Puntanen, S.: Further remarks on the connection between fixed linear model and mixed linear model. Stat. Pap. 56, 1235–1247 (2015)
Baksalary, J.K.: An elementary development of the equation characterizing best linear unbiased estimators. Linear Algebra Appl. 388, 3–6 (2004)
Baksalary, J.K., Drygas, H.: A note on the concepts of sufficiency in the general Gauss–Markov model: a coordinate-free approach. Forschungsbericht 92/2, Universität Dortmund, Fachbereich Statistik (1992)
Baksalary, J.K., Kala, R.: A bound for the Euclidean norm of the difference between the least squares and the best linear unbiased estimators. Ann. Stat. 6, 1390–1393 (1978)
Baksalary, J.K., Kala, R.: A new bound for the Euclidean norm of the difference between the least squares and the best linear unbiased estimators. Ann. Stat. 8, 679–681 (1980)
Baksalary, J.K., Kala, R.: Linear transformations preserving best linear unbiased estimators in a general Gauss-Markoff model. Ann. Stat. 9, 913–916 (1981)
Baksalary, J.K., Kala, R.: Linear sufficiency with respect to a given vector of parametric functions. J. Stat. Plan. Inf. 14, 331–338 (1986)
Baksalary, J.K., Mathew, T.: Linear sufficiency and completeness in an incorrectly specified general Gauss-Markov model. Sankhyā Ser. A 48, 169–180 (1986)
Baksalary, J.K., Mathew, T.: Rank invariance criterion and its application to the unified theory of least squares. Linear Algebra Appl. 127, 393–401 (1990)
Baksalary, J.K., Puntanen, S.: Weighted-least-squares estimation in the general Gauss–Markov model. In: Dodge, Y. (ed.) Statistical Data Analysis and Inference, pp. 355–368. Elsevier Science Publishers B.V., Amsterdam (1989)
Baksalary, J.K., Puntanen, S., Styan, G.P.H.: A property of the dispersion matrix of the best linear unbiased estimator in the general Gauss-Markov model. Sankhyā Ser. A 52, 279–296 (1990)
Baksalary, J.K., Rao, C.R., Markiewicz, A.: A study of the influence of the "natural restrictions" on estimation problems in the singular Gauss-Markov model. J. Stat. Plan. Inf. 31, 335–351 (1992)
Baksalary, O.M., Trenkler, G., Liski, E.: Let us do the twist again. Stat. Pap. 54, 1109–1119 (2013)
Ben-Israel, A., Greville, T.N.E.: Generalized Inverses: Theory and Applications, \(2\)nd edn. Springer, New York (2003)
Bloomfield, P., Watson, G.S.: The inefficiency of least squares. Biometrika 62, 121–128 (1975)
Christensen, R.: Plane Answers to Complex Questions: The Theory of Linear Models, \(4\)th edn. Springer, New York (2011)
Drygas, H.: The Coordinate-Free Approach to Gauss-Markov Estimation. Springer, Berlin (1970)
Drygas, H.: Sufficiency and completeness in the general Gauss-Markov model. Sankhyā Ser. A 45, 88–98 (1983)
Groß, J.: A note on the concepts of linear and quadratic sufficiency. J. Stat. Plan. Inf. 70, 88–98 (1998)
Groß, J.: The general Gauss-Markov model with possibly singular dispersion matrix. Stat. Pap. 45, 311–336 (2004)
Groß, J., Puntanen, S.: Estimation under a general partitioned linear model. Linear Algebra Appl. 321, 131–144 (2000)
Groß, J., Puntanen, S.: Extensions of the Frisch-Waugh-Lovell Theorem. Discussiones Mathematicae - Probab. Stat. 25, 39–49 (2005)
Haslett, S.J., Isotalo, J., Liu, Y., Puntanen, S.: Equalities between OLSE, BLUE and BLUP in the linear model. Stat. Pap. 55, 543–561 (2014)
Hauke, J., Markiewicz, A., Puntanen, S.: Comparing the BLUEs under two linear models. Commun. Stat. Theory Methods 41, 2405–2418 (2012)
Isotalo, J., Puntanen, S.: Linear sufficiency and completeness in the partitioned linear model. Acta Comment Univ. Tartu Math. 10, 53–67 (2006a)
Isotalo, J., Puntanen, S.: Linear prediction sufficiency for new observations in the general Gauss-Markov model. Commun. Stat. Theory Methods 35, 1011–1023 (2006b)
Kala, R., Pordzik, P.R.: Estimation in singular partitioned, reduced or transformed linear models. Stat. Pap. 50, 633–638 (2009)
Kala, R., Puntanen, S., Tian, Y.: Some notes on linear sufficiency. Stat. Pap. (2015). doi:10.1007/s00362-015-0682-2
Kornacki, A.: Different kinds of sufficiency in the general Gauss-Markov model. Math. Slovaca 57, 389–392 (2007)
Marsaglia, G., Styan, G.P.H.: Equalities and inequalities for ranks of matrices. Linear and Multilinear Algebra 2, 269–292 (1974)
Müller, J.: Sufficiency and completeness in the linear model. J. Multivar. Anal. 21, 312–323 (1987)
Mäkinen, J.: Bounds for the difference between a linear unbiased estimate and the best linear unbiased estimate. Phys. Chem. Earth Pt A. 25, 693–698 (2000)
Mäkinen, J.: A bound for the Euclidean norm of the difference between the best linear unbiased estimator and a linear unbiased estimator. J. Geodesy 76, 317–322 (2002)
Pordzik, P.R.: A bound for the Euclidean distance between restricted and unrestricted estimators of parametric functions in the general linear model. Stat. Pap. 53, 299–304 (2012)
Puntanen, S., Styan, G.P.H.: The equality of the ordinary least squares estimator and the best linear unbiased estimator (with discussion). Am. Stat. 43, 151–161 (1989). (Commented by O. Kempthorne on pp. 161–162 and by S. R. Searle on pp. 162–163, Reply by the authors on p. 164)
Puntanen, S., Styan, G.P.H., Isotalo, J.: Matrix Tricks for Linear Statistical Models: Our Personal Top Twenty. Springer, Heidelberg (2011)
Rao, C.R.: Representations of best linear estimators in the Gauss-Markoff model with a singular dispersion matrix. J. Multivar. Anal. 3, 276–292 (1973)
Rao, C.R., Mitra, S.K.: Generalized Inverse of Matrices and Its Applications. Wiley, New York (1971)
Tian, Y., Puntanen, S.: On the equivalence of estimations under a general linear model and its transformed models. Linear Algebra Appl. 430, 2622–2641 (2009)
Watson, G.S.: Serial correlation in regression analysis. I. Biometrika 42, 327–341 (1955)
Zyskind, G., Martin, F.B.: On best linear estimation and general Gauss-Markov theorem in linear models with arbitrary nonnegative covariance structure. SIAM J. Appl. Math. 17, 1190–1202 (1969)
Acknowledgements
Part of this research was done during the meetings of an International Research Group on Multivariate Models in the Mathematical Research and Conference Center, Bȩdlewo, Poland, March 2015 and October 2015, supported by the Stefan Banach International Mathematical Center.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Kala, R., Markiewicz, A., Puntanen, S. (2017). Some Further Remarks on the Linear Sufficiency in the Linear Model. In: Bebiano, N. (eds) Applied and Computational Matrix Analysis. MAT-TRIAD 2015. Springer Proceedings in Mathematics & Statistics, vol 192. Springer, Cham. https://doi.org/10.1007/978-3-319-49984-0_19
Download citation
DOI: https://doi.org/10.1007/978-3-319-49984-0_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-49982-6
Online ISBN: 978-3-319-49984-0
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)