Skip to main content

Some Further Remarks on the Linear Sufficiency in the Linear Model

  • Conference paper
  • First Online:
Applied and Computational Matrix Analysis (MAT-TRIAD 2015)

Part of the book series: Springer Proceedings in Mathematics & Statistics ((PROMS,volume 192))

Included in the following conference series:

Abstract

In this article we consider the linear sufficiency of statistic \(\mathbf {F}\mathbf {y}\) when estimating the estimable parametric function of \(\varvec{\beta }\) under the linear model \( \mathscr {A}= \{\mathbf {y}, \mathbf {X}\varvec{\beta }, \mathbf {V}\}\). We review some properties that have not been received much attention in the literature and provide some new results and insight into the meaning of the linear sufficiency . In particular, we consider the best linear unbiased estimation (\(\mathrm {BLUE})\) under the transformed model \( \mathscr {A}_{t}= \{ \mathbf {F}\mathbf {y}, \mathbf {F}\mathbf {X}\varvec{\beta }, \mathbf {F}\mathbf {V}\mathbf {F}' \}\) and study the possibilities to measure the relative linear sufficiency of \(\mathbf {F}\mathbf {y}\) by comparing the \(\mathrm {BLUE}\)s under \(\mathscr {A}\) and \(\mathscr {A}_{t}\). We also consider some new properties of the Euclidean norm of the distance of the BLUEs under \(\mathscr {A}\) and \(\mathscr {A}_{t}\). The concept of linear sufficiency was essentially introduced in early 1980s by Baksalary, Kala and Drygas, but to our knowledge the concept of relative linear sufficiency nor the Euclidean norm of the difference between the \(\mathrm {BLUE}\)s under \(\mathscr {A}\) and \(\mathscr {A}_{t}\) have not appeared in the literature. To make the article more self-readable we go through some basic concepts related to linear sufficiency . We also provide a rather extensive list of relevant references.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aitken, A.C.: On least squares and linear combination of observations. Proc. R. Soc. Edinburgh Sect. A 55, 42–49 (1935)

    Article  MATH  Google Scholar 

  2. Arendacká, B., Puntanen, S.: Further remarks on the connection between fixed linear model and mixed linear model. Stat. Pap. 56, 1235–1247 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  3. Baksalary, J.K.: An elementary development of the equation characterizing best linear unbiased estimators. Linear Algebra Appl. 388, 3–6 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  4. Baksalary, J.K., Drygas, H.: A note on the concepts of sufficiency in the general Gauss–Markov model: a coordinate-free approach. Forschungsbericht 92/2, Universität Dortmund, Fachbereich Statistik (1992)

    Google Scholar 

  5. Baksalary, J.K., Kala, R.: A bound for the Euclidean norm of the difference between the least squares and the best linear unbiased estimators. Ann. Stat. 6, 1390–1393 (1978)

    Article  MathSciNet  MATH  Google Scholar 

  6. Baksalary, J.K., Kala, R.: A new bound for the Euclidean norm of the difference between the least squares and the best linear unbiased estimators. Ann. Stat. 8, 679–681 (1980)

    Article  MathSciNet  MATH  Google Scholar 

  7. Baksalary, J.K., Kala, R.: Linear transformations preserving best linear unbiased estimators in a general Gauss-Markoff model. Ann. Stat. 9, 913–916 (1981)

    Article  MathSciNet  MATH  Google Scholar 

  8. Baksalary, J.K., Kala, R.: Linear sufficiency with respect to a given vector of parametric functions. J. Stat. Plan. Inf. 14, 331–338 (1986)

    Article  MathSciNet  MATH  Google Scholar 

  9. Baksalary, J.K., Mathew, T.: Linear sufficiency and completeness in an incorrectly specified general Gauss-Markov model. Sankhyā Ser. A 48, 169–180 (1986)

    MathSciNet  MATH  Google Scholar 

  10. Baksalary, J.K., Mathew, T.: Rank invariance criterion and its application to the unified theory of least squares. Linear Algebra Appl. 127, 393–401 (1990)

    Article  MathSciNet  MATH  Google Scholar 

  11. Baksalary, J.K., Puntanen, S.: Weighted-least-squares estimation in the general Gauss–Markov model. In: Dodge, Y. (ed.) Statistical Data Analysis and Inference, pp. 355–368. Elsevier Science Publishers B.V., Amsterdam (1989)

    Google Scholar 

  12. Baksalary, J.K., Puntanen, S., Styan, G.P.H.: A property of the dispersion matrix of the best linear unbiased estimator in the general Gauss-Markov model. Sankhyā Ser. A 52, 279–296 (1990)

    MathSciNet  MATH  Google Scholar 

  13. Baksalary, J.K., Rao, C.R., Markiewicz, A.: A study of the influence of the "natural restrictions" on estimation problems in the singular Gauss-Markov model. J. Stat. Plan. Inf. 31, 335–351 (1992)

    Article  MathSciNet  MATH  Google Scholar 

  14. Baksalary, O.M., Trenkler, G., Liski, E.: Let us do the twist again. Stat. Pap. 54, 1109–1119 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  15. Ben-Israel, A., Greville, T.N.E.: Generalized Inverses: Theory and Applications, \(2\)nd edn. Springer, New York (2003)

    Google Scholar 

  16. Bloomfield, P., Watson, G.S.: The inefficiency of least squares. Biometrika 62, 121–128 (1975)

    Article  MathSciNet  MATH  Google Scholar 

  17. Christensen, R.: Plane Answers to Complex Questions: The Theory of Linear Models, \(4\)th edn. Springer, New York (2011)

    Google Scholar 

  18. Drygas, H.: The Coordinate-Free Approach to Gauss-Markov Estimation. Springer, Berlin (1970)

    Book  MATH  Google Scholar 

  19. Drygas, H.: Sufficiency and completeness in the general Gauss-Markov model. Sankhyā Ser. A 45, 88–98 (1983)

    MathSciNet  MATH  Google Scholar 

  20. Groß, J.: A note on the concepts of linear and quadratic sufficiency. J. Stat. Plan. Inf. 70, 88–98 (1998)

    MathSciNet  MATH  Google Scholar 

  21. Groß, J.: The general Gauss-Markov model with possibly singular dispersion matrix. Stat. Pap. 45, 311–336 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  22. Groß, J., Puntanen, S.: Estimation under a general partitioned linear model. Linear Algebra Appl. 321, 131–144 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  23. Groß, J., Puntanen, S.: Extensions of the Frisch-Waugh-Lovell Theorem. Discussiones Mathematicae - Probab. Stat. 25, 39–49 (2005)

    MathSciNet  MATH  Google Scholar 

  24. Haslett, S.J., Isotalo, J., Liu, Y., Puntanen, S.: Equalities between OLSE, BLUE and BLUP in the linear model. Stat. Pap. 55, 543–561 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  25. Hauke, J., Markiewicz, A., Puntanen, S.: Comparing the BLUEs under two linear models. Commun. Stat. Theory Methods 41, 2405–2418 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  26. Isotalo, J., Puntanen, S.: Linear sufficiency and completeness in the partitioned linear model. Acta Comment Univ. Tartu Math. 10, 53–67 (2006a)

    MathSciNet  MATH  Google Scholar 

  27. Isotalo, J., Puntanen, S.: Linear prediction sufficiency for new observations in the general Gauss-Markov model. Commun. Stat. Theory Methods 35, 1011–1023 (2006b)

    Article  MathSciNet  MATH  Google Scholar 

  28. Kala, R., Pordzik, P.R.: Estimation in singular partitioned, reduced or transformed linear models. Stat. Pap. 50, 633–638 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  29. Kala, R., Puntanen, S., Tian, Y.: Some notes on linear sufficiency. Stat. Pap. (2015). doi:10.1007/s00362-015-0682-2

    Google Scholar 

  30. Kornacki, A.: Different kinds of sufficiency in the general Gauss-Markov model. Math. Slovaca 57, 389–392 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  31. Marsaglia, G., Styan, G.P.H.: Equalities and inequalities for ranks of matrices. Linear and Multilinear Algebra 2, 269–292 (1974)

    Article  MathSciNet  MATH  Google Scholar 

  32. Müller, J.: Sufficiency and completeness in the linear model. J. Multivar. Anal. 21, 312–323 (1987)

    Article  MathSciNet  Google Scholar 

  33. Mäkinen, J.: Bounds for the difference between a linear unbiased estimate and the best linear unbiased estimate. Phys. Chem. Earth Pt A. 25, 693–698 (2000)

    Article  Google Scholar 

  34. Mäkinen, J.: A bound for the Euclidean norm of the difference between the best linear unbiased estimator and a linear unbiased estimator. J. Geodesy 76, 317–322 (2002)

    Article  MATH  Google Scholar 

  35. Pordzik, P.R.: A bound for the Euclidean distance between restricted and unrestricted estimators of parametric functions in the general linear model. Stat. Pap. 53, 299–304 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  36. Puntanen, S., Styan, G.P.H.: The equality of the ordinary least squares estimator and the best linear unbiased estimator (with discussion). Am. Stat. 43, 151–161 (1989). (Commented by O. Kempthorne on pp. 161–162 and by S. R. Searle on pp. 162–163, Reply by the authors on p. 164)

    Google Scholar 

  37. Puntanen, S., Styan, G.P.H., Isotalo, J.: Matrix Tricks for Linear Statistical Models: Our Personal Top Twenty. Springer, Heidelberg (2011)

    Book  MATH  Google Scholar 

  38. Rao, C.R.: Representations of best linear estimators in the Gauss-Markoff model with a singular dispersion matrix. J. Multivar. Anal. 3, 276–292 (1973)

    Article  MathSciNet  MATH  Google Scholar 

  39. Rao, C.R., Mitra, S.K.: Generalized Inverse of Matrices and Its Applications. Wiley, New York (1971)

    MATH  Google Scholar 

  40. Tian, Y., Puntanen, S.: On the equivalence of estimations under a general linear model and its transformed models. Linear Algebra Appl. 430, 2622–2641 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  41. Watson, G.S.: Serial correlation in regression analysis. I. Biometrika 42, 327–341 (1955)

    Article  MathSciNet  MATH  Google Scholar 

  42. Zyskind, G., Martin, F.B.: On best linear estimation and general Gauss-Markov theorem in linear models with arbitrary nonnegative covariance structure. SIAM J. Appl. Math. 17, 1190–1202 (1969)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

Part of this research was done during the meetings of an International Research Group on Multivariate Models in the Mathematical Research and Conference Center, Bȩdlewo, Poland, March 2015 and October 2015, supported by the Stefan Banach International Mathematical Center.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Simo Puntanen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Kala, R., Markiewicz, A., Puntanen, S. (2017). Some Further Remarks on the Linear Sufficiency in the Linear Model. In: Bebiano, N. (eds) Applied and Computational Matrix Analysis. MAT-TRIAD 2015. Springer Proceedings in Mathematics & Statistics, vol 192. Springer, Cham. https://doi.org/10.1007/978-3-319-49984-0_19

Download citation

Publish with us

Policies and ethics