Skip to main content

Multivariate Multiple Orthogonal Linear Regression

  • Conference paper
  • First Online:
Intelligent Decision Technologies 2018 (KES-IDT 2018 2018)

Part of the book series: Smart Innovation, Systems and Technologies ((SIST,volume 97))

Included in the following conference series:

Abstract

We propose a multivariate multiple orthogonal linear regression (MMOLR) model. The MMOLR model expresses the relationship between two sets of dependent variables and independent variables. It is possible to use the MMOLR as a step to be followed by multivariate linear regression to compare and investigate the relationships between dependent variables, which are still limited in the multivariate linear regression model. The MMOLR takes into account the advantages of the errors-in-variables model, that is, total least squares, and thereby, examines the errors of all independent and dependent variables. Consequently, the assumptions of the model are easy to satisfy in practice. Moreover, in the context of total least squares, we reveal the relationship between the MMOLR and the canonical regression model.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. McArdle, B.H., Anderson, M.J.: Fitting multivariate models to community data: a comment on distance based redundancy analysis. Ecology 82, 290–297 (2001)

    Article  Google Scholar 

  2. Elo, S., Kyng, H.: The qualitative content analysis process. J. Adv. Nurs. 62, 107–115 (2008)

    Article  Google Scholar 

  3. Bartlett, M.S.: An inverse matrix adjustment arising in discriminant analysis. Ann. Math. Stat. 22, 107–111 (1951)

    Article  MathSciNet  Google Scholar 

  4. Tatsuoka, M.M., Lohnes, P.R.: Multivariate Analysis: Techniques for Educational and Psychological Research. Macmillan Publishing Co, Inc., New York (1988)

    Google Scholar 

  5. Lutz, J.G., Eckert, T.L.: The relationship between canonical correlation analysis and multivariate multiple regression. Educ. Psychol. Meas. 54, 666–675 (1994)

    Article  Google Scholar 

  6. Dattalo, P.: Analysis of Multiple Dependent Variables. Oxford University Press, New York (2013)

    Book  Google Scholar 

  7. Wold, H.: Path models with latent variables: the NIPALS approach. In: Quantitative Sociology, pp 307–357. Elsevier (1975)

    Chapter  Google Scholar 

  8. Rohlf, F.J., Corti, M.: Use of two-block partial least-squares to study covariation in shape. Syst. Biol. 49, 740–753 (2000)

    Article  Google Scholar 

  9. Wold, S., Ruhe, A., Wold, H., Dunn III, W.J.: The collinearity problem in linear regression. The partial least squares (PLS) approach to generalized inverses. SIAM J. Sci. Stat. Comput. 5, 735–743 (1984)

    Article  Google Scholar 

  10. Breiman, L., Friedman, J.H.: Predicting multivariate responses in multiple linear regression. J. Roy. Stat. Soc. Ser. B (Stat. Methodol.) 59, 3–54 (1997)

    Article  MathSciNet  Google Scholar 

  11. Yuan, M., Ekici, A., Lu, Z., Monteiro, R.: Dimension reduction and coefficient estimation in multivariate linear regression. J. Roy. Stat. Soc. Ser. B (Stat. Methodol.) 69, 329–346 (2007)

    Article  MathSciNet  Google Scholar 

  12. Reinsel, G.C., Velu, R.P.: Multivariate linear regression. In: Multivariate Reduced-Rank Regression, pp 1–14. Springer (1998)

    Chapter  Google Scholar 

  13. Harrell Jr., F.E.: Regression Modeling Strategies: With Applications to Linear Models, Logistic and Ordinal Regression, and Survival Analysis. Springer, Cham (2015)

    Book  Google Scholar 

  14. Everitt, B.S., Dunn, G.: Applied Multivariate Data Analysis, vol. 2. Wiley Online Library, Chichester (2001)

    Book  Google Scholar 

  15. Velu, R., Reinsel, G.C.: Multivariate Reduced-Rank Regression: Theory and Applications, vol. 136. Springer Science and Business Media, Heidelberg (2013)

    MATH  Google Scholar 

  16. Berkson, J.: Are there two regressions? J. Am. Stat. Assoc. 45, 164–180 (1950)

    Article  Google Scholar 

  17. Durbin, J.: Errors in variables. Revue de l’institut International de Statistique 22, 23–32 (1954)

    Article  MathSciNet  Google Scholar 

  18. Zamar, R.H.: Robust estimation in the errors-in-variables model. Biometrika 76, 149–160 (1989)

    Article  MathSciNet  Google Scholar 

  19. Maronna, R.: Principal components and orthogonal regression based on robust scales. Technometrics 47, 264–273 (2005)

    Article  MathSciNet  Google Scholar 

  20. Golub, G.H., Reinsch, C.: Singular value decomposition and least squares solutions. Numerische Mathematik 14, 403–420 (1970)

    Article  MathSciNet  Google Scholar 

  21. Brown, M.L.: Robust line estimation with errors in both variables. J. Am. Stat. Assoc. 77, 71–79 (1982)

    Article  Google Scholar 

  22. Golub, G.H., Van Loan, C.F.: An analysis of the total least squares problem. SIAM J. Numer. Anal. 17, 883–893 (1980)

    Article  MathSciNet  Google Scholar 

  23. Wang, J., et al.: Package “robust” (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Thi Binh An Duong .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

An Duong, T.B., Tsuchida, J., Yadohisa, H. (2019). Multivariate Multiple Orthogonal Linear Regression. In: Czarnowski, I., Howlett, R., Jain, L., Vlacic, L. (eds) Intelligent Decision Technologies 2018. KES-IDT 2018 2018. Smart Innovation, Systems and Technologies, vol 97. Springer, Cham. https://doi.org/10.1007/978-3-319-92028-3_5

Download citation

Publish with us

Policies and ethics