Regression Analysis and Its Development

  • Ryuei Nishii
Part of the Mathematics for Industry book series (MFI, volume 5)


Regression analysis aims to predict a target variable statistically by using explanatory variables. The analysis has a long history and is utilized in various situations. We will review linear regression analysis and describe model assessment methods based on the coefficient of determination and Akaike information criterion (AIC). Furthermore, we propose a relative coefficient of determination based on AIC for general statistical modeling. Finally, we illustrate variable selection and discuss recent developments in regression analysis.


Akaike information criterion Bayesian information criterion  Coefficient of determination Model selection Regression analysis 


  1. 1.
    P. Armitage, G. Berry, J.N.S. Matthews, Statistical Methods in Medical Research, 4th edn. (Blackwell Publishing, Malden, 2002)CrossRefGoogle Scholar
  2. 2.
    G. Claeskens, N.L. Hjort, Model Selection and Model Averaging (Cambridge University Press, Cambridge, 2008)CrossRefMATHGoogle Scholar
  3. 3.
  4. 4.
    Gamlss page (Generalized Additive Models for Location, Scale and Shape),
  5. 5.
    T.J. Hastie, R.J. Tibshirani, Generalized Additive Models (Chapman and Hall, London, 1990)MATHGoogle Scholar
  6. 6.
    S. Konishi, G. Kitagawa, Information Criteria and Statistical Modeling (Springer, New York, 2007)Google Scholar
  7. 7.
    T. Hastie, R. Tibshirani, J. Friedman, The Elements of Statistical Learning, 2nd edn. (Springer, New York, 2008)Google Scholar
  8. 8.
  9. 9.
    D. Miyata, R. Nishii, S. Tanaka, Nonlinear regression modeling of forest area ratios. Tokei Suri 60(1), 109–119 (2012). (in Japanese)MathSciNetGoogle Scholar
  10. 10.
    O. Nelles, Nonlinear System Identification (Springer, New York, 2001)CrossRefMATHGoogle Scholar
  11. 11.
    R. Nishii, S. Tanaka, Modeling and inference of forest coverage ratio using zero-one inflated distributions with spatial dependence. Environ. Ecol. Stat. 20, 315–336 (2013)MathSciNetCrossRefGoogle Scholar
  12. 12.
    P. Qin, R. Nishii, Selection of ARX models estimated by the penalized weighted least squares method. Bull. Inf. Cybern. 42, 35–43 (2010)MathSciNetMATHGoogle Scholar
  13. 13.
    The R Project for Statistical Computing,

Copyright information

© Springer Japan 2014

Authors and Affiliations

  1. 1.Institute of Mathematics for IndustryKyushu UniversityNishi-kuJapan

Personalised recommendations