Parameter Estimation Methods



This chapter covers topics related to estimation of model parameters and to model identification of univariate and multivariate problems not covered in earlier chapters. First, the fundamental notion of estimability of a model is introduced which includes both structural and numerical identifiability concepts. Recall that in Chap. 5 issues addressed were relevant to parameter estimation of linear models and to variable selection using step-wise regression in multivariate analysis. This chapter extends these basic notions by presenting the general statistical parameter estimation problem, and then presenting a few important estimation methods. Multivariate estimation methods (such as principle component analysis, ridge regression and stagewise regression) are discussed along with case study examples. Next, the error in variable (EIV) situation is treated when the errors in the regressor variables are large. Subsequently, another powerful and widely used estimation method, namely maximum likelihood estimation (MLE) is described, and its application to parameter estimation of probability functions and logistic models is presented. Also covered is parameter estimation of models non-linear in the parameters which can be separated into those that are transformable into linear ones, and those which are intrinsically non-linear. Finally, computer intensive numerical methods are discussed since such methods are being increasingly used nowadays because of the flexibility and robustness they provide. Different robust regression methods, whereby the influence of outliers on parameter estimation can be deemphasized, are discussed. This is, followed by the bootstrap resampling approach which is applicable for parameter estimation, and for ascertaining confidence limits of estimated model parameters and of model predictions.


Partial Little Square Principle Component Analysis Ridge Regression Regressor Variable Structural Identifiability 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Supplementary material


  1. Andersen, K.K., and Reddy, T.A., 2002. “The error in variable (EIV) regression approach as a means of identifying unbiased physical parameter estimates: Application to chiller performance data”, HVAC&R Research Journal, vol.8, no.3, pp. 295-309, July.CrossRefGoogle Scholar
  2. Bard, Y., 1974. Nonlinear Parameter Estimation, Academic Press, New York.MATHGoogle Scholar
  3. Beck, J.V. and K.J., Arnold, 1977. Parameter Estimation in Engineering and Science, John Wiley and Sons, New YorkMATHGoogle Scholar
  4. Belsley, D.A., Kuh, E. and Welsch, R.E., 1980, Regression Diagnostics, John Wiley & Sons, New York.CrossRefMATHGoogle Scholar
  5. Chapra, S.C. and Canale, R.P., 1988. Numerical Methods for Engineers, 2nd Edition, McGraw-Hill, New York.Google Scholar
  6. Chatfield, C., 1995. Problem Solving: A Statistician’s Guide, 2nd Ed., Chapman and Gall, London, U.K.MATHGoogle Scholar
  7. Chatterjee, S. and B. Price, 1991. Regression Analysis by Example, 2nd Edition, John Wiley & Sons, New YorkGoogle Scholar
  8. Devore J., and N. Farnum, 2005. Applied Statistics for Engineers and Scientists, 2nd Ed., Thomson Brooks/Cole, Australia.Google Scholar
  9. Davison, A.C. and D.V.Hinkley, 1997. Bootstrap Methods and their Applications, Cambridge University Press, CambridgeCrossRefGoogle Scholar
  10. Draper, N.R. and H. Smith, 1981. Applied Regression Analysis, 2nd Ed., John Wiley and Sons, New York.MATHGoogle Scholar
  11. Edwards, C.H. and D.E. Penney, 1996. Differential Equations and Boundary Value Problems, Prentice Hall, Englewood Cliffs, NJMATHGoogle Scholar
  12. Efron, B. and J. Tibshirani, 1982. An Introduction to the The Bootstrap, Chapman and Hall, New YorkGoogle Scholar
  13. Freedman, D.A., and S.C. Peters, 1984. Bootstrapping a regression equation: Some empirical results, J. of the American Statistical Association, 79(385), pp.97-106, March.CrossRefMathSciNetGoogle Scholar
  14. Fuller, W. A., 1987. Measurement Error Models, John Wiley & Sons, NY.CrossRefMATHGoogle Scholar
  15. Godfrey, K., 1983. Compartmental Models and Their Application, Academic Press, New York.Google Scholar
  16. Kachigan, S.K., 1991. Multivariate Statistical Analysis, 2nd Ed., Radius Press, New York.Google Scholar
  17. Kowalski, W.J., 2002. Immune Building Systems Technology, McGraw-Hill, New YorkGoogle Scholar
  18. Lipschutz, S., 1966. Finite Mathematics, Schaum’s Outline Series, McGraw-Hill, New YorkGoogle Scholar
  19. Mandel, J., 1964. The Statistical Analysis of Experimental Data, Dover Publications, New York.Google Scholar
  20. Manly, B.J.F., 2005. Multivariate Statistical Methods: A Primer, 3rd Ed., Chapman & Hall/CRC, Boca Raton, FLGoogle Scholar
  21. Masters, G.M. and W.P. Ela, 2008. Introduction to Environmental Engineering and Science,3rd Ed. Prentice Hall, Englewood Cliffs, NJGoogle Scholar
  22. Mullet, G.M., 1976. Why regression coefficients have the wrong sign, J. Quality Technol., 8(3).Google Scholar
  23. Pindyck, R.S. and D.L. Rubinfeld, 1981. Econometric Models and Economic Forecasts, 2nd Edition, McGraw-Hill, New York, NY.Google Scholar
  24. Reddy, T.A., and D.E. Claridge, 1994 “Using synthetic data to evaluate multiple regression and principal component analysis for statistical models of daily energy consumption”, Energy and Buildings, Vol.21, pp. 35-44.Google Scholar
  25. Reddy, T.A., S. Deng, and D.E. Claridge, 1999. “Development of an inverse method to estimate overall building and ventilation parameters of large commercial buildings”, ASME Journal of Solar Energy Engineering, vol.121, pp.40-46, February.Google Scholar
  26. Reddy, T.A. and K.K. Andersen, 2002. “An evaluation of classical steady-state off-line linear parameter estimation methods applied to chiller performance data”, HVAC&R Research Journal, vol.8, no.1, pp.101-124.Google Scholar
  27. Reddy, T.A., 2007. Application of a generic evaluation methodology to assess four different chiller FDD Methods (RP1275), HVAC&R Research Journal, vol.13, no.5, pp 711-729, September.Google Scholar
  28. Saunders, D.H., J.J. Duffy, F.S. Luciani, W. Clarke, D. Sherman, L. Kinney, and N.H. Karins, 1994. “Measured performance rating method for weatherized homes”, ASHRAE Trans., V.100, Pt.1, paper no. 94-25-3.Google Scholar
  29. Shannon, R.E., 1975. System Simulation: The Art and Science, Prentice-Hall,  Englewood Cliffs, NJ.Google Scholar
  30. Sinha, N.K. and B. Kuszta, 1983. Modeling and Identification of Dynamic Systems, Van Nostrand Reinhold Co., New York.Google Scholar
  31. Subbarao, K., 1988. “PSTAR-Primary and Secondary Terms Analysis and Renormalization: A Unified Approach to Building Energy Simulations and Short-Term Monitoring”, SERI/TR - 253- 3175, Solar Energy Research Institute, Golden CO.Google Scholar
  32. Walpole, R.E., R.H. Myers, S.L. Myers, and K. Ye, 2007, Probability and Statistics for Engineers and Scientists, 8th Ed., Prentice-Hall, Upper Saddle River, NJ.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  1. 1.The Design School and School of SustainabilityArizona State UniversityTempeUSA

Personalised recommendations