Computational Economics

, Volume 36, Issue 2, pp 153–169 | Cite as

Partially Adaptive Econometric Methods For Regression and Classification

  • James V. Hansen
  • James B. McDonald
  • Panayiotis Theodossiou
  • Brad J. Larsen


Assumptions about the distributions of domain variables are important for much of statistical learning, including both regression and classification problems. However, it is important that the assumed models are consistent with the stylized facts. For example selecting a normal distribution permits modeling two data characteristics—the mean and the variance, but it is not appropriate for data which are skewed or have thick tails. The adaptive methods developed here offer the flexibility found in many machine learning models, but lend themselves to statistical interpretation, as well. This paper contributes to the development of partially adaptive estimation methods that derive their adaptability from membership in families of distributions, which are distinguished by modifications of simple parameters. In particular, we have extended the methods to include recently proposed distributions, including example applications and computational details.


Partially adaptive estimation Regression Classification Value at risk Asymmetric error costs 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Amemiya T. (1985) Advanced econometrics. Harvard University Press, Cambridge, MAGoogle Scholar
  2. Amendela M., Fackler P. (2006) Applied Computational economics and finance. MIT Press, Cambridge, MAGoogle Scholar
  3. Bali T. G., Theodossiou P. (2007) A conditional-SGT-VaR approach with alternative GARCH models. Annals of Operations Research 151(1): 241–267CrossRefGoogle Scholar
  4. Bali T. G., Theodossiou P. (2008) Risk measurement performance of alternative distribution functions. Journal of Risk and Insurance 75(2): 411–437CrossRefGoogle Scholar
  5. Belsely D. A., Kuh E., Welsch R. (1980) Regression diagnostics. John Wiley and Sons, New York, NYCrossRefGoogle Scholar
  6. Bollerslev T. (1986) Generalized autoregressive conditional heteroscedasticity. Journal of Econometrics 31: 307–327CrossRefGoogle Scholar
  7. Box G. E. P., Tiao G. C. (1962) A further look at robustness via Bayes’ Theorem. Biometrica 49: 419–432Google Scholar
  8. Clarke D., McDonald J. (1992) Generalized qualitative response models with an application to consumer credit behavior. Journal of Economics and Business 44: 47–62CrossRefGoogle Scholar
  9. Cummins, J. D., McDonald, J., & Merrill, C. (2007). Risky loss distributions and modeling the loss reserve pay-out tail. Review of Applied Economics 3.Google Scholar
  10. Engle R. F. (1982) Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation. Econometrica 50: 987–1007CrossRefGoogle Scholar
  11. Engle R. F. (1990) Discussion: Stock market volatility and the crash of ’87. Review of Financial Studies 3: 103–106Google Scholar
  12. Engle R. F., Ng V. K. (1993) Measuring and testing the impact of news on volatility. Journal of Finance 48: 1749–1778CrossRefGoogle Scholar
  13. Hansen, C., McDonald, J., & Theodossiou, P. (2007). Some flexible parametric models for partially adaptive estimators of econometric models.
  14. Hansen J., McDonald J., Turley R. (2006) Partially adaptive robust estimation of regression models and applications. European Journal of Operational Research 170: 132–143CrossRefGoogle Scholar
  15. Harrison D., Rubinfeld D. L. (1978) Hedonic housing prices and the demand for clean air. Journal of Environmental Economics and Management 5: 81–102CrossRefGoogle Scholar
  16. Heston, S., & Nandi, S. (1998). Pricing bonds and interest rate derivatives under a two-factor model of interest rates with GARCH volatility: Analytical solutions and their applications. Working Paper, Federal Reserve Bank of Atlanta.Google Scholar
  17. Johnson N. L. (1949) Systems of frequency curves generated by methods of translation. Biometrica 36: 149–176Google Scholar
  18. Kendrick D. A., Mercado P. R., Amman H. M. (2005) Computational economics. Princeton University Press, Princeton, New JerseyGoogle Scholar
  19. Manski C., Lerman S. (1977) Estimation of choice probabilities from choice-based samples. Econometrica 45: 77–89CrossRefGoogle Scholar
  20. McDonald J. (1996) An application and comparison of some flexible parametric and semiparametric qualitative response models. Economics Letters 53: 145–152CrossRefGoogle Scholar
  21. McDonald J., Newey W. (1988) Partially adaptive estimation of regression models via the generalized t distribution. Econometric Theory 4: 428–457Google Scholar
  22. McDonald J., Xu Y. (1996) An application and comparison of some flexible parametric and semiparametric qualitative response models. Economic Letters 53: 145–152CrossRefGoogle Scholar
  23. Nelson D. (1991) Conditional heteroskedasticity in asset returns: A new approach. Econometrica 59: 347–370CrossRefGoogle Scholar
  24. Schwert G. W. (1989) Why does stock market volatility change over time?. Journal of Finance 44: 1115–1153CrossRefGoogle Scholar
  25. Sentana E. (1995) Quadratic ARCH models. Review of Economic Studies 62: 639–661CrossRefGoogle Scholar
  26. Taylor S. (1986) Modeling financial time series. Wiley, New York, NYGoogle Scholar
  27. Tesfatsion, L., & Judd, K. (2006). Handbook of computational economics (Vol. 1). New York, NY: Elsevier.Google Scholar
  28. Theodossiou P. (1998) Financial data and the skewed generalized t distribution. Management Science 44: 1650–1661CrossRefGoogle Scholar
  29. Theodossiou P., Kahya E., Saidi R., Philippatos G. (1996) Financial distress and corporate acquisitions: further empirical evidence. Journal of Business Finance and Accounting 23: 699–719CrossRefGoogle Scholar
  30. Zakoian J. M. (1994) Threshold heteroscedastic models. Journal of Economic Dynamics and Control 18: 931–995CrossRefGoogle Scholar
  31. Zeckhauser R., Thompson M. (1970) Linear regression with non-normal error terms. Review of Economics and Statistics 50: 280–286CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC. 2010

Authors and Affiliations

  • James V. Hansen
    • 1
  • James B. McDonald
    • 2
  • Panayiotis Theodossiou
    • 3
    • 4
  • Brad J. Larsen
    • 5
  1. 1.Marriott SchoolBrigham Young UniversityProvoUSA
  2. 2.Department of EconomicsBrigham Young UniversityProvoUSA
  3. 3.School of BusinessRutgers UniversityCamdenUSA
  4. 4.Faculty of Management and EconomicsCyprus University of TechnologyLimassolCyprus
  5. 5.Department of EconomicsMassachusetts Institute of TechnologyCambridgeUSA

Personalised recommendations