The New Palgrave Dictionary of Economics

2018 Edition
| Editors: Macmillan Publishers Ltd

Artificial Neural Networks

  • Chung-Ming Kuan
Reference work entry
DOI: https://doi.org/10.1057/978-1-349-95189-5_2714

Abstract

Artificial neural networks (ANNs) constitute a class of flexible nonlinear models designed to mimic biological neural systems. In this article we introduce ANN using familiar econometric terminology and provide an overview of the ANN modelling approach and its implementation methods.

Keywords

ARMA models Artificial neural networks Back propagation algorithm BAYESIAN information criterion Distributed lags Feedforward neural networks Learning Model misspecification Newton algorithm Nonlinear least squares (NLS) method Nonlinear models Nonparametric functional analysis Nonparametric methods Predictive stochastic complexity Recurrent neural networks Stochastic approximation method 

JEL Classification

C45 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgment

I would like to express my sincere gratitude to Steven Durlauf for his patience and constructive comments on early drafts of this article. I also thank Shih-Hsun Hsu and Yu-Lieh Huang for very helpful suggestions. The remaining errors are all mine.

Bibliography

  1. Barron, A. 1991. Complexity regularization with application to artificial neural networks. In Nonparametric functional estimation and related topics, ed. G. Roussas. Dordrecht: Kluwer Academic Publishers.Google Scholar
  2. Barron, A. 1993. Universal approximation bounds for superpositions of a sigmoidal function. IEEE Transactions on Information Theory 39: 930–945.CrossRefGoogle Scholar
  3. Cybenko, G. 1989. Approximation by superpositions of a sigmoid function. Mathematics of Control, Signals, and Systems 2: 303–314.CrossRefGoogle Scholar
  4. Elman, J. 1990. Finding structure in time. Cognitive Science 14: 179–211.CrossRefGoogle Scholar
  5. Funahashi, K. 1989. On the approximate realization of continuous mappings by neural networks. Neural Networks 2: 183–192.CrossRefGoogle Scholar
  6. Gallant, A., and H. White. 1988. A unified theory of estimation and inference for nonlinear dynamic models. Oxford: Basil Blackwell.Google Scholar
  7. Hornik, K. 1991. Approximation capabilities of multilayer feedforward nets. Neural Networks 4: 231–242.CrossRefGoogle Scholar
  8. Hornik, K. 1993. Some new results on neural network approximation. Neural Networks 6: 1069–1072.CrossRefGoogle Scholar
  9. Hornik, K., M. Stinchcombe, and H. White. 1989. Multi-layer feedforward networks are universal approximators. Neural Networks 2: 359–366.CrossRefGoogle Scholar
  10. Hornik, K., M. Stinchcombe, and H. White. 1990. Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks. Neural Networks 3: 551–560.CrossRefGoogle Scholar
  11. Jordan, M. 1986. Serial order: A parallel distributed processing approach, Report No. 8604. La Jolla: Institute for Cognitive Science, University of California San Diego.Google Scholar
  12. Kuan, C.-M. 1995. A recurrent Newton algorithm and its convergence properties. IEEE Transactions on Neural Networks 6: 779–783.CrossRefGoogle Scholar
  13. Kuan, C.-M., and K. Hornik. 1991. Convergence of learning algorithms with constant learning rates. IEEE Transactions on Neural Networks 2: 484–489.CrossRefGoogle Scholar
  14. Kuan, C.-M., and T. Liu. 1995. Forecasting exchange rates using feedforward and recurrent neural networks. Journal of Applied Econometric 10: 347–364.CrossRefGoogle Scholar
  15. Kuan, C.-M., and H. White. 1994. Artificial neural networks: An econometric perspective (with discussions). Econometric Reviews 13(1–91): 139–143.CrossRefGoogle Scholar
  16. Kuan, C.-M., K. Hornik, and H. White. 1994. A convergence result for learning in recurrent neural networks. Neural Computation 6: 420–440.CrossRefGoogle Scholar
  17. McClelland, J.,D. Rumelhart, and the PDP Research Group. 1986. Parallel distributed processing: Explorations in the microstructure of cognition, vol. 2. Cambridge, MA: MIT Press.Google Scholar
  18. McCulloch, W., and W. Pitts. 1943. A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biophysics 5: 115–133.CrossRefGoogle Scholar
  19. Rissanen, J. 1986. Stochastic complexity and modeling. Annals of Statistics 14: 1080–1100.CrossRefGoogle Scholar
  20. Rissanen, J. 1987. Stochastic complexity (with discussions). Journal of the Royal Statistical Society, B 49(223–39): 252–265.Google Scholar
  21. Robbins, H., and S. Monro. 1951. A stochastic approximation method. Annals of Mathematical Statistics 22: 400–407.CrossRefGoogle Scholar
  22. Rosenblatt, F. 1958. The perception: A probabilistic model for information storage and organization in the brain. Psychological Reviews 62: 386–408.CrossRefGoogle Scholar
  23. Rumelhart, D., G. Hinton, and R. Williams. 1986a. Learning internal representation by error propagation. In Parallel distributed processing: Explorations in the microstructure of cognition, vol. 1, ed. D. Rumelhart, J. McClelland and the PDP Research Group. Cambridge, MA: MIT Press.Google Scholar
  24. Rumelhart, D., J. McClelland, and the PDP Research Group, eds. 1986b. Parallel distributed processing: Explorations in the microstructure of cognition, vol. 1. Cambridge, MA: MIT Press.Google Scholar
  25. Stinchcombe, M., and H. White. 1998. Consistent specification testing with nuisance parameters present only under the alternative. Econometric Theory 14: 295–325.CrossRefGoogle Scholar
  26. Swanson, N., and H. White. 1997. A model selection approach to real-time macroeconomic forecasting using linear models and artificial neural networks. Review of Economics and Statistics 79: 540–550.CrossRefGoogle Scholar
  27. White, H. 1988. Economic prediction using neural networks: The case of IBM stock prices.In: Proceedings of the second annual IEEE conference on neural networks II. New York: IEEE Press.Google Scholar
  28. White, H. 1989. Some asymptotic results for learning in single hidden layer feedforward network models. Journal of the American Statistical Association 84: 1003–1013.CrossRefGoogle Scholar

Copyright information

© Macmillan Publishers Ltd. 2018

Authors and Affiliations

  • Chung-Ming Kuan
    • 1
  1. 1.