Online Forecasting of Stock Market Movement Direction Using the Improved Incremental Algorithm
In this paper we present a particular implementation of the Learn++ algorithm: we investigate the predictability of financial movement direction with Learn++ by forecasting the daily movement direction of the Dow Jones. The Learn++ algorithm is derived from the Adaboost algorithm, which is denominated by sub-sampling. The goal of concept learning, according to the probably approximately correct weak model, is to generate a description of another function, called the hypothesis, which is close to the concept, by using a set of examples. The hypothesis which is derived from weak learning is boosted to provide a better composite hypothesis in generalizing the establishment of the final classification boundary. The framework is implemented using multi-layer Perceptron (MLP) as a weak Learner. First, a weak learning algorithm, which tries to learn a class concept with a single input Perceptron, is established. The Learn++ algorithm is then applied to improve the weak MLP learning capacity and introduces the concept of online incremental learning. The proposed framework is able to adapt as new data are introduced and is able to classify.
KeywordsIncremental Learning Weak Learning Very High Testing Subset Training Subset
Unable to display preview. Download preview PDF.
- 1.Carpenter, G., Grossberg, S., Marhuzon, N., Reynolds, J., Rosen, D.: Artmap: A neural network architecture for incremental learning supervised learning of analog multidi-mensional maps. Transactions in Neural Networks 3, 678–713 (1992)Google Scholar
- 2.McNelis, P.D. (ed.): Neural Networks in Finance: Gaining the predictive edge in the market. Elsevier Academic Press, Oxford (2005)Google Scholar
- 3.Freund, Y., Schapire, R.: A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Science (1997)Google Scholar
- 4.Bishop, C. (ed.): Neural Networks for Pattern Recognition. Oxford University Press, Oxford-London (1995)Google Scholar
- 5.Vilakazi, B., Marwala, T., Mautla, R., Moloto, E.: Online bushing condition monitoring using computational intelligence. WSEAS Transactions on Power Systems 1, 280–287 (2006)Google Scholar
- 7.Polikar, R., Byorick, J., Krause, S., Marino, A., Moreton, M.: Learn++: A classifier independent incremental learning algorithm. In: Proceedings of International Joint Conference on Neural Networks (2002)Google Scholar
- 8.Polikar, R.: Algorithms for enhancing pattern separability, feature selection and incremental learning with applications to gas sensing electronic noise systems. PhD thesis, Iowa State University, Ames (2000)Google Scholar
- 9.Freund, Y., Schapire, R.: A short introduction to boosting. Japanese Society for Artificial Intelligence 14, 771–780 (1999)Google Scholar
- 13.McIver, D., Friedl, M.: Estimating pixel-scale land cover classification confidence using nonparametric machine learning methods. Transactions on Geoscience and Remote Sensing 39 (2001)Google Scholar
- 14.Leung, M., Daouk, H., Chen, A.: Forecasting stock indices: a comparison of classification and level estimation models. International Journal of Forecasting, 173–190Google Scholar