Wavelet Network for Nonlinear Regression Using Probabilistic Framework
Regression analysis is an essential tools in most research fields such as signal processing, economic forecasting etc. In this paper, an regression algorithm using probabilistic wavelet network is proposed. As in most neural network (NN) regression methods, the proposed method can model nonlinear functions. Unlike other NN approaches, the proposed method is much robust to noisy data and thus over-fitting may not occur easily. This is because the use of wavelet representation in the hidden nodes and the probabilistic inference on the value of weights such that the assumption of smooth curve can be encoded implicitly. Experimental results show that the proposed network have higher modeling and prediction power than other common NN regression methods.
KeywordsHide Node Noisy Data Wavelet Function Mother Wavelet Probabilistic Framework
Unable to display preview. Download preview PDF.
- 3.Bansal, A., Kauffmann, R., Weitz, R.: Comparing the modeling performance of regression and neural networks as data quality varies: A business value approach. Journal of Management Information Systems 10, 11–32 (1993)Google Scholar
- 9.MacKay, D.J.C.: Bayesian methods for backpropagation networks. In: Domany, E., van Hemmen, J.L., Schulten, K. (eds.) Models of Neural Networks III, Springer, New York (1994)Google Scholar
- 10.Ray, S., Chan, A., Mallick, B.: Bayesian wavelet shrinkage in transformation based normal models. In: ICIP 2002, I, pp. 876–879 (2002)Google Scholar