Forward and Backward Selection in Regression Hybrid Network
- Cite this paper as:
- Cohen S., Intrator N. (2002) Forward and Backward Selection in Regression Hybrid Network. In: Roli F., Kittler J. (eds) Multiple Classifier Systems. MCS 2002. Lecture Notes in Computer Science, vol 2364. Springer, Berlin, Heidelberg
We introduce a Forward Backward and Model Selection algorithm (FBMS) for constructing a hybrid regression network of radial and perceptron hidden units. The algorithm determines whether a radial or a perceptron unit is required at a given region of input space. Given an error target, the algorithm also determines the number of hidden units. Then the algorithm uses model selection criteria and prunes unnecessary weights. This results in a final architecture which is often much smaller than a RBF network or a MLP. Results for various data sizes on the Pumadyn data indicate that the resulting architecture competes and often outperform best known results for this data set.
KeywordsHybrid Network Architecture SMLP Clustering Regularization Nested Models Model Selection
Unable to display preview. Download preview PDF.