Abstract
A novel structure for radial basis function networks is proposed. In this structure, unlike traditional RBF, we set some weights between input and hidden layer. These weights, which take values around unity, are multiplication factors for input vector and perform a linear mapping. Doing this, we increase free parameters of the network, but since these weights are trainable, the overall performance of the network is improved significantly. According to the new weight vector, we called this structure Weighted RBF or WRBF. Weight adjustment formula is provided by applying the gradient descent algorithm. Two classification problems used to evaluate performance of the new RBF network: letter classification using UCI dataset with 16 features, a difficult problem, and digit recognition using HODA dataset with 64 features, an easy problem. WRBF is compared with classic RBF and MLP network, and our experiments show that WRBF outperforms both significantly. For example, in the case of 200 hidden neurons, WRBF achieved recognition rate of 92.78% on UCI dataset while RBF and MLP achieved 83.13 and 89.25% respectively. On HODA dataset, WRBF reached 97.94% recognition rate whereas RBF achieved 97.14%, and MLP accomplished 97.63%.
Similar content being viewed by others
References
Knudsen EI (1994) Supervised Learning in the Brain. J Neurosci 14(7): 3985–3997
Maass W (1997) Networks of spiking neurons: the third generation of neural network models. Neural Netw 10: 1659–1671
Izhikevich EM (2004) Which model to use for cortical spiking neuron?. IEEE Trans Neural Netw 15(5): 1063–1070
da Silva AB, Rosa JLG (2011) Advances on criteria for biological plausibility in artificial neural networks: think of learning processes. In: International joint conference on neural networks, California
Kohonen T (1988) An introduction to neural computing. Neural Netw 1: 4
Huang SH, Zhang H-C (1994) Artificial neural networks in manufacturing: concepts, applications, and perspectives. IEEE Trans Compon Packag Manuf Technol 17(2): 212–228
Balabin RM, Safieva RZ (2008) Motor oil classification by base stock and viscosity based on near infrared (NIR) spectroscopy data. Fuel 87: 2745–2752
Khosravi H, Kabir E (2010) Farsi font recognition based on Sobel–Roberts features. Pattern Recogn Lett 31: 75–82
Xiaohu L et al (2011) A new multilayer feedforward small-world neural network with its performances on function approximation. In: IEEE Int’l Conf. on computer science and automation engineering, pp 353–357
Balabin RM, Lomakina EI (2009) Neural network approach to quantum-chemistry data: accurate prediction of density functional theory energies. J Chem Phys 131(7): 1041–1048
Bashkirov OA, Braverman EM, Muchnik IB (1964) Potential function algorithms networks for pattern recognition learning machines. Autom Remote Control, pp 629–631
Hojjatoleslami A, Sardo L, Kittler J (1997) An RBF based classifier for the detection of microcalcifications in mammograms with outlier rejection capability In: International conference on neural networks, pp 379–1384
Wang D et al (2002) Protein sequences classification using radial basis function (RBF) neural networks. In: 9’th international conference on neural information processing, Singapore, pp 764–769
Chen S et al (2008) Symmetric RBF classifier for nonlinear detection in multiple-antenna-aided systems. IEEE Tran Neural Netw 19(5): 737–745
Meng K et al (2010) A self-adaptive RBF neural network classifier for transformer fault analysis. IEEE Trans Power Syst 25(3): 1350–1360
Vakil-Baghmisheh M-T, Pavesic N (2004) Training RBF networks with selective backpropagation. Neurocomputing 62: 39–64
King JL, Reznik L (2006) Topology selection for signal change detection in sensor networks: RBF vs. MLP. In: International joint conference on neural networks, pp 2529–2535
Polat G, Altun H (2007) Evalutation of performance of KNN, MLP and RBF classifiers in emotion detection problem. In: 15th conference on signal processing and communications applications, vol 1, pp 1–4
Haykin S (2009) Neural networks and learning machines, 3rd edn. Prentice-Hall, Upper Saddle River
Werbos PJ (1974) Beyond regression: new tools for prediction and analysis in the behavioral science. PhD thesis, Harvard University
Parker DB (1982) Learning logic. Invention Report S81-64, File 1, Oce of Technology Licensing. Stanford University
Ciocoiu IB (2002) RBF networks training using a dual extended Kalman filter. Neurocomputing 48: 609–622
Abe Y, Iiguni Y (2006) Fast computation of RBF coefficients using FFT. Sig Process 86(11): 3264–3274
Ho K, Leung C-s, Sum J (2011) Training RBF network to tolerate single node fault. Neurocomputing 74(6): 1046–1052
Sanchez AD (2002) Searching for a solution to the automatic RBF network design problem. Neurocomputing 42: 147–170
Zhang R et al (2007) Improved GAP-RBF network for classification problems. Neurocomputing 70(16–18): 3011–3018
Tao J, Wang N (2007) Splicing system based genetic algorithms for developing rbf networks models. Chin J Chem Eng 15(2): 240–246
Sug H (2010) Generating better radial basis function network for large data set of census. Int J Softw Eng Appl 4(2): 15–22
Zhang Q, Benveniste A (1992) Wavelet networks. IEEE Trans Neural Netw 3(6): 889–898
Balabin RM, Safieva RZ, Lomakina EI (2008) Wavelet neural network (WNN) approach for calibration model building based on gasoline near infrared (NIR) spectra. Chemometr Intell Lab Syst 93: 58–62
Khosravi H, Kabir E (2007) Introducing a very large dataset of handwritten Farsi digits and a study on their varieties. Pattern Recogn Lett 28(10): 1133–1141
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Khosravi, H. A Novel Structure for Radial Basis Function Networks—WRBF. Neural Process Lett 35, 177–186 (2012). https://doi.org/10.1007/s11063-011-9210-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-011-9210-0