Pattern Classification with the Probabilistic Neural Networks Based on Orthogonal Series Kernel
Probabilistic neural network (PNN) is the well-known instance-based learning algorithm, which is widely used in various pattern classification and regression tasks, if rather small number of instances for each class is available. The known disadvantage of this network is its insufficient classification computational complexity. The common way to overcome this drawback is the reduction techniques with selection of the most typical instances. Such approach causes the shifting of the estimates of the class probability distribution, and, in turn, the decrease of the classification accuracy. In this paper we examine another possible solution by replacing the Gaussian window and the Parzen kernel to the orthogonal series Fejér kernel and using the naïve assumption about independence of features. It is shown, that our approach makes it possible to achieve much better runtime complexity in comparison with either original PNN or its modification with the preliminary clustering of the training set.
KeywordsPattern classification Small sample size problem Probabilistic neural network (PNN) Orthogonal series kernel Nonparametric density estimates
The work is partially supported by Laboratory of Algorithms and Technologies for Network Analysis, National Research University Higher School of Economics.
- 1.Haykin, S.O.: Neural Networks and Learning Machines. Prentice Hall, Harlow (2008)Google Scholar
- 10.Li, X., Zhang, S., Li, S., Chen, J.: An improved method of speech recognition based on probabilistic neural network ensembles. In: 11th International Conference on Natural Computation (ICNC), pp. 650–654. IEEE (2015)Google Scholar
- 14.Kusy, M., Kluska, J.: Probabilistic neural network structure reduction for medical data classification. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2013, Part I. LNCS, vol. 7894, pp. 118–129. Springer, Heidelberg (2013)CrossRefGoogle Scholar
- 19.Bhatt, R.B., Sharma, G., Dhall, A., Chaudhury, S.: Efficient skin region segmentation using low complexity fuzzy decision tree model. In: India Conference (INDICON), pp. 1–4. IEEE (2009)Google Scholar