Abstract
The research subject is the computational complexity of the probabilistic neural network (PNN) in the pattern recognition problem for large model databases. We examined the following methods of increasing the efficiency of a neural-network classifier: a parallel multithread realization, reducing the PNN to a criterion with testing of homogeneity of feature histograms of input and reference images, approximate nearest-neighbor analyses (Best-Bin First, directed enumeration methods). The approach was tested in facial-recognition experiments with FERET dataset.
Similar content being viewed by others
References
Bishop, C., Neural Networks for Pattern Recognition, Oxford University Press, 1996, p. 504.
Forsyth, D.A. and Ponce, J., Computer Vision: A Modern Approach, Pearson Education, Prentice Hall, 2011, p. 792.
Lapko, A.V. and Lapko, V.A., Nonparametric pattern recognition systems in the conditions of large learning samples, Pattern Recognition and Image Analysis, (Advances in Mathematical Theory and Applications), 2010, vol. 20, no. 2, pp. 129–136.
Specht, D.F., Probabilistic neural networks, Neural Networks, 1990, vol. 3. no. 1, pp. 109–118.
Savchenko, A.V., Statistical Recognition of a Set of Patterns Using Novel Probability Neural Network (Proc. of Int. Conf. ANNPR’12 LNCS), 2012, vol. 7477, pp. 93–103.
Borovkov, A.A., Mathematical Statistics: Additional Chapters, Nauka, 1984, p. 144.
Cortes, C. and Vapnik, V.N., Support-vector networks, Machine Learning, 1995, vol. 20, no. 3, pp. 273–297.
Borisov, E.S., Using the language MC# for the implementation of a parallel pattern classifier, Cybernetics and Systems Analysis, 2005, vol. 41, no. 3, pp. 468–472.
Arya, S., Mount, D.M., Netanyahu, N.S., Silverman, R., and Wu, A.Y., An optimal algorithm for approximate nearest neighbor searching, Journal of the ACM, 1998, vol. 45, pp. 891–923.
Beis, J. and Lowe, D.G., Shape indexing using approximate nearest-neighbour search in high dimensional spaces (Proc. of Int. Conf. on Computer Vision and Pattern Recognition), 1997, pp. 1000–1006.
Savchenko, A.V., Directed enumeration method in image recognition, Pattern Recognition, 2012, vol. 45, no. 8, pp. 2952–2961.
Savchenko, A.V., Probabilistic neural network with homogeneity testing in recogntion of discrete patterns set, Neural Networks, 2013, vol. 46, pp. 227–241. doi: 10.1016/j.neunet.2013.06.003
Savchenko, A.V., Adaptive video image recognition system using a committee machine, Optical Memory and Neural Networks (Information Optics), 2012, vol. 21, no. 4, pp. 219–226.
Cleary, J.G., Analysis of an algorithm for finding nearest neighbors in Euclidean space, ACM Transactions on Mathematical Software, 1979, vol. 5, no. 2, pp. 183–192.
Savchenko, A.V., Real-time image recognition with the parallel directed enumeration method (Proc. of Int. Conf. ICVS 2013 LNCS), 2013, vol. 7963, pp. 123–132.
Savchenko, A.V., Image recognition on the basis of probabilistic neural network with homogeneity testing, Computer Optics, 2013, vol. 37, no. 2, pp. 255–263.
Kullback, S., Information Theory and Statistics, New York: Dover Pub., 1997, p. 399.
Malkov, Y., Ponomarenko, A., Logvinov, A., and Krylov, V., Scalable distributed algorithm for approximate nearest neighbor search problem in high dimensional general metric spaces (Proc. of Int. Conf SISAP’12 LNCS), 2012, vol. 7404, pp. 132–147.
Bentley, J.L., Weide, B.W., and Yao, A.C., Optimal expected-time algorithms for closest point problems, ACM Transactions on Mathematical Software, 1980, vol. 6, no. 4, pp. 563–580.
Batko, M., Gennaro, C., and Zezula, P., Similarity Grid for Searching in Metric Spaces (Proc. of Int. Conf. DELOS LNCS), 2005, vol. 3664, pp. 25–44.
Beaumont, O., Kermarrec, A.-M., Marchal, L., and Riviere, E., VoroNet: A scalable object network based on Voronoi tessellations (Proc. of Int. Symposium Parallel and Distributed Processing), 2007, pp. 1–10.
Savchenko, A.V., Face Recognition in Real-Time Applications: Comparison of Directed Enumeration Method and K-d Trees (Proc. of Int. Conf. BIR’12 LNBIP), 2012, vol. 128, pp. 187–199.
Chellappa, R., Du, M., Turaga, P., and Zhou, S.K., Face tracking and recognition in video, Handbook of Face Recognition, 2011, pp. 323–351.
The FERET dataset, http://www.itl.nist.gov/iad/humanid/feret/feret-master.html
Dalal, N. and Triggs, B., Histograms of Oriented Gradients for Human Detection. Proceedings (Proc. of Int. Conf. on Computer Vision & Pattern Recognition), 2005, pp. 886–893.
Lowe, D., Distinctive image features from scale-invariant keypoints, International Journal of Computer Vision, 2004, vol. 60, no. 2, pp. 91–110.
Tuytelaars, T. and Mikolajczyk, K., Local invariant feature detectors: A Survey, Foundations and Trends in Computer Graphics and Vision, 2007, vol. 3, no. 3, pp. 177–280.
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Savchenko, A.V. Pattern recognition and increasing of the computational efficiency of a parallel realization of the probabilistic neural network with homogeneity testing. Opt. Mem. Neural Networks 22, 184–192 (2013). https://doi.org/10.3103/S1060992X13030090
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.3103/S1060992X13030090