On the Application of Orthogonal Series Density Estimation for Image Classification Based on Feature Description

  • Piotr Duda
  • Maciej Jaworski
  • Lena Pietruczuk
  • Marcin Korytkowski
  • Marcin Gabryel
  • Rafał Scherer
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 364)


This paper presents an image classification algorithm called density-based classifier. The proposed method puts together the image representation based on keypoints and the estimation of the probability density of descriptors with the application of orthonormal series. For each class of images a separate classifier is constructed. The presented procedure ensures that different descriptors affect the final decision in a different degree. The trained classifier determines whether the query image is assigned to the class or not. The obtained experimental results show that proposed method provides good results. The algorithm can be applied to many tasks in the field of image processing.


Content-based image retrieval Image classification 



The project was funded by the National Center for Science under decision number DEC-2011/01/D/ST6/06957.


  1. 1.
    Bay, H., Tuytelaars, T., Van Gool, L.: SURF: Speeded Up Robust Features. In: ECCV, pp. 404–417 (2006)Google Scholar
  2. 2.
    Belongie, S., Malik, J.: Matching with shape contexts. In: IEEE Workshop on Contentbased Access of Image and Video Libraries (CBAIVL-2000) (2000)Google Scholar
  3. 3.
    Chapelle, O., Haffner, P., Vapnik, V.N.: Support vector machines for histogram-based image classification. Trans. Neural Netw. 10(5), 1055–1064 (1999)CrossRefGoogle Scholar
  4. 4.
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005 (2005)Google Scholar
  5. 5.
    Datta, R., Joshi, D., Li, J., Wang, J.Z.: Image retrieval: ideas, influences, and trends of the new age. ACM Comput. Surv. 40(2), 5:1–5:60 (2008)Google Scholar
  6. 6.
    Duda, P., Jaworski, M., Pietruczuk, L., Scherer, R., Korytkowski, M., Gabryel, M.: On the application of fourier series density estimation for image classification based on feature description. In: Skulimowski, A. (ed.) Looking into the Future of Creativity and Decision Support Systems: Proceedings of the 8th International Conference on Knowledge, Information and Creativity Support Systems, Kraków, Poland, 7–9 Nov 2013. Advances in Decision Sciences and Future Studies, vol. 2. Progress and Business Publishers, Kraków (2013)Google Scholar
  7. 7.
    Fei-Fei, L., Fergus, R., Perona, P.: A Bayesian approach to unsupervised one-shot learning of object categories. In: Proceedings of the Ninth IEEE International Conference on Computer Vision, ICCV’03, vol. 2, pp. 1134. IEEE Computer Society, Washington, DC, USA (2003)Google Scholar
  8. 8.
    Fritz, M., Kruijff, G.J.M., Schiele, B.: Tutor-based learning of visual categories using different levels of supervision. Comput. Vis. Image Underst. 114, 564–573 (2010)CrossRefGoogle Scholar
  9. 9.
    Gałkowski, T., Rutkowski, L.: Nonparametric fitting of multivariable functions. IEEE Trans. Autom. Control AC-31, 785–787 (1986)Google Scholar
  10. 10.
    Greblicki, W., Rutkowska, D., Rutkowski, L.: An orthogonal series estimate of time-varying regression. Ann. Inst. Stat. Math. 35(Part A), 215–228 (1983)Google Scholar
  11. 11.
    Greblicki, W., Rutkowski, L.: Density-free Bayes risk consistency of nonparametric pattern recognition procedures. Proc. IEEE 69, 482–483 (1981)CrossRefGoogle Scholar
  12. 12.
    Jiang, L., Wang, W., Yang, X., Xie, N., Cheng, Y.: Classification methods of remote sensing image based on decision tree technologies. In: Li, D., Liu, Y., Chen, Y. (eds.) CCTA (1). IFIP Advances in Information and Communication Technology, vol. 344, pp. 353–358. Springer (2010)Google Scholar
  13. 13.
    Kelly, P.M., Cannon, T.M.: Candid: Comparison algorithm for navigating digital image databases. In: Proceedings Seventh International Working Conference on Scientific and Statistical Database Management, pp. 252–258 (1994)Google Scholar
  14. 14.
    Keysers, D., Dahmen, J., Ney, H., Wein, B., Lehmann, T.: A statistical framework for model-based image retrieval in medical applications (2002)Google Scholar
  15. 15.
    Korytkowski, M., Rutkowski, L., Scherer, R.: On combining backpropagation with boosting. In: 2006 International Joint Conference on Neural Networks, IEEE World Congress on Computational Intelligence, Vancouver, BC, Canada, pp. 1274–1277. IEEE (2006)Google Scholar
  16. 16.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Bartlett, P.L., Pereira, F.C.N., Burges, C.J.C., Bottou, L., Weinberger, K.Q. (eds.) NIPS, pp. 1106–1114 (2012)Google Scholar
  17. 17.
    Lowe, D.G.: Object recognition from local scale-invariant features. In: Proceedings of the International Conference on Computer Vision, ICCV’99, vol. 2, pp. 1150. IEEE Computer Society, Washington, DC, USA (1999)Google Scholar
  18. 18.
    Maheshwary, P., Srivastava, N.: Prototype system for retrieval of remote sensing images based on color moment and gray level co-occurrence matrix (2009)Google Scholar
  19. 19.
    Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 10(27), 1615–1630 (2005)CrossRefGoogle Scholar
  20. 20.
    Nowicki, R.: Rough-neuro-fuzzy system with MICOG defuzzification. In: 2006 IEEE International Conference on Fuzzy Systems, IEEE World Congress on Computational Intelligence, 16–21 July 2006, Vancouver, BC, Canada, pp. 1958–1965 (2006)Google Scholar
  21. 21.
    Orphanoudakis, S.C., Chronaki, C., Kostomanolakis, S.: I2C: a system for the indexing, storage, and retrieval of medical images by content. Med. Inf. (Lond.) 19(2), 109–122 (1994)Google Scholar
  22. 22.
    Patan, K., Patan, M.: Optimal training strategies for locally recurrent neural networks. J. Artif. Intell. Soft Comput. Res. 1(2), 103–114 (2011)Google Scholar
  23. 23.
    Rutkowski, L., Rafajłowicz, E.: On optimal global rate of convergence of some nonparametric identification procedures. IEEE Trans. Autom. Control AC-34(10), 1089–1091 (1989)Google Scholar
  24. 24.
    Rutkowski, L.: A general approach for nonparametric fitting of functions and their derivatives with applications to linear circuits identification. IEEE Trans. Circ. Syst. CAS-33, 812–818 (1986)Google Scholar
  25. 25.
    Rutkowski, L.: Identification of MISO nonlinear regressions in the presence of a wide class of disturbances. IEEE Trans. Inf. Theory IT-37, 214–216 (1991)Google Scholar
  26. 26.
    Rutkowski, L.: New Soft Computing Techniques for System Modeling, Pattern Classification and Image Processing. Springer (2004)Google Scholar
  27. 27.
    Rutkowski, L.: On Bayes risk consistent pattern recognition procedures in a quasi-stationary environment. IEEE Trans. Pattern Anal. Mach. Intell. PAMI-4(1), 84–87 (1982)Google Scholar
  28. 28.
    Rutkowski, L.: On nonparametric identification with prediction of time-varying systems. IEEE Trans. Autom. Control AC-29, 58–60 (1984)Google Scholar
  29. 29.
    Rutkowski, L.: On-line identification of time-varying systems by nonparametric techniques. IEEE Trans. Autom. Control AC-27, 228–230 (1982)Google Scholar
  30. 30.
    Rutkowski, L.: Sequential estimates of probability densities by orthogonal series and their application in pattern classification. IEEE Trans. Syst. Man Cybern. SMC-10(12), 918–920 (1980)Google Scholar
  31. 31.
    Rutkowski, L.: Nonparametric identification of quasi-stationary systems. Syst. Control Lett. 6, 33–35 (1985)CrossRefMathSciNetzbMATHGoogle Scholar
  32. 32.
    Rutkowski, L.: The real-time identification of time-varying systems by nonparametric algorithms based on the parzen kernels. Int. J. Syst. Sci. 16, 1123–1130 (1985)CrossRefzbMATHGoogle Scholar
  33. 33.
    Rutkowski, L.: Sequential pattern recognition procedures derived from multiple Fourier series. Pattern Recogn. Lett. 8, 213–216 (1988)CrossRefzbMATHGoogle Scholar
  34. 34.
    Rutkowski, L.: An application of multiple Fourier series to identification of multivariable nonstationary systems. Int. J. Syst. Sci. 20(10), 1993–2002 (1989)CrossRefMathSciNetzbMATHGoogle Scholar
  35. 35.
    Rutkowski, L.: Nonparametric learning algorithms in the time-varying environments. Signal Process. 18, 129–137 (1989)CrossRefMathSciNetGoogle Scholar
  36. 36.
    Rutkowski, L.: Multiple Fourier series procedures for extraction of nonlinear regressions from noisy data. IEEE Trans. Signal Process. 41(10), 3062–3065 (1993)CrossRefzbMATHGoogle Scholar
  37. 37.
    Rutkowski, L.: Adaptive probabilistic neural-networks for pattern classification in time-varying environment. IEEE Trans. Neural Netw. 15, 811–827 (2004)CrossRefGoogle Scholar
  38. 38.
    Rutkowski, L.: Generalized regression neural networks in time-varying environment. IEEE Trans. Neural Netw. 15, 576–596 (2004)CrossRefGoogle Scholar
  39. 39.
    Shariat, S., Rabiee, H.R., Khansari, M.: Inferring a Bayesian network for content-based image classification. In: 13th International CSI Computer Conference, 09 March 2008. Kish Island, Iran (2008)Google Scholar
  40. 40.
    Soliman, O.S., Mahmoud, A.S., Hassan, S.M.: Remote sensing satellite images classification using support vector machine and particle swarm optimization. In: Proceedings of the 2012 Third International Conference on Innovations in Bio-Inspired Computing and Applications, IBICA’12, pp. 280–285. IEEE Computer Society (2012)Google Scholar
  41. 41.
    Xiao, B., Song, Y.Z., Hall, P.M.: Learning invariant structure for object identification by using graph methods. Comput. Vis. Image Underst. 115(7), 1023–1031 (2011)CrossRefGoogle Scholar
  42. 42.
    Xu, M., Wei, C.: Remotely sensed image classification by complex network eigenvalue and connected degree. In: Computational and Mathematical Methods in Medicine 2012 (2012)Google Scholar
  43. 43.
    Yan, K., Sukhtankar, R.: PCA-SIFT: a more distinctive representation for local image descriptors. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, vol. 2, pp. 506–513 (2004)Google Scholar
  44. 44.
    Yaw, C., Yishi, W., Cuixain, C., Ricanek, K.: Optimal training strategies for locally recurrent neural networks. J. Artif. Intell. Soft Comput. Res. 1(3), 241–253 (2011)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Piotr Duda
    • 1
  • Maciej Jaworski
    • 1
  • Lena Pietruczuk
    • 1
  • Marcin Korytkowski
    • 1
  • Marcin Gabryel
    • 1
  • Rafał Scherer
    • 1
  1. 1.Institute of Computational IntelligenceCzestochowa University of TechnologyCzestochowaPoland

Personalised recommendations