Classification of Data Chunks Using Proximal Vector Machines and Singular Value Decomposition

  • Antonio Irpino
  • Mario Rosario Guarracino
  • Rosanna Verde
Conference paper
Part of the Studies in Classification, Data Analysis, and Knowledge Organization book series (STUDIES CLASS)


Data production grows at an unprecedented increasing rate in every research and technical field. Furthermore, with the explosion of sensors networks and proprietary/legacy classifiers, like those used by banks for assessing the credit approvals, the data production and modeling is done locally, where only the local classifiers are available. In order to find a global classification rule, the ensemble classification paradigm proposes several methods of aggregation. In this paper, starting from a set of classifiers obtained by using a recently developed classification technique, known as Regularized Generalized Eigenvalues Classifier, we present a novel way of aggregating linear classification models using the Singular Value Decomposition. Using artificial datasets, we compare the developed algorithm with a voting scheme, showing that the proposed strategy allows a reduction in computational cost with a classification accuracy that well compares with the original method.


  1. Fung, G., & Mangasarian, O. L. (2001). Proximal support vector machine classifiers. In Proceedings of the seventh ACM SIGKDD international conference on knowledge discovery and data mining (KDD ’01). ACM, New York, NY, USA (pp. 77–86).Google Scholar
  2. Guarracino, M. R., Cifarelli, C., Seref, O., & Pardalos, P. (2007). A classification algorithm based on generalized eigenvalue problems. Optimization Methods and Software,22(1), 73–81.Google Scholar
  3. Irpino, A., Guarracino, M. R., & Verde, R. (2010) Multiclass generalized eigenvalue proximal support vector Machines. In: 4th IEEE Conference on Complex, Intelligent and Software Intensive Systems (CISIS 2010), Krakow (pp. 25–32).Google Scholar
  4. Mangasarian, O., & Wild, E. (2004). Multisurface proximal support vector classification via generalized eigenvalues (Tech. Rep. 04-03). Data Mining Institute.Google Scholar
  5. Parlett, B. (1998). The symmetric eigenvalue problem. Philadelphia: SIAM.Google Scholar
  6. Sinha, A., Chen, H., Danu, D. G., Kirubarajan, T., & Farooq, M. (2008). Estimation and decision fusion: A survey. Neurocomputing,71(13–15), 2650–2656.Google Scholar
  7. Suykens, J. A. K., Van Gestel, T., De Brabanter, J., De Moor, B., & Vandewalle, J. (2002). Least squares support vector machines. Singapore: World Scientific.Google Scholar
  8. Vapnik, V. (1995). The nature of statistical learning theory. New York: Springer.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Antonio Irpino
    • 1
  • Mario Rosario Guarracino
    • 2
    • 3
  • Rosanna Verde
    • 1
  1. 1.Dipartimento di Studi Europei e MediterraneiSeconda Università degli Studi di NapoliCasertaItaly
  2. 2.High Performance Computing and NetworkingNational Research Council of ItalyNaplesItaly
  3. 3.Center for Applied OptimizationUniversity of FloridaGainesvilleUSA

Personalised recommendations