Advertisement

A New Adaptive Framework for Classifier Ensemble in Multiclass Large Data

  • Hamid Parvin
  • Behrouz Minaei
  • Hosein Alizadeh
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6782)

Abstract

This paper proposes an innovative combinational algorithm to improve the performance of multiclass problems. Because the more accurate classifier the better performance of classification, so researchers have been tended to improve the accuracies of classifiers. Although obtaining the more accurate classifier is often targeted, there is an alternative way to reach for it. Indeed one can use many inaccurate classifiers each of which is specialized for a few dataitems in the problem space and then s/he can consider their consensus vote as the classification. This paper proposes a new ensembles methodology that uses ensemble of classifiers as elements of ensemble. These ensembles of classifiers jointly work using majority weighted voting. The results of these ensembles are in weighted manner combined to decide the final vote of the classification. In empirical result, these weights in final classifier are determined with using a series of genetic algorithms. We evaluate the proposed framework on a very large scale Persian digit handwritten dataset and the results show effectiveness of the algorithm.

Keywords

Genetic Algorithm Optical Character Recognition Pairwise Classifier Multiclass Classification 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bala, J., De Jong, K., Huang, J., Vafaie, H., Wechsler, H.: Using learning to facilitate the evolution of features for recognizing visual concepts. Evolutionary Computation, Special Issue on Evolution, Learning, and Instinct: 100 years of the Baldwin Effect 4(3) (1997)Google Scholar
  2. 2.
    Bandyopadhyay, S., Muthy, C.A.: Pattern Classification Using Genetic Algorithms. Pattern Recognition Letters 16, 801–808 (1995)CrossRefGoogle Scholar
  3. 3.
    Breiman, L.: Bagging Predictors. Journal of Machine Learning 24(2), 123–140 (1996)zbMATHGoogle Scholar
  4. 4.
    Guerra-Salcedo, C., Whitley, D.: Feature Selection mechanisms for ensemble creation: a genetic search perspective. In: Freitas, A.A. (ed.) Data Mining with Evolutionary Algorithms: Research Directions – Papers from the AAAI Workshop, Technical Report WS-99-06, pp. 13–17. AAAI Press, Menlo Park (1999)Google Scholar
  5. 5.
    Gunter, S., Bunke, H.: Creation of classifier ensembles for handwritten word recognition using feature selection algorithms. In: IWFHR 2002, January 15 (2002)Google Scholar
  6. 6.
    Holland, J.: Adaptive in Natural and Artificial Systems. MIT Press, Cambridge (1992) (1st edn. The University of Michigan Press, Ann Arbor (1975))Google Scholar
  7. 7.
    Khosravi, H., Kabir, E.: Introducing a very large dataset of handwritten Farsi digits and a study on the variety of handwriting styles. Pattern Recognition Letters 28(10), 1133–1141 (2007)CrossRefGoogle Scholar
  8. 8.
    Kuncheva, L.I., Jain, L.C.: Designing Classifier Fusion Systems by Genetic Algorithms. IEEE Transaction on Evolutionary Computation 33, 351–373 (2000)Google Scholar
  9. 9.
    Kuncheva, L.I.: Combining Pattern Classifiers, Methods and Algorithms. Wiley, New York (2005)zbMATHGoogle Scholar
  10. 10.
    Martin-Bautista, M.J., Vila, M.A.: A survey of genetic feature selection in mining issues. In: Proceeding Congress on Evolutionary Computation (CEC 1999), Washington DC, pp. 1314–1321 (1999)Google Scholar
  11. 11.
    Minaei-Bidgoli, B., Punch, W.F.: Using Genetic Algorithms for Data Mining Optimization in an Educational Web-based System. In: Cantú-Paz, E., Foster, J.A., Deb, K., Davis, L., Roy, R., O’Reilly, U.-M., Beyer, H.-G., Kendall, G., Wilson, S.W., Harman, M., Wegener, J., Dasgupta, D., Potter, M.A., Schultz, A., Dowsland, K.A., Jonoska, N., Miller, J., Standish, R.K. (eds.) GECCO 2003. LNCS, vol. 2723, Springer, Heidelberg (2003)Google Scholar
  12. 12.
    Minaei-Bidgoli, B., Kortemeyer, G., Punch, W.F.: Mining Feature Importance: Applying Evolutionary Algorithms within a Web-Based Educational System. In: Proc. of the Int. Conf. on Cybernetics and Information Technologies, Systems and Applications (2004)Google Scholar
  13. 13.
    Parvin, H., Alizadeh, H., Fathi, M., Minaei-Bidgoli, B.: Improved Face Detection Using Spatial Histogram Features. In: Improved Face Detection Using Spatial Histogram Features. The 2008 Int. Conf. on Image Processing, Computer Vision, and Pattern Recognition (IPCV 2008), Las Vegas, Nevada, USA, July 14-17 (2008)Google Scholar
  14. 14.
    Punch, W.F., Pei, M., Chia-Shun, L., Goodman, E.D., Hovland, P., Enbody, R.: Further research on Feature Selection and Classification Using Genetic Algorithms. In: 5th International Conference on Genetic Algorithm, Champaign IL, pp. 557–564 (1993)Google Scholar
  15. 15.
    Saberi, A., Vahidi, M., Minaei-Bidgoli, B.: Learn to Detect Phishing Scams Using Learning and Ensemble Methods. In: IEEE/WIC/ACM International Conference on Intelligent Agent Technology, Workshops (IAT 2007), Silicon Valley, USA, November 2-5, vol. 5, pp. 311–314 (2007)Google Scholar
  16. 16.
    Vafaie, H., De Jong, K.: Robust feature Selection algorithms. In: Proceeding 1993 IEEE Int. Conf on Tools with AI, Boston, Mass., USA, pp. 356–363 (1993)Google Scholar
  17. 17.
    Yang, T.: Computational Verb Decision Trees. International Journal of Computational Cognition, 34–46 (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Hamid Parvin
    • 1
  • Behrouz Minaei
    • 1
  • Hosein Alizadeh
    • 1
  1. 1.School of Computer EngineeringIran University of Science and Technology (IUST)TehranIran

Personalised recommendations