Genetic Algorithms for Multi-classifier System Configuration: A Case Study in Character Recognition

  • K. Sirlantzis
  • M. C. Fairhurst
  • M. S. Hoque
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2096)


We describe a multiple classifier system which incorporates an automatic self-configuration scheme based on genetic algorithms. Our main interest in this paper is focused on exploring the statistical properties of the resulting multi-expert configurations. To this end we initially test the proposed system on a series of tasks of increasing difficulty drawn from the domain of character recognition. We then proceed to investigate the performance of our system not only in comparison to that of its constituent classifiers, but also in comparison to an independent set of individually optimised classifiers. Our results illustrate that significant gains can be obtained by integrating a genetic algorithm based optimisation process into multi-classifier schemes both in the performance enhancement and in the reduction of its volatility, especially as the task domain becomes more complex.


Genetic Algorithm Recognition Rate Character Recognition Document Image Combination Scheme 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    A. Brindle, Genetic algorithms for function optimization. Included in TCGA Tech. Report No. 91002, University of Alabama, Tuscaloosa, AL 35487, USA (Report authors: R. E. Smith, D. E. Goldberg and J. A. Earickson).Google Scholar
  2. 2.
    T.G. Dietterich. Machine Learning Research: Four Current Directions. AI Magazine, 18(4):97–136, 1997.Google Scholar
  3. 3.
    A.J. Elms and J. Illingworth. Combination of HMMs for the representation of printed characters in noisy document images. Image and Vision Computing, 13(5):385–392, 1995.CrossRefGoogle Scholar
  4. 4.
    M.C. Fairhurst and T.J. Stonham. A classification system for alphanumeric characters based on learning network techniques. Digital Processes, 2:321–339, 1976.zbMATHGoogle Scholar
  5. 5.
    M.C. Fairhurst and M.S. Hoque. Moving window classifier: approach to off-line image recognition. Ellectronics Letters, 36(7):628–630, 2000.CrossRefGoogle Scholar
  6. 6.
    D.E. Goldberg. Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley Publishing Company, Inc., 1989.Google Scholar
  7. 7.
    J.H. Holland. Adaption in Natural and Artificial Systems. University of Michigan Press, Ann Arbor, 1975.zbMATHGoogle Scholar
  8. 8.
    J. Kittler, M. Hatef, R.P.W. Duin, and J. Matas. On combining classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(3):226–239, 1998.CrossRefGoogle Scholar
  9. 9.
    L.I. Kuncheva and L.C. Jain. Designing classifier fusion systems by genetic algorithms. IEEE Transactions on Evolutionary Computation, 4(4):327–336, 2000.CrossRefGoogle Scholar
  10. 10.
    S. Lucas. Can scanning n-tuple classifiers be improved by pre-transforming training data? In IEE Workshop on Handwriting Analysis and Recognition–A European Perspective (Ref. No 1996/165), pages 4/1–6, IEE, UK, 1996.Google Scholar
  11. 11.
    D. Michie, D.J. Spiegelhalter, and C.C. Taylor. Machine Learning, Neural and Statistical Classification. Ellis Horwood Series in Artificial Intelligence. Ellis Horwood Ltd, London, 1994.zbMATHGoogle Scholar
  12. 12.
    A.F.R. Rahman and M.C. Fairhurst. An evaluation of multi-expert configurations for recognition of handwritten numerals. Pattern Recog., 31(9):1255–1273, 1998.CrossRefGoogle Scholar
  13. 13.
    A.F.R. Rahman and M.C. Fairhurst. Machine-printed character recognition revisited: Re-application of recent advances in handwritten character recognition research. Special Issue on Document Image Processing and Multimedia Environments, Image & Vision Computing, 16(12-13):819–842, 1998.Google Scholar
  14. 14.
    A.F.R. Rahman and M.C. Fairhurst. Automatic self-configuration of a novel multiple-expert classifier using a genetic algorithm. In Proc. Int. Conf. on Image Processing and Applications (IPA’99), volume 1, pages 57–61, 1999.CrossRefGoogle Scholar
  15. 15.
    D.E. Rumelhart, G.E. Hinton, and R.J. Williams. Learning internal representations by error propagation, in Parallel Distributed Processing, volume 1, pages 318–362. MIT Press, Cambridge, MA, 1986. D.E. Rumelhart and J.L. McClelland(Eds.).Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • K. Sirlantzis
    • 1
  • M. C. Fairhurst
    • 1
  • M. S. Hoque
    • 1
  1. 1.Department of ElectronicsUniversity of KentCanterburyUK

Personalised recommendations