Soft Computing

, Volume 15, Issue 12, pp 2355–2374 | Cite as

A multistage genetic fuzzy classifier for land cover classification from satellite imagery

  • D. G. Stavrakoudis
  • J. B. Theocharis
  • G. C. Zalidis


A linguistic boosted genetic fuzzy classifier (LiBGFC) is proposed in this paper for land cover classification from multispectral images. The LiBGFC is a three-stage process, aiming at effectively tackling the interpretability versus accuracy tradeoff problem. The first stage iteratively generates fuzzy rules, as directed by a boosting algorithm that localizes new rules in uncovered subspaces of the feature space, implicitly preserving the cooperation with previously derived ones. Each rule is able to select the required features, further improving the interpretability of the obtained model. Special provision is taken in the formulation of the fitness function to avoid the creation of redundant rules. A simplification stage follows the first one aiming at further improving the interpretability of the initial rule base, providing a more compact and interpretable solution. Finally, a genetic tuning stage fine tunes the fuzzy sets database improving the classification performance of the obtained model. The LiBGFC is tested using an IKONOS multispectral VHR image, in a lake-wetland ecosystem of international importance. The results indicate the effectiveness of the proposed system in handling multidimensional feature spaces, producing easily understandable fuzzy models.


AdaBoost Genetic fuzzy rule-based classification systems (GFRBCS) Local feature selection Genetic tuning Evolutionary algorithms Textural and spatial features Multispectral image classification 


  1. Alcalá-Fdez J, Sánchez L, García S, del Jesus MJ, Ventura S, Garrell JM, Otero J, Romero C, Bacardit J, Rivas VM, Fernández JC, Herrera F (2009) KEEL: a software tool to assess evolutionary algorithms to data mining problems. Soft Comput 13(3):307–318 (software available online: Scholar
  2. Alonso JM, Magdalena L, Guillaume S (2006) Linguistic knowledge base simplification regarding accuracy and interpretability. Mathware Soft Comput 7(3):203–216Google Scholar
  3. Alonso JM, Magdalena L, Guillaume S (2008) HILK: a new methodology for designing highly interpretable linguistic knowledge bases using the fuzzy logic formalism. Int J Intell Syst 23(7):761–794zbMATHCrossRefGoogle Scholar
  4. Bäck T (1996) Evolutionary algorithms in theory and practice. Oxford University Press, OxfordzbMATHGoogle Scholar
  5. Baker JE (1985) Adaptive selection methods for genetic algorithm. In: Grefenstette JJ (ed) Proceedings of the first international conference on genetic algorithms and applications. Lawrence Erlbaum, Hillsdale, pp 101–111Google Scholar
  6. Bandyopadhyay S, Maulik U, Mukhopadhyay A (2007) Multiobjective genetic clustering for pixel classification in remote sensing imagery. IEEE Trans Geosci Remote Sens 45(5):1506–1511CrossRefGoogle Scholar
  7. Bárdossy A, Samaniego L (2002) Fuzzy rule-based classification of remotely sensed imagery. IEEE Trans Geosci Remote Sens 40:362–374CrossRefGoogle Scholar
  8. Beyer HG, Schwefel HP (2002) Evolution strategies—a comprehensive introduction. Nat Comput 1:3–52MathSciNetzbMATHCrossRefGoogle Scholar
  9. Bezdek JC, Kuncheva LI (2001) Nearest prototype classifier designs: an experimental study. Int J Intell Syst 16(12):1445–1473zbMATHCrossRefGoogle Scholar
  10. Casillas J, Martínez P, Benítez AD (2009) Learning consistent, complete and compact sets of fuzzy rules in conjunctive normal form for regression problems. Soft Comput 13(5):451–465CrossRefGoogle Scholar
  11. Cordón O, Herrera F (1997) A three-stage evolutionary process for learning descriptive and approximate fuzzy-logic-controller knowledge bases from examples. Int J Approx Reason 17(4):369–407zbMATHCrossRefGoogle Scholar
  12. Cordón O, Herrera F (1999) A two-stage evolutionary process for designing TSK fuzzy rule-based systems. IEEE Trans Syst Man Cybern Part B Cybern 29(6):703–715CrossRefGoogle Scholar
  13. Cordón O, Herrera F (2001) Hybridizing genetic algorithms with sharing scheme and evolution strategies for designing approximate fuzzy rule-based systems. Fuzzy Sets Syst 118(2):235–255zbMATHCrossRefGoogle Scholar
  14. Cordón O, del Jesus MJ, Herrera F (1998) Analyzing the reasoning mechanisms in fuzzy rule-based classification systems. Mathware Soft Comput 5(2–3):321–332zbMATHGoogle Scholar
  15. Cordón O, del Jesus MJ, Herrera F (1999a) A proposal on reasoning methods in fuzzy rule-based classification systems. Int J Approx Reason 20(1):21–45Google Scholar
  16. Cordón O, del Jesús MJ, Herrera F, Lozano M (1999b) MOGUL: a methodology to obtain genetic fuzzy rule-based systems under the iterative rule learning approach. Int J Intell Syst 14(11):1123–1153zbMATHCrossRefGoogle Scholar
  17. Cordón O, Herrera F, Hoffmann F, Magdalena L (2001) Genetic fuzzy systems: evolutionary tuning and learning of fuzzy knowledge Bases. World Scientific, SingaporezbMATHGoogle Scholar
  18. Cordón O, Gomide F, Herrera F, Hoffmann F, Magdalena L (2004) Ten years of genetic fuzzy systems: current framework and new trends. Fuzzy Sets Syst 141:5–31zbMATHCrossRefGoogle Scholar
  19. Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20:273–297zbMATHGoogle Scholar
  20. del Jesus MJ, Hoffmann F, Navascués LJ, Sánchez L (2004) Induction of fuzzy-rule-based classifiers with evolutionary boosting algorithms. IEEE Trans Fuzzy Syst 12(3):296–308CrossRefGoogle Scholar
  21. Dietterich TG (1998) Approximate statistical tests for comparing supervised classification learning algorithms. Neural Comput 10:1895–1924CrossRefGoogle Scholar
  22. Duda R, Hart P, Stork D (2001) Pattern classification, 2nd edn. Wiley, New YorkGoogle Scholar
  23. Freund Y, Schapire R (1996) Experiments with a new boosting algorithm. In: Proceedings of the 13th international conference on machine learning, San Francisco, pp 148–156Google Scholar
  24. Ghosh A, Pal NR, Das J (2006) A fuzzy rule based approach to cloud estimation. Remote Sens Environ 100:531–549CrossRefGoogle Scholar
  25. Giordana A, Neri F (1995) Search-intensive concept induction. Evol Comput 3(4):375–416CrossRefGoogle Scholar
  26. González A, Herrera F (1997) Multi-stage genetic fuzzy systems based on the iterative rule learning approach. Mathware Soft Comput 4:233–249zbMATHGoogle Scholar
  27. González A, Pérez R (1998) Completeness and consistency conditions for learning fuzzy rules. Fuzzy Sets Syst 96:37–51CrossRefGoogle Scholar
  28. González A, Pérez R (1999) SLAVE: a genetic learning system based on an iterative approach. IEEE Trans Fuzzy Syst 7(2):176–191CrossRefGoogle Scholar
  29. González A, Pérez R (2001) Selection of relevant features in a fuzzy genetic learning algorithm. IEEE Trans Syst Man Cybern Part B Cybern 31(3):417–425CrossRefGoogle Scholar
  30. Greene DP, Smith SF (1993) Competition-based induction of decision models from examples. Mach Learn 13(2–3):229–257CrossRefGoogle Scholar
  31. Haralick RM, Shapiro LG (1992) Robot and computer vision: vol 1. Addison-Wesley, ReadingGoogle Scholar
  32. Hoffmann F (2004) Combining boosting and evolutionary algorithms for learning of fuzzy classification rules. Fuzzy Sets Syst 14:47–58CrossRefGoogle Scholar
  33. Holland JH (1975) Adaptation in natural and artificial systems. University of Michigan Press, Ann ArborGoogle Scholar
  34. Horne JH (2003) A tasseled cap transformation for IKONOS images. In: Proceedings of the ASPRS annual conference, Anchorage, AlaskaGoogle Scholar
  35. Ishibuchi H (2007) Multiobjective genetic fuzzy systems: review and future research directions. In: Proceedings of the FUZZ-IEEE 2007, London, UK, pp 913–918Google Scholar
  36. Ishibuchi H, Nojima Y (2007) Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning. Int J Approx Reason 44(1):4–31MathSciNetzbMATHCrossRefGoogle Scholar
  37. Ishibuchi H, Yamamoto T (2004) Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining. Fuzzy Sets Syst 141(1):59–88MathSciNetzbMATHCrossRefGoogle Scholar
  38. Ishibuchi H, Yamamoto T (2005) Rule weight specification in fuzzy rule-based classification systems. IEEE Trans Fuzzy Syst 13(4):428–435CrossRefGoogle Scholar
  39. Ishibuchi H, Nozaki K, Tanaka H (1992) Distributed representation of fuzzy rules and its application to pattern classification. Fuzzy Sets Syst 52(1):21–32CrossRefGoogle Scholar
  40. Ishibuchi H, Nakashima T, Morisawa T (1999a) Voting in fuzzy rule-based systems for pattern classification problems. Fuzzy Sets Syst 103(2):223–238CrossRefGoogle Scholar
  41. Ishibuchi H, Nakashima T, Murata T (1999b) Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems. IEEE Trans Syst Man Cybern Part B-Cybern 29:601–618CrossRefGoogle Scholar
  42. Ishibuchi H, Nakashima T, Nii M (2004) Classification and modeling with linguistic information granules: advanced approaches to linguistic data mining. Springer, BerlinGoogle Scholar
  43. Karr C (1991) Genetic algorithms for fuzzy controllers. AI Expert 6(2):26–33Google Scholar
  44. Laha A, Pal NR, Das J (2006) Land cover classification using fuzzy rules and aggregation of contextual information through evidence theory. IEEE Trans Geosci Remote Sens 44(6):1633–1641CrossRefGoogle Scholar
  45. Lin C-T, Lee Y-C, Pu H-C (2000) Satellite sensor image classification using cascaded architecture of neural fuzzy network. IEEE Trans Geosci Remote Sens 38(2):1033–1043CrossRefGoogle Scholar
  46. Mallat SG (1989) Theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans Pattern Anal Mach Intell 11:674–693zbMATHCrossRefGoogle Scholar
  47. Mansoori EG, Zolghadri MJ, Katebi SD (2008) SGERD: a steady-state genetic algorithm for extracting fuzzy classification rules from data. IEEE Trans Fuzzy Syst 16(4):1061–1071CrossRefGoogle Scholar
  48. Melgani F, Al Hashemy BAR, Taha SMR (2000) An explicit fuzzy supervised classification method for multispectral remote sensing images. IEEE Trans Geosci Remote Sens 38(1):287–295CrossRefGoogle Scholar
  49. Mitrakis NE, Topaloglou CA, Alexandridis TK, Theocharis JB, Zalidis GC (2008a) A novel self-organizing neuro-fuzzy multilayered classifier for land cover classification of a VHR image. Int J Remote Sens 29(14):4061–4087CrossRefGoogle Scholar
  50. Mitrakis NE, Topaloglou CA, Alexandridis TK, Theocharis JB, Zalidis GC (2008b) Decision fusion of GA self-organizing neuro-fuzzy multilayered classifiers for land cover classification using textural and spectral features. IEEE Trans Geosci Remote Sens 46(7):2137–2152CrossRefGoogle Scholar
  51. Nakashima T, Schaefer G, Yokota Y, Ishibuchi H (2007) A weighted fuzzy classifier and its application to image processing tasks. Fuzzy Sets Syst 158(3):284–294MathSciNetCrossRefGoogle Scholar
  52. Otero J, Sánchez L (2006) Induction of descriptive fuzzy classifiers with the Logitboost algorithm. Soft Comput 10(9):825–835CrossRefGoogle Scholar
  53. Pakhira MK, Bandyopadhyay S, Maulik U (2005) A study of some fuzzy cluster validity indices, genetic clustering and application to pixel classification. Fuzzy Sets Syst 155(2):191–214MathSciNetCrossRefGoogle Scholar
  54. Papadakis SE, Theocharis JB (2002) A GA-based fuzzy modeling approach for generating TSK models. Fuzzy Sets Syst 131(1):121–152MathSciNetzbMATHCrossRefGoogle Scholar
  55. Parodi A, Bonelli P (1993) A new approach to fuzzy classifier systems. In: Proceedings of the 5th international conference on genetic algorithms. University of Illinois, Urbana-Champaign, pp 223–230Google Scholar
  56. Quinlan JR (1993) C4.5: programs for machine learning. Morgan Kauffman, San FranciscoGoogle Scholar
  57. Stathakis D, Vasilakos A (2008) A comparison of computational intelligence based classification techniques for remotely sensed optical image classification. IEEE Trans Geosci Remote Sens 44(8):2305–2318CrossRefGoogle Scholar
  58. Thrift P (1991) Fuzzy logic synthesis with genetic algorithms. In: Proceedings of ICGA’91, San Diego, USA, pp 509–513Google Scholar
  59. Valenzuela-Rendón M (1991) The fuzzy classifier system: a classifier system for continuously varying variables. In: Proceedings of the 4th international conference on genetic algorithms. University of California, San Diego, pp 346–353Google Scholar
  60. Zhang Y, Hong G (2005) An IHS and wavelet integrated approach to improve pan-sharpening visual quality of natural colour IKONOS and QuickBird images. Inform Fusion 6:225–234CrossRefGoogle Scholar

Copyright information

© Springer-Verlag 2010

Authors and Affiliations

  • D. G. Stavrakoudis
    • 1
  • J. B. Theocharis
    • 1
  • G. C. Zalidis
    • 2
  1. 1.Division of Electronics and Computer Engineering, Department of Electrical and Computer EngineeringAristotle University of ThessalonikiThessalonikiGreece
  2. 2.Laboratory of Applied Soil Science, Faculty of AgronomyAristotle University of ThessalonikiThessalonikiGreece

Personalised recommendations