Using Genetic Algorithms for Data Mining Optimization in an Educational Web-Based System

  • Behrouz Minaei-Bidgoli
  • William F. Punch
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2724)

Abstract

This paper presents an approach for classifying students in order to predict their final grade based on features extracted from logged data in an education web-based system. A combination of multiple classifiers leads to a significant improvement in classification performance. Through weighting the feature vectors using a Genetic Algorithm we can optimize the prediction accuracy and get a marked improvement over raw classification. It further shows that when the number of features is few; feature weighting is works better than just feature selection.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Baker, J. E.: Reducing bias and inefficiency in the selection algorithm, Proceeding ICGA 2, Lawrence Erlbuam Associates, Publishers, (1987) 14–21Google Scholar
  2. 2.
    Bala J., De Jong K., Huang J., Vafaie H.: and Wechsler H. Using learning to facilitate the evolution of features for recognizing visual concepts. Evolutionary Computation 4(3)-Special Issue on Evolution, Learning, and Instinct: 100 years of the Baldwin Effect. (1997)Google Scholar
  3. 3.
    Bandyopadhyay, S., and Muthy, C.A.: Pattern Classification Using Genetic Algorithms, Pattern Recognition Letters, Vol. 16, (1995) 801–808CrossRefGoogle Scholar
  4. 4.
    De Jong K.A., Spears W.M. and Gordon D.F.: Using genetic algorithms for concept learning. Machine Learning 13, (1993) 161–188CrossRefGoogle Scholar
  5. 5.
    Duda, R.O., Hart, P.E., and Stork, D.G.: Pattern Classification. 2nd Edition, John Wiley & Sons, Inc., New York NY. (2001)MATHGoogle Scholar
  6. 6.
    Falkenauer E.: Genetic Algorithms and Grouping Problems. John Wiley & Sons, (1998)Google Scholar
  7. 7.
    Freitas, A.A.: A survey of Evolutionary Algorithms for Data Mining and Knowledge Discovery, See: www.pgia.pucpr.br/~alex/papers. A chapter of: A. Ghosh and S. Tsutsui. (Eds.) Advances in Evolutionary Computation. Springer-Verlag, (2002)Google Scholar
  8. 8.
    Goldberg, D.E.: Genetic Algorithms in Search, Optimization, and Machine Learning, MA, Addison-Wesley, (1989)Google Scholar
  9. 9.
    Guerra-Salcedo C. and Whitley D.: Feature Selection mechanisms for ensemble creation: a genetic search perspective. In: Freitas AA (Ed.) Data Mining with Evolutionary Algorithms: Research Directions, Technical Report WS-99-06. AAAI Press, (1999)Google Scholar
  10. 10.
    Jain, A. K.; Zongker, D.: Feature Selection: Evaluation, Application, and Small Sample Performance, IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 19, No. 2, February (1997)Google Scholar
  11. 11.
    Kuncheva, L.I., and Jain, L.C.: Designing Classifier Fusion Systems by Genetic Algorithms, IEEE Transaction on Evolutionary Computation, Vol. 33 (2000) 351–373Google Scholar
  12. 12.
    Martin-Bautista MJ and Vila MA. A survey of genetic feature selection in mining issues. Proceeding Congress on Evolutionary Computation (CEC-99), Washington D.C., July (1999) 1314–1321Google Scholar
  13. 13.
    Michalewicz Z.: Genetic Algorithms + Data Structures = Evolution Programs. 3rd Ed. Springer-Verlag, (1996)Google Scholar
  14. 14.
    Muhlenbein and Schlierkamp-Voosen D.: Predictive Models for the Breeder Genetic Algorithm: I. Continuous Parameter Optimization, Evolutionary Computation, Vol. 1, No. 1, (1993) 25–49CrossRefGoogle Scholar
  15. 15.
    Park Y and Song M.: A genetic algorithm for clustering problems. Genetic Programming 1998: Proceeding of 3rd Annual Conference, Morgan Kaufmann, (1998), 568–575.Google Scholar
  16. 16.
    Pei, M., Goodman, E.D. and Punch, W.F.: Pattern Discovery from Data Using Genetic Algorithms, Proceeding of 1st Pacific-Asia Conference Knowledge Discovery & Data Mining (PAKDD-97) Feb. (1997)Google Scholar
  17. 17.
    Pei, M., Punch, W.F., and Goodman, E.D.: Feature Extraction Using Genetic Algorithms, Proceeding of International Symposium on Intelligent Data Engineering and Learning’98 (IDEAL’98), Hong Kong, Oct. (1998)Google Scholar
  18. 18.
    Punch, W.F., Pei, M., Chia-Shun, L., Goodman, E.D.: Hovland, P., and Enbody R. Further research on Feature Selection and Classification Using Genetic Algorithms, In 5th International Conference on Genetic Algorithm, Champaign IL, (1993) 557–564Google Scholar
  19. 19.
    Siedlecki, W., Sklansky J., A note on genetic algorithms for large-scale feature selection, Pattern Recognition Letters, Vol. 10, (1989) 335–347MATHCrossRefGoogle Scholar
  20. 20.
    Skalak D. B.: Using a Genetic Algorithm to Learn Prototypes for Case Retrieval an Classification. Proceeding of the AAAI-93 Case-Based Reasoning Workshop, Washigton, D.C., American Association for Artificial Intelligence, Menlo Park, CA, (1994) 64–69Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Behrouz Minaei-Bidgoli
    • 1
  • William F. Punch
    • 1
  1. 1.Genetic Algorithms Research and Applications Group (GARAGe), Department of Computer Science & EngineeringMichigan State UniversityEast Lansing

Personalised recommendations