Ant Based Semi-supervised Classification

  • Anindya Halder
  • Susmita Ghosh
  • Ashish Ghosh
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6234)

Abstract

Semi-supervised classification methods make use of the large amounts of relatively inexpensive available unlabeled data along with the small amount of labeled data to improve the accuracy of the classification. This article presents a novel ‘self-training’ based semi-supervised classification algorithm using the property of aggregation pheromone found in natural behavior of real ants. The proposed algorithm is evaluated with real life benchmark data sets in terms of classification accuracy. Also the method is compared with two conventional supervised classification methods and two recent semi-supervised classification techniques. Experimental results show the potentiality of the proposed algorithm.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bennett, K.P., Demiriz, A.: Semi-supervised support vector machines. In: Advances in Neural Information Processing Systems, pp. 368–374. MIT Press, Cambridge (1998)Google Scholar
  2. 2.
    Blum, A., Chawla, S.: Learning from labeled and unlabeled data using graph mincuts. In: Proc. 18th Intl. Conf. on Machine Learning, pp. 19–26. Morgan Kaufmann, San Francisco (2001)Google Scholar
  3. 3.
    Blum, A., Lafferty, J., Rwebangira, M.R., Reddy, R.: Semi-supervised learning using randomized mincuts. In: Proc. of the 21st Intl. Conf. on Machine Learning, pp. 97–104 (2004)Google Scholar
  4. 4.
    Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceedings of the eleventh annual conference on Computational learning theory, pp. 92–100. Morgan Kaufmann Publishers, San Francisco (1998)CrossRefGoogle Scholar
  5. 5.
    Chapelle, O., Schölkopf, B., Zien, A.: Semi-Supervised Learning, Adaptive Computation and Machine Learning. The MIT Press, Cambridge (2006)Google Scholar
  6. 6.
    Chapelle, O., Zien, A.: Semi-supervised classification by low density separation. In: Proc. of the 10th Intl. Workshop on Artificial Intelligence and Statistics, pp. 57–64 (2005)Google Scholar
  7. 7.
    Collobert, R., Sinz, F., Weston, J., Bottou, L., Joachims, T.: Large scale transductive svms. Journal of Machine Learning Research 7, 1687–1712 (2006)Google Scholar
  8. 8.
    Dorigo, M., Stützle, T.: Ant Colony Optimization. Prentice Hall of India Private Limited, New Delhi (2005)Google Scholar
  9. 9.
    Ghosh, A., Halder, A., Kothari, M., Ghosh, S.: Aggregation pheromone density based data clustering. Information Sciences 178(13), 2816–2831 (2008)CrossRefGoogle Scholar
  10. 10.
    Halder, A., Ghosh, A., Ghosh, S.: Aggregation pheromone density based pattern classification. Fundamenta Informaticae 92(4), 345–362 (2009)MathSciNetGoogle Scholar
  11. 11.
    Handl, J., Meyer, B.: Ant-based and swarm-based clustering. Swarm Intelligence 1, 95–113 (2007)CrossRefGoogle Scholar
  12. 12.
    Haykin, S.: Neural Networks: A Comperehensive Foundation, 2nd edn. Prentice Hall, Englewood Cliffs (1999)Google Scholar
  13. 13.
    Liu, B., Abbass, H.A., McKay, B.: Density-based heuristic for rule discovery with ant-miner. In: Proc. of 6th Australasia-Japan Joint Workshop on Intelligence Evololution System, Canberra, Australia, pp. 180–184 (2002)Google Scholar
  14. 14.
    Newman, D.J., Hettich, S., Blake, C.L., Merz, C.J.: UCI repository of machine learning databases. University of California, Department of Information and Computer Sciences, http://www.ics.uci.edu/~mlearn/MLRepository.html
  15. 15.
    Nigam, K., Mccallum, A.K., Thrun, S., Mitchell, T.: Text classification from labeled and unlabeled documents using EM. Machine Learning 39(2-3), 103–134 (2000)MATHCrossRefGoogle Scholar
  16. 16.
    Pal, S.K., Majumder, D.D.: Fuzzy sets and decision making approaches in vowel and speaker recognition. IEEE Transactions on Systems, Man, and Cybernetics 7, 625–629 (1977)MATHCrossRefGoogle Scholar
  17. 17.
    Rosenberg, C., Hebert, M., Schneiderman, H.: Semi-supervised self-training of object detection models. In: Seventh IEEE Workshop on Applications of Computer Vision, pp. 29–36 (2005)Google Scholar
  18. 18.
    Schölkopf, B., Smola, A.J.: Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, Cambridge (2002)Google Scholar
  19. 19.
    Tsutsui, S.: Ant colony optimization for continuous domains with aggregation pheromones metaphor. In: Proc. of the 5th Intl. Conf. on Recent Advances in Soft Computing, United Kingdom, pp. 207–212 (December 2004)Google Scholar
  20. 20.
    Yarowsky, D.: Unsupervised word sense disambiguation rivaling supervised methods. In: Proc. of the 33rd Annual Meeting of the Association for Computational Linguistics, pp. 189–196 (1995)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Anindya Halder
    • 1
  • Susmita Ghosh
    • 2
  • Ashish Ghosh
    • 1
  1. 1.Indian Statistical InstituteCenter for Soft Computing ResearchKolkataIndia
  2. 2.Dept. of Computer Science & Engg.Jadavpur UniversityKolkataIndia

Personalised recommendations