Skip to main content

Semi-supervised Data Mining Tool Design with Self-tuning Optimization Techniques

  • Conference paper
  • First Online:
Book cover Informatics in Control, Automation and Robotics (ICINCO 2017)

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 495))

  • 956 Accesses

Abstract

Due to its wide applicability, the problem of semi-supervised classification is attracting increasing attention in machine learning. Presented in this article are semi-supervised artificial neural network- (ANN) and support vector machine- (SVM) based classifiers designed by the self-configuring genetic algorithm (SelfCGA) and the fuzzy controlled meta-heuristic approach Co-operation of Biology Related Algorithms (COBRA). Both data mining tools are based on dividing instances from different classes using both labelled and unlabelled examples. A new collective bionic algorithm, namely fuzzy controlled cooperation of biology-related algorithms, which solves constrained optimization problems, COBRA-cf, has been developed for the design of semi-supervised SVMs. Firstly, the experimental results obtained by the two types of fuzzy controlled COBRA are presented and compared and their usefulness is demonstrated. Then the performance and behaviour of the proposed semi-supervised SVMs and semi-supervised ANNs were studied under common experimental settings and their workability was established. Then their efficiency was estimated on a speech-based emotion recognition problem. Thus, the workability of the proposed meta-heuristic optimization algorithms was confirmed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning: Data Mining, Inference, and Prediction (2009)

    Google Scholar 

  2. Bishop, C.M.: Theoretical foundation of neural networks. Technical Report, Aston University, Neural computing Research Group, UK, NCRG-96-024 (1996)

    Google Scholar 

  3. Kuncheva, L.I.: How good are fuzzy if-then classifiers? IEEE Trans. Syst. Man Cybern. B Cybern. 30(4), 501–509 (2000)

    Article  Google Scholar 

  4. Vapnik, V., Chervonenkis, A.: Theory of Pattern Recognition. Nauka, Moscow (1974)

    MATH  Google Scholar 

  5. Zhu, X., Goldberg, A.B.: Introduction to Semi-supervised Learning Morgan and Claypool (2009)

    Google Scholar 

  6. Bennett, K.P., Demiriz, A.: Semi-supervised support vector machines. Adv. Neural. Inf. Process. Syst. 11, 368–374 (1999)

    Google Scholar 

  7. Semenkina, M., Akhmedova, S.H., Semenkin, E.: Nonlinguistic information extraction by semi-supervised techniques. In: The 14th International Conference on Informatics in Control, Automation and Robotics (2017)

    Google Scholar 

  8. Akhmedova, S.H., Semenkin, E., Stanovov, V.: Semi-supervised SVM with fuzzy controlled cooperation of biology related algorithms. In: The 14th International Conference on Informatics in Control, Automation and Robotics (2017)

    Google Scholar 

  9. Semenkin, E.S., Semenkina, M.E.: Self-configuring genetic algorithm with modified uniform crossover operator. Advances in Swarm Intelligence. Lecture Notes in Computer Science 7331, pp. 414–421. Springer, Berlin Heidelberg (2012)

    Google Scholar 

  10. Akhmedova, S.H., Semenkin, E.: Co-operation of biology related algorithms. In: IEEE Congress on Evolutionary Computation, pp. 2207–2214 (2013)

    Google Scholar 

  11. Akhmedova, S.H., Semenkin, E., Stanovov, V., Vishnevskaya, S.: Fuzzy logic controller design for tuning the Cooperation of Biology-Inspired Algorithms. Advances in swarm intelligence, ICSI 2017, Lecture Notes in Computer Science, vol. 10386, pp. 269–274 (2017)

    Google Scholar 

  12. Jain, A., Law, M.: Data clustering: a user’s dilemma. Lect. Notes Comput. Sci. 3776, 1–10 (2005)

    Article  Google Scholar 

  13. Frank, A., Asuncion, A.: UCI Machine Learning Repository. Irvine, University of California, School of Information and Computer Science (2010). http://archive.ics.uci.edu/ml

  14. Chapelle, O., Zien, A., Schoelkopf, B.: Semi-supervised learning. MIT Press. (2006)

    Google Scholar 

  15. Joachims, T.: Transductive inference for text classification using support vector machines. In: ICML ‘99 Proceedings of the Sixteenth International Conference on Machine Learning, pp. 200–209 (1999)

    Google Scholar 

  16. Ravi, S.: Semi-supervised Learning in Support Vector Machines. Project Report COS 521 (2014)

    Google Scholar 

  17. Kennedy, J., Eberhart, R.: Particle Swarm Optimization. In: IEEE International Conference on Neural networks, IV, pp. 1942–1948 (1995)

    Google Scholar 

  18. Yang, Ch., Tu, X., Chen, J.: Algorithm of Marriage in Honey Bees Optimization Based on the Wolf Pack Search. In: International Conference on Intelligent Pervasive Computing, pp. 462–467 (2007)

    Google Scholar 

  19. Yang, X.S.: Firefly algorithms for multimodal optimization. In: 5th Symposium on Stochastic Algorithms, Foundations and Applications, pp. 169–178 (2009)

    Chapter  Google Scholar 

  20. Yang, X.S., Deb, S.: Cuckoo Search via Levy flights. In: World Congress on Nature & Biologically Inspired Computing, pp. 210–214. IEEE Publications (2009)

    Google Scholar 

  21. Yang, X.S.: A new metaheuristic bat-inspired algorithm. Nature Inspired Cooperative Strategies for Optimization, Studies in Computational Intelligence, vol. 284, pp. 65–74 (2010)

    MATH  Google Scholar 

  22. Bastos, F.C., Lima, N.F.: Fish School Search: an overview. Nature-Inspired Algorithms for Optimization. Series: Studies in Computational Intelligence, vol. 193, pp. 261–277 (2009)

    Google Scholar 

  23. Akhmedova, S.H., Semenkin, E.: New optimization metaheuristic based on co-operation of biology related algorithms. Vestnik. Bulletine of Siberian State Aerospace University, vol. 4, 50, pp. 92–99 (2013)

    Google Scholar 

  24. Eiben, A.E., Smith, J.E.: Introduction to evolutionary computation. Springer, Berlin (2003)

    Book  Google Scholar 

  25. Deb, K.: An efficient constraint handling method for genetic algorithms. Comput. Methods Appl. Mech. Eng. 186(2–4), 311–338 (2000)

    Article  Google Scholar 

  26. Liang, J.J., Shang Z., Li, Z.: Coevolutionary comprehensive learning particle swarm optimizer. In: Congress on Evolutionary Computation, pp. 1505–1512 (2010)

    Google Scholar 

  27. Whitley, D., Mathias, K., Rana, S., Dzubera, J.: Building Better Test Functions. In: The Sixth International Conference on Genetic Algorithms and their Applications, pp. 239–246 (1995)

    Google Scholar 

  28. Li, Y.F., Zhou, Z.H.: Improving semi-supervised support vector machines through unlabeled instances selection. In: The Twenty Fifth AAAI Conference on Artificial Intelligence, pp. 386–391 (2011)

    Google Scholar 

  29. Boersma, P.: Praat, a system for doing phonetics by computer. Glot Int. 5(9/10), 341–345 (2002)

    Google Scholar 

  30. Eyben, F., Wllmer, M., Schuller, B.: Opensmile: the Munich versatile and fast opensource audio feature extractor. In: International Conference on Multimedia, pp. 1459–1462. ACM (2010)

    Google Scholar 

Download references

Acknowledgements

The reported study was funded by the Russian Foundation for Basic Research, Government of Krasnoyarsk Territory, Krasnoyarsk Region Science and Technology Support Fund for the research project № 16-41-243064.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maria Semenkina .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Akhmedova, S., Semenkina, M., Stanovov, V., Semenkin, E. (2020). Semi-supervised Data Mining Tool Design with Self-tuning Optimization Techniques. In: Gusikhin, O., Madani, K. (eds) Informatics in Control, Automation and Robotics . ICINCO 2017. Lecture Notes in Electrical Engineering, vol 495. Springer, Cham. https://doi.org/10.1007/978-3-030-11292-9_5

Download citation

Publish with us

Policies and ethics