Abstract
Machine learning is evolved from a collection of powerful techniques in AI areas and has been extensively used in data mining, which allows the system to learn the useful structural patterns and models from training data. Machine learning algorithms can be basically classified into four categories: supervised, unsupervised, semi-supervised and reinforcement learning. In this chapter, widely-used machine learning algorithms are introduced. Each algorithm is briefly explained with some examples.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
S. B. Kotsiantis, I. Zaharakis, and P. Pintelas, “Supervised machine learning: A review of classification techniques,” Emerging Artificial Intelligence Applications in Computer Engineering, vol. 160, pp. 3–24, 2007.
J. Friedman, T. Hastie, and R. Tibshirani, The Elements of Statistical Learning. Springer Series in Statistics New York, 2001, vol. 1.
T. Cover and P. Hart, “Nearest neighbor pattern classification,” IEEE Trans. Information Theory, vol. 13, no. 1, pp. 21–27, Jan. 1967.
L. Breiman, J. Friedman, C. J. Stone, and R. A. Olshen, Classification and Regression Trees. CRC Press, 1984.
J. Han, J. Pei, and M. Kamber, Data Mining: Concepts and Techniques. Elsevier, 2011.
J. R. Quinlan, “Induction of decision trees,” Machine Learning, vol. 1, no. 1, pp. 81–106, 1986.
S. Karatsiolis and C. N. Schizas, “Region based support vector machine algorithm for medical diagnosis on Pima Indian Diabetes dataset,” in Proc. IEEE BIBE’12, Larnaca, Cyprus, Nov. 2012, pp. 139–144.
W. R. Burrows, M. Benjamin, S. Beauchamp, E. R. Lord, D. McCollor, and B. Thomson, “CART decision-tree statistical analysis and prediction of summer season maximum surface ozone for the Vancouver, Montreal, and Atlantic regions of Canada,” Journal of Applied Meteorology, vol. 34, no. 8, pp. 1848–1862, 1995.
A. Kumar, P. Bhatia, A. Goel, and S. Kole, “Implementation and comparison of decision tree based algorithms,” International Journal of Innovations & Advancement in Computer Science, vol. 4, pp. 190–196, May. 2015.
L. Breiman, “Random forests,” Machine Learning, vol. 45, no. 1, pp. 5–32, 2001.
S. Haykin, Neural Networks: A Comprehensive Foundation. Prentice Hall PTR, 1994.
S. Haykin and N. Network, “A comprehensive foundation,” Neural Networks, vol. 2, no. 2004, p. 41, 2004.
K. Lee, D. Booth, and P. Alam, “A comparison of supervised and unsupervised neural networks in predicting bankruptcy of Korean firms,” Expert Systems with Applications, vol. 29, no. 1, pp. 1–16, 2005.
S. Timotheou, “The random neural network: A survey,” The Computer Journal, vol. 53, no. 3, pp. 251–267, March 2010.
S. Basterrech and G. Rubino, “A tutorial about random neural networks in supervised learning,” arXiv preprint arXiv:1609.04846, 2016.
H. Bakirciouglu and T. Koccak, “Survey of random neural network applications,” European Journal of Operational Research, vol. 126, no. 2, pp. 319–330, 2000.
Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, vol. 521, no. 7553, p. 436, 2015.
J. Baker, “Artificial neural networks and deep learning,” Feb. 2015. [Online]. Available: http://lancs.ac.uk/~bakerj1/pdfs/ANNs/Artificial_neural_networks-report.pdf
J. Schmidhuber, “Deep learning in neural networks: An overview,” Neural Networks, vol. 61, pp. 85–117, 2015.
G. Pandey and A. Dukkipati, “Learning by stretching deep networks,” in International Conference on Machine Learning, 2014, pp. 1719–1727.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” in Advances in Neural Information Processing Systems, 2012, pp. 1097–1105.
C. Li, Y. Wu, X. Yuan, Z. Sun, W. Wang, X. Li, and L. Gong, “Detection and defense of DDoS attack-based on deep learning in OpenFlow-based SDN,” International Journal of Communication Systems, 2018.
T. Mikolov, M. Karafiát, L. Burget, J. Černockỳ, and S. Khudanpur, “Recurrent neural network based language model,” in Eleventh Annual Conference of the International Speech Communication Association, 2010.
H. Sak, A. Senior, and F. Beaufays, “Long short-term memory recurrent neural network architectures for large scale acoustic modeling,” in Fifteenth Annual Conference of the International Speech Communication Association, 2014.
S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural Computation, vol. 9, no. 8, pp. 1735–1780, 1997.
X. Li and X. Wu, “Constructing long short-term memory based deep recurrent neural networks for large vocabulary speech recognition,” in Proc. IEEE ICASSP’15, Brisbane, QLD, Australia, April 2015, pp. 4520–4524.
V. N. Vapnik and V. Vapnik, Statistical Learning Theory. Wiley New York, 1998, vol. 1.
B. Yekkehkhany, A. Safari, S. Homayouni, and M. Hasanlou, “A comparison study of different kernel functions for SVM-based classification of multi-temporal polarimetry SAR data,” The International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 40, no. 2, p. 281, 2014.
A. Patle and D. S. Chouhan, “SVM kernel functions for classification,” in Proc. IEEE ICATE’13, Mumbai, India, Jan 2013, pp. 1–9.
I. Steinwart and A. Christmann, Support Vector Machines. Springer Science & Business Media, 2008.
M. Martínez-Ramón and C. Christodoulou, “Support vector machines for antenna array processing and electromagnetics,” Synthesis Lectures on Computational Electromagnetics, vol. 1, no. 1, pp. 1–120, 2005.
H. Hu, Y. Wang, and J. Song, “Signal classification based on spectral correlation analysis and SVM in cognitive radio,” in Proc. IEEE AINA’08, Okinawa, Japan, March. 2008, pp. 883–887.
G. E. Box and G. C. Tiao, Bayesian Inference in Statistical Analysis. John Wiley & Sons, 2011, vol. 40.
J. Bakker, “Intelligent traffic classification for detecting DDoS attacks using SDN/OpenFlow,” Victoria University of Wellington, pp. 1–142, 2017.
N. Friedman, D. Geiger, and M. Goldszmidt, “Bayesian network classifiers,” Machine Learning, vol. 29, no. 2–3, pp. 131–163, 1997.
F. V. Jensen, An Introduction to Bayesian Networks. UCL Press London, 1996, vol. 210.
D. Heckerman et al., “A tutorial on learning with Bayesian networks,” Nato Asi Series D Behavioural And Social Sciences, vol. 89, pp. 301–354, 1998.
T. D. Nielsen and F. V. Jensen, Bayesian Networks and Decision Graphs. Springer Science & Business Media, 2009.
L. R. Rabiner, “A tutorial on hidden markov models and selected applications in speech recognition,” Proceedings of the IEEE, vol. 77, no. 2, pp. 257–286, Feb. 1989.
P. Holgado, V. A. VILLAGRA, and L. Vazquez, “Real-time multistep attack prediction based on hidden markov models,” IEEE Trans. Dependable and Secure Computing, vol. PP, no. 99, pp. 1–1, 2017.
E. Alpaydin, Introduction to Machine Learning. MIT Press, 2014.
T. Kanungo, D. M. Mount, N. S. Netanyahu, C. D. Piatko, R. Silverman, and A. Y. Wu, “An efficient k-means clustering algorithm: Analysis and implementation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 881–892, Jul. 2002.
T. Kohonen, “The self-organizing map,” Neurocomputing, vol. 21, no. 1–3, pp. 1–6, 1998.
M. M. Van Hulle, “Self-organizing maps,” in Handbook of Natural Computing. Springer, 2012, pp. 585–622.
X. Zhu, “Semi-supervised learning literature survey,” Citeseer, pp. 1–59, 2005.
X. Zhou and M. Belkin, “Semi-supervised learning,” in Academic Press Library in Signal Processing. Elsevier, 2014, vol. 1, pp. 1239–1269.
D.-H. Lee, “Pseudo-label: The simple and efficient semi-supervised learning method for deep neural networks,” in Workshop on Challenges in Representation Learning, ICML, vol. 3, 2013, p. 2.
H. Wu and S. Prasad, “Semi-supervised deep learning using Pseudo labels for hyperspectral image classification,” IEEE Trans. Image Processing, vol. 27, no. 3, pp. 1259–1270, March 2018.
O. Chapelle, B. Scholkopf, and A. Zien, “Semi-supervised learning (chapelle, o. et al., eds.; 2006)[book reviews],” IEEE Trans. Neural Networks, vol. 20, no. 3, pp. 542–542, 2009.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2019 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Yu, F.R., He, Y. (2019). Introduction to Machine Learning. In: Deep Reinforcement Learning for Wireless Networks. SpringerBriefs in Electrical and Computer Engineering. Springer, Cham. https://doi.org/10.1007/978-3-030-10546-4_1
Download citation
DOI: https://doi.org/10.1007/978-3-030-10546-4_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-10545-7
Online ISBN: 978-3-030-10546-4
eBook Packages: EngineeringEngineering (R0)