Abstract
The heterogeneous property in the next generation wireless network arises challenges of network selection problem. Existing approaches are mainly implemented in static network environments while cannot handle unpredictable dynamics in practice. In this paper, we propose a prediction and learning based approach, which considers both the fluctuation of radio resource and the variation of user demand. The network selection scenario is modeled as a multiagent coordination problem, in which a population of rational agents compete to maximize their benefits with incomplete information (no prior knowledge of network bandwidth and other users’ demands). Terminal users adaptively adjust their selections in response to the gradually or abruptly changing environment. The system is shown to converge to Nash equilibrium, which also turns out to be both Pareto optimal and socially optimal. Extensive simulation results show that our approach achieves significantly better performance compared with two existing approaches in terms of load balancing, user payoff and the overall bandwidth utilization efficiency.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Barve, S.S., Kulkarni, P.: Dynamic channel selection and routing through reinforcement learning in cognitive radio networks. In: IEEE International Conference on Computational Intelligence & Computing Research, pp. 1–7 (2012)
Brockwell, P.J., Davis, R.A.: Introduction to Time Series and Forecasting. STS. Springer, Cham (2016). doi:10.1007/b97391
Charilas, D.E., Panagopoulous, A.D.: Multiaccess radio network enviroments. IEEE Veh. Technol. Mag. 5(4), 40–49 (2010)
Jain, K., Padhye, J., Padmanabhan, V.N., Qiu, L.: Impact of interference on multi-hop wireless network performance. Wireless Netw. 11(4), 471–487 (2005)
Kianercy, A., Galstyan, A.: Dynamics of Boltzmann q learning in two-player two-action games. Phys. Rev. E 85(4), 041145 (2012)
Kittiwaytang, K., Chanloha, P., Aswakul, C.: CTM-based reinforcement learning strategy for optimal heterogeneous wireless network selection. In: Computational Intelligence, Modelling and Simulation (CIMSiM), pp. 73–78. IEEE (2010)
Martinez-Morales, J.D., Pineda-Rico, U., Stevens-Navarro, E.: Performance comparison between madm algorithms for vertical handoff in 4G networks. In: Electrical Engineering Computing Science and Automatic Control (CCE), pp. 309–314. IEEE (2010)
Monsef, E., Keshavarz-Haddad, A., Aryafar, E., Saniie, J., Chiang, M.: Convergence properties of general network selection games. In: 2015 IEEE Conference on Computer Communications (INFOCOM), pp. 1445–1453. IEEE (2015)
Niyato, D., Hossain, E.: Dynamics of network selection in heterogeneous wireless networks: an evolutionary game approach. IEEE Trans. Veh. Technol. 58(4), 2008–2017 (2009)
Perkins, D.D., Hughes, H.D., Owen, C.B.: Factors affecting the performance of ad hoc networks. In: IEEE International Conference on Communications, vol. 4, pp. 2048–2052 (2002)
Trestian, R., Ormond, O., Muntean, G.M.: Game theory-based network selection: solutions and challenges. IEEE Commun. Surv. Tutor. 14(4), 1212–1231 (2012)
Xu, Y., Chen, J., Ma, L., Lang, G.: Q-learning based network selection for WCDMA/WLAN heterogeneous wireless networks. In: 2014 IEEE 79th Vehicular Technology Conference (VTC Spring), pp. 1–5. IEEE (2014)
Acknowledgements
This work has partially been sponsored by the National Science Foundation of China (No. 61572349, No. 61272106), Tianjin Research Program of Application Foundation and Advanced Technology (No.:16JCQNJC00100).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Li, X., Cao, R., Hao, J., Feng, Z. (2017). A Prediction and Learning Based Approach to Network Selection in Dynamic Environments. In: Lintas, A., Rovetta, S., Verschure, P., Villa, A. (eds) Artificial Neural Networks and Machine Learning – ICANN 2017. ICANN 2017. Lecture Notes in Computer Science(), vol 10613. Springer, Cham. https://doi.org/10.1007/978-3-319-68600-4_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-68600-4_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-68599-1
Online ISBN: 978-3-319-68600-4
eBook Packages: Computer ScienceComputer Science (R0)