Springer Nature is making SARS-CoV-2 and COVID-19 research free. View research | View latest news | Sign up for updates

Optimal network selection in heterogeneous wireless multimedia networks


The complementary characteristics of different wireless networks make it attractive to integrate a wide range of radio access technologies. Most of previous work on integrating heterogeneous wireless networks concentrates on network layer quality of service (QoS), such as blocking probability and utilization, as design criteria. However, from a user’s point of view, application layer QoS, such as multimedia distortion, is an important issue. In this paper, we propose an optimal distributed network selection scheme in heterogeneous wireless networks considering multimedia application layer QoS. Specifically, we formulate the integrated network as a restless bandit system. With this stochastic optimization formulation, the optimal network selection policy is indexable, meaning that the network with the lowest index should be selected. The proposed scheme can be applicable to both tight coupling and loose coupling scenarios in the integration of heterogeneous wireless networks. Simulation results are presented to illustrate the performance of the proposed scheme.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9


  1. 1.

    ETSI. (2001). Requirements and architectures for interworking between HIPERLAN/3 and 3rd generation cellular systems. Tech. Rep. ETSI TR, 101, 957, Aug.

  2. 2.

    3GPP TS 23.234, v.6.2.0,. (2004). Group services and system aspects; 3GPP systems to wireless local area network (WLAN) interworking; system description (release 6), Sept.

  3. 3.

    Gustafsson, E., & Jonsson, A. (2003). Always best connected. IEEE Wireless Communications, 10(1), 49–55.

  4. 4.

    Song, Q., & Jamalipour, A. (2005). Network selection in an integrated wireless LAN and UMTS environment using mathematical modeling and computing techniques. IEEE Wireless Communications, 12(3), 42–48.

  5. 5.

    Song, W., Jiang, H., Zhuang, W., & Shen, X. (2005). Resource management for QoS support in cellular/WLAN interworking. IEEE Network, 19(5), 12–18.

  6. 6.

    Song, W., Jiang, H., & Zhuang, W. (2007). Performance analysis of the WLAN-first scheme in cellular/WLAN interworking. IEEE Transactions on Wireless Communications, 6(5), 1932–1952.

  7. 7.

    Song, W., Cheng, Y., & Zhuang, W. (2007). Improving voice and data services in cellular/WLAN integrated networks by admission control. IEEE Transactions on Wireless Communications, 6(11), 4025–4037.

  8. 8.

    Bari, F., & Leung, V. (2007). Automated network selection in a heterogeneous wireless network environment. IEEE Network, 21(1), 34–40.

  9. 9.

    Yu F., & Krishnamurthy, V. (2007). Optimal joint session admission control in integrated WLAN and CDMA cellular networks with vertical handoff. IEEE Transactions on Mobile Computing, 6(1), 126–139.

  10. 10.

    Niyato, D., & Hossain, E. (2008). A noncooperative game-theoretic framework for radio resource management in 4G heterogeneous wireless access networks. IEEE Transactions on Mobile Computing, 7(3), 332–345.

  11. 11.

    Gelabert, X., Peréz-Romero, J., Sallent, O., & Agustí, R. (2008). A Markovian approach to radio access technology selection in heterogeneous multiaccess/Multiservice wireless networks. IEEE Transactions on Mobile Computing, 7(10), 1257–1270.

  12. 12.

    Whittle, P. (1988). Restless bandits: activity allocation in a changing world. In J. Gani, (Ed.), A celebration of applied probability (vol. 25 of J. Appl. Probab, pp. 287–298). Sheffield: Applied Probability Trust.

  13. 13.

    Berstimas, D. & Niño-Mora, J. (2000). Restless bandits, linear programming relaxations, and a primal dual index heuristic. Operations Research, 48(1), 80–90.

  14. 14.

    Ny, J. L., Dahleh, M., & Feron, E. (2006). Multi-agent task assignment in the bandit framework. In Proceedings of the 45th IEEE Conference on Decision and Control (pp. 5281–5286). San Diego, California.

  15. 15.

    Ny, J. L. & Feron, E. (2006). Restless bandits with switching costs: Linear programming relaxations, performance bounds and limited lookahead policies. In Proceedings of the 2006 American Control Conference (pp. 1587–1592). Minneapolis, Minnesota.

  16. 16.

    Guo, G., Guo, Z., Zhang, Q., & Zhu, W. (2004). A seamless and proactive end-to-end mobility solution for roaming across heterogeneous wireless networks. IEEE Journal on Selected Areas in Communications, 12(5), 834–848.

  17. 17.

    Moon, K., Lee, Y., Son, Y., & Kim, C. (2003). Universal home network middleware guaranteeing seamless interoperability among the heterogeneous home network middleware. IEEE Transactions on Consumer Electronics, 49(3), 546–553.

  18. 18.

    Salkintzis, A. K. (2004). Interworking techniques and architectures for WLAN/3G integration toward 4G mobile data networks. IEEE Wireless Communications, 11, 50–61.

  19. 19.

    Buddhikot, M., Chandranmenon, G., Han, S., Lee, Y.W., Miller, S., & Salgarelli, L. (2003). Integration of 802.11 and third-generation wireless data networks. In Proceedings of IEEE INFOCOM’03, San Francisco, CA, Apr.

  20. 20.

    ANSI/IEEE Std. 802.11e, Draft 5.0 (2003). Wireless medium access control (MAC) and physical layer (PHY) specification: Medium access control (MAC) enhancement for quality of service (QoS), July.

  21. 21.

    Kuo, Y., Lu, C., Wu, E., & Chen, G. (2003). An admission control strategy for differentiated services in IEEE 802.11. In Proceedings of IEEE Globecom’03 (pp. 707–712). San Francisco, CA, Dec.

  22. 22.

    Zhu, H., & Chlamtac, I. (2006). A call admission and rate control scheme for multimedia support over IEEE 802.11 wireless LANs. Wireless Networks, 12, 451–463.

  23. 23.

    IEEE Std. 802.16-2004 (2004). IEEE standard for local and metropolitan area networks, part 16: Air interface for fixed broadband wireless access systems, Oct.

  24. 24.

    Liu, Q., Zhou, S., & Giannakis, G.B. (2005). Queuing with adaptive modulation and coding over wireless links: Cross-layer analysis and design. IEEE Transactions on Wireless Communications, 4(3), 1142–1153.

  25. 25.

    Elwalid, A.I., & Mitra, D. (1993). Effective bandwidth of general Markovian traffic sources and admission control of high speed networks. IEEE/ACM Transactions on Networking , 1(3), 329–343.

  26. 26.

    Holma, H., & Toskala, A. (2004). WCDMA for UMTS: Radio access for third generation mobile communications. NY: Wiley.

  27. 27.

    He, Z., Cai, J., & Chen, C. (2002). Joint source channel rate-distortion analysis for adaptive mode selection and rate control in wireless video coding. IEEE Transactions on Circuits and Systems for Video Technology, 12(6), 511–523.

  28. 28.

    Robbins, H. (1952). Some aspects of the sequential design of experiments. Bulletin of the American Mathematical Society, 55, 527–535.

  29. 29.

    Zhang, S., Yu, F., & Leung, V. (2008). Joint connection admission control and routing in IEEE 802.16-based mesh networks. In Proceedings of IEEE International Conference on Communications (ICC’08) (pp. 4938–4942), Beijing, P.R. China, May.

Download references


We thank the reviewers for their detailed reviews and constructive comments, which have helped to improve the quality of this paper.

Author information

Correspondence to Pengbo Si.

Additional information

This work was supported in part by the National Science Foundation of China under Grant 60672124 and 60832009, the Hi-Tech Research and Development Program (National 863 Program) under Grant 2007AA01Z221, and the National Key Basic Research and Development Plan of China (973 Program) under Grant 2009CB320400.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Si, P., Ji, H. & Yu, F.R. Optimal network selection in heterogeneous wireless multimedia networks. Wireless Netw 16, 1277–1288 (2010).

Download citation


  • Network Selection
  • Heterogeneous Wireless Network
  • Radio Access Technology
  • WiMAX Network
  • Decision Epoch