An Intelligent Traffic Regulator Scheme in Multimedia Networks

  • Ming-Chang Hsiao
  • Chien-Yuan Liu
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 293)


This paper proposed an intelligent and regulative traffic method for solving congestion control problems in multimedia networks. The proposed scheme, which is capable of rate-based predictive control, consists of two sub-systems: a long-term policy critic and a short-term rate-selector. Each controller in multimedia networks jointly learns the control policy by real-time interactions without prior knowledge of a network model. In addition, a reward evaluator provides reinforcement signals based on game theory to train controllers to adapt to fluctuant network environment. The well-trained controllers can take actions correctly to regulate source flow to simultaneously meet the requirements of high link utilization, low packet loss rate (PLR) and packet delay. Simulation results show that the proposed approach is effectively in controlling congestion of the multimedia traffic in internet networks.


Congestion control Reinforcement signals 



The authors greatly appreciate to the support of the National Science Council, R.O.C., under the Grant no. NSC 101-2632-E-230-001-NY3.


  1. 1.
    Gevros, P., Crowcoft, J., Kirstein, P., & Bhatti, S. (2005) Congestion control mechanisms and the best effort service model. IEEE Network, 15, 16–26.Google Scholar
  2. 2.
    Chiu, D., & Jain, R. (1989) Analysis of the increase and decrease algorithm for congestion avoidance in computer networks. Computer Networks and ISDN Systems, 17, 1–14.Google Scholar
  3. 3.
    Lee, S. J., & Hou, C. L. (2009). A neural-fuzzy system for congestion control in ATM networks. IEEE Transactions on System, Man and Cybernetics, 30, 2–9.Google Scholar
  4. 4.
    Cheng, R.-G., Chang, C.-J., & Lin, L.-F. (1999). A QoS-provisioning neural fuzzy connection admission controller for multimedia high-speed networks. IEEE/ACM Transactions on Networking, 7, 111–121.CrossRefGoogle Scholar
  5. 5.
    Rajkumar, Nigam, M. J., Sharma, S., & Bhavsar, P. (2012). Temporal difference based tuning of fuzzy logic controller through reinforcement learning to control an inverted pendulum. I.J. Intelligent Systems and Applications, 9, 15–21.Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  1. 1.Department of Computer Science and Information EngineeringWuFeng UniversityChiayiTaiwan, Republic of China
  2. 2.Department of Computer Science and Information EngineeringCheng Shiu UniversityKaohsiungTaiwan, Republic of China

Personalised recommendations