Fuzzy Reinforcement Learning for Dynamic Power Control in Cognitive Radio Networks

  • Jerzy Martyna
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8467)


Intelligent and flexible spectrum access procedures and resource allocation methods are needed to build cognitive radio (CR) networks. Apart from the major objective to maximise spectra efficiency, the goal of the CR network design is to rationalise the distribution of radio resources and the cost of their usage. This paper proposes a new fuzzy reinforcement learning method that allows for learning the best transmit power control strategy that in turn enables cognitive secondary users to achieve its required transmission rate and quality whilst minimising interference. An example is presented to illustrate the performance and applicability of the proposed method.


Cognitive Radio Power Control Secondary User Cognitive Radio Network Fuzzy Variable 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Alsarhan, A., Agrawal, A.: Spectrum Sharing in Multi-service Cognitive Using Reinforcement Learning. In: First UK India International Workshop on Cognitive Wireless Systems, UKIWCWS (2009)Google Scholar
  2. [2]
    Beon, H.R., Chen, H.S.: A Sensor-based Navigation for a Mobile Robot Using Fuzzy-Logic and Reinforcement Learning. IEEE Trans. on Systems, Man, and Cybernetics 25(3), 467–477 (1995)Google Scholar
  3. [3]
    Berenji, H.R., Vengerov, D.: Advantages of Cooperation Between Reinforcement Learning Agent in Difficult Stochastic Problems. In: Proceedings of the Ninth IEEE International Conference on Fuzzy Systems, San Antonio, TX, pp. 871–876 (2000)Google Scholar
  4. [4]
    Federal Communications Commission, Spectrum Policy Task Force Report, FCC 02 -155 (2002)Google Scholar
  5. [5]
    Foschini, G.J., Miljanic, Z.: A Simple Distributed Autonomous Power Control Algorithm and Its Convergence. IEEE Trans. Veh. Tech. 42(2), 641–646 (1993)CrossRefGoogle Scholar
  6. [6]
    Gao, S., Qian, L., Vaman, D.R.: Distributed Energy Efficient Spectrum Access in Wireless Cognitive Radio Sensor Networks. In: IEEE Wireless Communications and Networking Conf. (WCNC), Las Vegas, NV (2008)Google Scholar
  7. [7]
    Gatsis, N., Marques, A.G., Giannakis, G.B.: Utility-based Power Control for Peer-to-Peer Cognitive Radio Networks with Heterogeneous QoS Constraints. In: IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Las Vegas, NV (2008)Google Scholar
  8. [8]
    Haykin, S.: Cognitive Radio: Brain-empowered Wireless Communications. IEEE Journal on Selected Areas in Communications 23(2), 201–220 (2005)CrossRefGoogle Scholar
  9. [9]
    Hoang, A., Liang, Y.: Downlink Channel Assignment and Power Control for Cognitive Radio Networks. IEEE Trans. on Wireless Communications 7(8), 3106–3117 (2008)CrossRefGoogle Scholar
  10. [10]
    Joó, L., Kóczy, L.T., Tikk, D., Varlaki, P.: On a Stable Interpretation Method. In: Proceedings of the 7th International Fuzzy System Association World Congress, Prague, Czech Republic, pp. 133–137 (1997)Google Scholar
  11. [11]
    Le, H.-S.T., Liang, Q.: An Efficient Power Control Scheme for Cognitive Radios. In: Proc. IEEE Wireless Communications and Networking Conference (WCNC), pp. 2559–2563 (2007)Google Scholar
  12. [12]
    Le, H.-S.T., Ly, H.D.: Opportunistic Spectrum Access Using Fuzzy Logic for Cognitive Radio Networks. In: Proc. Second Int. Conf. on Electronics (ICCE), pp. 240–245 (2008)Google Scholar
  13. [13]
    Matinmikko, M., Rauma, T., Mustonen, M., Harjula, I., Sarvanko, H., Mämmela, A.: Application of Fuzzy Logic to Cognitive Radio Systems. IEICE Trans. on Comm. E92-B(12), 3572–3580 (2009)CrossRefGoogle Scholar
  14. [14]
    Mitola III, J.: Cognitive Radio for Flexible Mobile Multimedia Conference, San Diego, CA, pp. 3–10 (1999)Google Scholar
  15. [15]
    Wang, X., Zhu, Q.: Power Control for Cognitive Radio Base on Game Theory. In: Int. Conf. on Wireless Communications, China (2007)Google Scholar
  16. [16]
    Watkins, C.J.C.H.: Learning from Delayed Rewards, Ph. D. thesis King’s College, Cambridge (1989)Google Scholar
  17. [17]
    Watkins, C.J.C.H., Dayan, P.: Technical Note: Q-learning. Machine Learning 8, 279–292 (1992)zbMATHGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Jerzy Martyna
    • 1
  1. 1.Institute of Computer Science, Faculty of Mathematics and Computer ScienceJagiellonian UniversityCracowPoland

Personalised recommendations