Distributed Optimization of Local Area Networks

  • Sofie Pollin
  • Michael Timmers
  • Liesbet Van der Perre
Part of the Signals and Communication Technology book series (SCT)


An important task of a cognitive radio is to learn and calibrate its behavior in the environment. How to achieve this efficiently is illustrated in this chapter for IEEE 802.11 networks that aim at minimizing the co-channel interference in a distributed way.

A novel control algorithm, Spatial Learning, is proposed, which learns the optimal operating point in a 3D design space at run-time. The learner interprets how the environment reacts to the selected actions and adapts his actions accordingly. Simulation-based experiments illustrate the trade-offs which need to be made, and the gains that can eventually be achieved.


Nash Equilibrium Transmission Power Transmission Rate Spatial Learn Spatial Reuse 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 16.
    J. Mitola, Cognitive Radio: An Integrated Architecture for Software-Defined Radio, PhD thesis, KTH Stockholm, 2000 Google Scholar
  2. 40.
    R. Jain, D.-M. Chiu, W. Hawe, A Quantitative Measure of Fairness and Discrimination for Resource Allocation in Shared Computer Systems, DEC Technical Report 301 (1984) Google Scholar
  3. 46.
    M. Timmers, S. Pollin, A. Dejonghe, A. Bahai, L. Van der Perre, F. Catthoor, Throughput modeling of large-scale 802.11 networks, in Proc. of the Global Telecommunication Conference (Globecom), 2008 Google Scholar
  4. 67.
    T.M. Mitchell, Machine Learning (McGraw-Hill, New York, 1997) zbMATHGoogle Scholar
  5. 92.
    C. Hua, R. Zheng, Starvation modeling and identification in dense 802.11 wireless community networks, in Proc. of the IEEE International Conference on Computer Communications (Infocom), 2008, pp. 1022–1030. doi: 10.1109/INFOCOM.2008.156 Google Scholar
  6. 93.
    M. Krunz, A. Muqattash, S.J. Lee, Transmission power control in wireless ad hoc networks: Challenges, solutions and open issues. IEEE Netw. 18(5), 8–14 (2004) CrossRefGoogle Scholar
  7. 94.
    I. Broustis, J. Eriksson, S.V. Krishnamurthy, M. Faloutsos, Implications of power control in wireless networks: A quantitative study, in Passive and Active Network Measurement. Springer Lecture Notes in Computer Science, vol. 4427 (2007), pp. 83–93 CrossRefGoogle Scholar
  8. 95.
    Y. Zhou, S. Nettles, Balancing the hidden and exposed node problems with power control in CSMA/CA-based wireless networks, in The IEEE Wireless Communications and Networking Conference, vol. 2, 2005, pp. 683–688 CrossRefGoogle Scholar
  9. 96.
    J.A. Fuemmeler, N.H. Vaidya, V.V. Veeravalli, Selecting transmit powers and carrier sense thresholds in CSMA protocols for wireless ad hoc networks, in WICON ’06: Proceedings of the 2nd Annual International Workshop on Wireless Internet (ACM, New York, 2006), p. 15. ISBN 1-59593-510-X. doi: 10.1145/1234161.1234176 CrossRefGoogle Scholar
  10. 97.
    V.P. Mhatre, K. Papagiannaki, F. Baccelli, Interference mitigation through power control in high density 802.11 WLANs, in Proc. of the IEEE International Conference on Computer Communications (Infocom), 2007, pp. 535–543. doi: 10.1109/INFCOM.2007.69 CrossRefGoogle Scholar
  11. 98.
    X. Yang, N. Vaidya, A spatial backoff algorithm using the joint control of carrier sense threshold and transmission rate, in Proc. of the IEEE Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks (SECON), 2007, pp. 501–511 CrossRefGoogle Scholar
  12. 99.
    A. Kamerman, L. Monteban, WaveLAN®-II: A high-performance wireless LAN for the unlicensed band. Bell Labs Tech. J. 2(3), 118–133 (1997) CrossRefGoogle Scholar
  13. 100.
    M. Lacage, M. Manshaei, T. Turletti, IEEE 802.11 rate adaptation: A practical approach, in Proceedings of the 7th ACM International Symposium on Modeling, Analysis and Simulation of Wireless and Mobile Systems, 2004 Google Scholar
  14. 101.
    G. Holland, N. Vaidya, P. Bahl, A rate-adaptive MAC protocol for multi-hop wireless networks, in Proceedings of the 7th Annual International Conference on Mobile Computing and Networking, 2001 Google Scholar
  15. 102.
    B. Sadeghi, V. Kanodia, A. Sabharwal, E. Knightly, Opportunistic media access for multirate ad hoc networks, in Proceedings of ACM MobiCom ’02, 2002 Google Scholar
  16. 103.
    B. Chakravarty, Rate Control Algorithms for IEEE 802.11 Wireless Networks, Master’s thesis, The University of Texas at Arlington, 2007 Google Scholar
  17. 104.
    J. Won, C. Kim, A downlink rate adaptation scheme in IEEE 802.11 WLANs using overhearing, in Intl. Conf. on Information Networking ICOIN ’08, Busan, Korea, 23–25 Jan. 2008, pp. 1–5 Google Scholar
  18. 105.
    J. Choi, J. Na, Y. Lim, K. Park, C. Kim, Collision-aware design of rate adaptation for multi-rate 802.11 WLANs. IEEE J. Sel. Areas Commun. 26(8), 1366–1375 (2008) CrossRefGoogle Scholar
  19. 106.
    S. Khan, S. Mahmud, K. Loo, H. Alraweshidy, A cross layer rate adaptation solution for IEEE 802.11 networks. Comput. Commun. 31(8), 1638–1652 (2008) CrossRefGoogle Scholar
  20. 107.
    S. Lee, K. Chung, Combining the rate adaptation and quality adaptation schemes for wireless video streaming. J. Vis. Commun. Image Represent. 19(8), 508–519 (2008) CrossRefGoogle Scholar
  21. 108.
    H. Jung, K. Cho, Y. Seok, T. Kwon, Y. Choi, RARA: Rate adaptation using rate-adaptive acknowledgment for IEEE 802.11 WLANs, in Proceedings of the Consumer Communications and Networking Conference, 2008 Google Scholar
  22. 109.
    J. Kim, S. Kim, S. Choi, D. Qiao, CARA: Collision-aware rate adaptation for IEEE 802.11 WLANs, in Proc. of the IEEE International Conference on Computer Communications (Infocom), 2006, pp. 1–11 CrossRefGoogle Scholar
  23. 110.
    S. Wang, A. Helmy, BEWARE: Background traffic-aware rate adaptation for IEEE 802.11, in Proceedings of the 9th IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM), Newport Beach, CA, June 2008 Google Scholar
  24. 111.
    Y. Yang, J. Hou, L.-C. Kung, Modeling the effect of transmit power and physical carrier sense in multi-hop wireless networks, in Proc. of the IEEE International Conference on Computer Communications (Infocom), 2007, pp. 2331–2335. doi: 10.1109/INFCOM.2007.275 CrossRefGoogle Scholar
  25. 112.
    Z. Zeng, Y. Yang, J. Hou, How physical carrier sense affects system throughput in IEEE 802.11 wireless networks, in Proc. of the IEEE International Conference on Computer Communications (Infocom), 2008, pp. 1445–1453 Google Scholar
  26. 113.
    F. Rossetto, M. Zorzi, Enhancing spatial reuse in ad hoc networks by carrier sense adaptation, in Proc. of the IEEE Military Communications Conference (MILCOM), 2007, pp. 1–6. doi: 10.1109/MILCOM.2007.4455087 CrossRefGoogle Scholar
  27. 114.
    E.B. Koh, C.-K. Kim, Mitigating starvation in CSMA-based wireless ad hoc networks using carrier sense threshold, in Proc. of the International Conference on Software, Telecommunications and Computer Networks, 2007, pp. 1–6 Google Scholar
  28. 115.
    H. Ma, S. Shin, S. Roy, Optimizing throughput with carrier sensing adaptation for IEEE 802.11 mesh networks based on loss differentiation, in Proc. of the IEEE International Conference on Communications (ICC), 2007 Google Scholar
  29. 116.
    X.-H. Lin, Y.-K. Kwok, V. Lau, Power control for IEEE 802.11 ad hoc networks: Issues and a new algorithm, in Proc. of the International Conference on Parallel Processing, 2003, pp. 249–256 Google Scholar
  30. 117.
    B. Alawieh, Y. Zhang, C. Assi, A distributed power and rate control scheme for mobile ad hoc networks, in Proc. of the International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks, 2008, pp. 335–343. doi: 10.1109/WIOPT.2008.4586087 CrossRefGoogle Scholar
  31. 118.
    T. Kim, H. Lim, J. Hou, Improving spatial reuse through tuning transmit power, carrier sense threshold, and data rate in multihop wireless networks, in Proceedings of the 12th Annual International Conference on Mobile Computing and Networking, 2006 Google Scholar
  32. 119.
    H.P. Young, Strategic Learning and Its Limits (Oxford University Press, Oxford, 2005) Google Scholar
  33. 120.
    Y. Shoham, R. Powers, T. Grenager, Multi-agent reinforcement learning: A critical survey, in AAAI Fall Symposium on Artificial Multi-Agent Learning, 2004 Google Scholar
  34. 121.
    L. Busoniu, R. Babuska, B.D. Schutter, Multi-agent reinforcement learning: A survey, in Proc. of the 9th International Conference on Control, Automation, Robotics and Vision, 2006, pp. 1–6. doi: 10.1109/ICARCV.2006.345353 CrossRefGoogle Scholar
  35. 122.
    L. Busoniu, R. Babuska, B.D. Schutter, A comprehensive survey of multiagent reinforcement learning. IEEE Trans. Syst. Man Cybern., Part C, Appl. Rev. 38(2), 156–172 (2008) CrossRefGoogle Scholar
  36. 123.
    S. Mannor, J. Shamma, Multi-agent learning for engineers. Artif. Intell. 171(7), 417–422 (2007) MathSciNetzbMATHCrossRefGoogle Scholar
  37. 124.
    S.O. Kimbrough, M. Lu, Simple reinforcement learning agents: Pareto beats Nash in an algorithmic game theory study. ISeB 3(1), 1–19 (2005) CrossRefGoogle Scholar
  38. 125.
    S. Hart, Adaptive heuristics. Econometrica 73(5), 1401–1430 (2005) MathSciNetzbMATHCrossRefGoogle Scholar
  39. 126.
    Y. Park, Y. Seok, N. Choi, Y. Choi, J. Bonnin, Rate-adaptive multimedia multicasting over IEEE 802.11 wireless LANs, in Proc. of the Consumer Communications and Networking Conference, vol. 1, 2005, pp. 178–182 Google Scholar
  40. 127.
    M. Timmers, S. Pollin, A. Dejonghe, L. Van der Perre, F. Catthoor, Exploring versus exploiting: Enhanced distributed cognitive coexistence between IEEE 802.11 and IEEE 802.15.4, in Proc. of the IEEE Conference on Sensors, 2008 Google Scholar
  41. 128.
    G. Bianchi, Performance analysis of the IEEE 802.11 distributed coordination function. IEEE J. Sel. Areas Commun. 18(3), 535–547 (2000) CrossRefGoogle Scholar
  42. 129.
    K. Fall, K. Varadhan, VINT project, The ns Manual, UC Berkeley, LBL, UCS/ISI, and Xerox PARC,

Copyright information

© Springer Science+Business Media B.V. 2011

Authors and Affiliations

  • Sofie Pollin
    • 1
  • Michael Timmers
    • 2
  • Liesbet Van der Perre
    • 3
  1. 1.SSET/wirelessIMECLeuvenBelgium
  2. 2.Bell LabsAlcatel-LucentAntwerpenBelgium
  3. 3.IMEC VZWLeuvenBelgium

Personalised recommendations