Skip to main content

Channel Usage Patterns and Their Impact on the Effectiveness of Machine Learning for Dynamic Channel Selection

  • Chapter
  • First Online:
  • 940 Accesses

Part of the book series: Signals and Communication Technology ((SCT))

Abstract

The diverse behavior of different primary users (PU) in various spectrum bands impacts a cognitive radio’s ability to exploit spectrum holes. This chapter summarizes the results of our previous studies on the impact of the complexity of primary users’ behavior on the performance of learning algorithms applied to dynamic channel selection. In particular, we characterize the observable spectrum utilization with respect to the duty cycle of the channels and to the complexity of the primary user’s activity. We use the term complexity to refer to the unpredictability associated with the primary user’s wireless resource usage, which we quantitatively characterize using Lempel-Ziv complexity. We evaluate the effectiveness of two learning-based dynamic channel selection algorithms by testing them with real spectrum occupancy data collected in the GSM, ISM, and DECT bands. Our results show that learning performance is highly correlated with the level of PU activity, estimated by the duty cycle, and the amount of structure in the use of spectrum, estimated by the Lempel-Ziv complexity.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Macaluso, I., Forde, T., DaSilva, L., Doyle, L.: Recognition and informed exploitation of grey spectrum opportunities. IEEE Veh. Tech. Mag. 7(2), 85–90 (2012)

    Article  Google Scholar 

  2. Macaluso, I., Finn, D., Ozgul, B., DaSilva, L.: Complexity of spectrum activity and benefits of reinforcement learning for dynamic channel selection. IEEE J. Sel. Areas Commun. (Cogn. Radio Ser.) 31(11), 2237–2248 (2013)

    Google Scholar 

  3. Ahmadi, H., Macaluso, I., DaSilva, L.: The effect of the spectrum opportunities diversity on opportunistic access. In: IEEE ICC’13 (2013)

    Google Scholar 

  4. Lempel, A., Ziv, J.: On the complexity of finite sequences. IEEE Trans. Inform. Theory 22(1), 75–81 (1976)

    Article  MATH  MathSciNet  Google Scholar 

  5. Clancy, T., Walker, B.: Predictive dynamic spectrum access. In: SDR Forum’s Technical Conference (2006)

    Google Scholar 

  6. Akbar, I., Tranter, W.: Dynamic spectrum allocation in cognitive radio using Hidden Markov Models: Poisson distributed case. In: IEEE SoutheastCon’.07 (2007)

    Google Scholar 

  7. Candy, J.: Bayesian Signal Processing: Classical, Modern, and Particle Filtering Methods. Wiley-Interscience, New York (2009)

    Google Scholar 

  8. Tumuluru, V., Wang, P., Niyato, D.: A neural network based spectrum prediction scheme for cognitive radio. In: IEEE ICC’10 (2010)

    Google Scholar 

  9. Tumuluru, V., Wang, P., Niyato, D.: Channel status prediction for cognitive radio networks. Wireless Commun. Mobile Comput. (2010)

    Google Scholar 

  10. Berthold, U., Fu, F., Van der Schaar, M., Jondral, F.: Detection of spectral resources in cognitive radios using reinforcement learning. In: New Frontiers in Dynamic Spectrum Access Networks, 2008. DySPAN 2008. 3rd IEEE Symposium on (2008)

    Google Scholar 

  11. Ahmadi, H., Chew, Y.H., Tang, P.K., Nijsure, Y.A.: Predictive opportunistic spectrum access using learning based hidden markov models. In: IEEE PIMRC’11 (2011)

    Google Scholar 

  12. Song, C., Zhang, Q.: Intelligent dynamic spectrum access assisted by channel usage prediction. In: IEEE INFOCOM’10 (2010)

    Google Scholar 

  13. Kone, V., Yang, L., Yang, X., Zhao, B., Zheng, H.: On the feasibility of effective opportunistic spectrum access. In: Proceedings of the 10th Annual Conference on Internet Measurement. ACM (2010)

    Google Scholar 

  14. Lindgren, K., Nordahl, M.: Complexity measures and cellular automata. Complex Syst. 2(4), 409–440 (1988)

    MATH  MathSciNet  Google Scholar 

  15. Grassberger, P.: Toward a quantitative theory of self-generated complexity. Int. J. Theor. Phys. 25(9), 907–938 (1986)

    Article  MATH  MathSciNet  Google Scholar 

  16. Kaspar, F., Schuster, H.: Easily calculable measure for the complexity of spatiotemporal patterns. Phys. Rev. A 36(2), 842–848 (1987)

    Article  MathSciNet  Google Scholar 

  17. Ziv, J.: Coding theorems for individual sequences. IEEE Trans. Inform. Theory 24(4), 405–412 (1978)

    Article  MATH  MathSciNet  Google Scholar 

  18. Kolmogorov, A.: Three approaches to the definition of the concept quantity of information. Problemy Peredachi Informatsii 1(1), 3–11 (1965)

    MATH  MathSciNet  Google Scholar 

  19. Brudno, A.: Entropy and the complexity of the trajectories of a dynamical system. Trans. Moscow Math. Soc. 44(2), 127–151 (1983)

    Google Scholar 

  20. Boffetta, G., Cencini, M., Falcioni, M., Vulpiani, A.: Predictability: a way to characterize complexity. Phys. Rep. 356(6), 367–474 (2002)

    Article  MATH  MathSciNet  Google Scholar 

  21. Watkins, C., Dayan, P.: Q-learning. Mach. Learn. 8(3), 279–292 (1992)

    MATH  Google Scholar 

Download references

Acknowledgments

This material is based upon works supported by the Science Foundation Ireland under Grants No. 10/CE/I1853 and 10/IN.1/I3007.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Irene Macaluso .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Macaluso, I., Ahmadi, H., DaSilva, L.A., Doyle, L. (2014). Channel Usage Patterns and Their Impact on the Effectiveness of Machine Learning for Dynamic Channel Selection. In: Di Benedetto, MG., Bader, F. (eds) Cognitive Communication and Cooperative HetNet Coexistence. Signals and Communication Technology. Springer, Cham. https://doi.org/10.1007/978-3-319-01402-9_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-01402-9_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-01401-2

  • Online ISBN: 978-3-319-01402-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics