Opportunistic channel access with repetition time diversity and switching cost: a block multi-armed bandit approach
In this paper, we investigate the channel access problem considering switching cost in the block fading channels with unknown information of channel occupation and quality. We formulate this problem as a multi-armed bandit (MAB) problem with the goal of minimizing the outage rate and avoiding frequent channel switching. To achieve this goal, a block based multi-armed bandit (BMAB) learning algorithm is proposed. Furthermore, the BMAB algorithm is extended to cope with the short-term deep channel fading, by exploiting the repetition time diversity (RTD). The regrets of the proposed two algorithms are proved to be logarithmic in time. Performance analysis and simulation results show that the proposed algorithms outperform standard SMAB algorithm in average system outage rate, switching cost and throughput. In addition, the repetition time diversity multi-armed bandit (RTDMAB) algorithm is better than BMAB algorithm in the presence of deep channel fading at the cost of receiving complexity .
KeywordsOpportunistic channel access Cognitive radio Multi-armed bandit Switching cost Repetition time diversity
This work is supported in part by the National Natural Science Foundation of China under Grant Nos. 61401508 and 61601490.
- 11.Gao, S., Qian, L., Vaman, D. R., & Han, Z. (2010). Distributed cognitive sensing for time varying channels: Exploration and exploitation. In Proceeding on IEEE wireless communications and networking conference.Google Scholar
- 17.Li, Y., et al. (2011). A distributed cooperative MAC for cognitive radio ad-hoc networks. In IEEE symposium on computers and communications (ISCC).Google Scholar
- 18.Li, Y., et al. (2015). Cooperative spectrum sharing with energy-save in cognitive radio networks. In IEEE global communications conference (GLOBECOM).Google Scholar
- 19.Li, B., Yang, P., Wang, J., et al. (2012). Optimal action point for dynamic spectrum utilization under Rayleigh fading. Ad Hoc & Sensor Wireless Networks, 17(1–2), 1–32.Google Scholar
- 23.Huang, J., Gan, X., & Feng, X. (2013). Multi-armed bandit based opportunistic channel access: A consideration of switch cost. In Proceeding on IEEE ICC.Google Scholar
- 25.Chen, L., Iellamo, S., & Coupechoux, M. (2011). Opportunistic spectrum access with channel switching cost for cognitive radio networks, In Proceeding on IEEE ICC.Google Scholar
- 27.Qin, Z., et al. (2015). Multiple armed bandits based opportunistic channel access with switching cost in block fading channel. In 2015 international conference IEEE wireless communications & signal processing (WCSP).Google Scholar
- 28.Chen, D., Yin, S., Zhang, Q., Liu, M., & Li, S. (2009). Mining spectrum usage data: A large-scale spectrum measurement study. In ACM MOBICOM (p. 13C24).Google Scholar