Abstract
Emerging paradigms such as smart cities and Internet of Things are expected to be an intrinsic part of next generation communication standards. To bring these paradigms to life, self-sustainable wireless sensor network (WSN) nodes capable of seamless and maintenance free operation at remote locations are desired. Recently, radio frequency energy harvesting (RFEH) circuits capable of harvesting RF power transmitted by base stations, TV towers and other ambient RF sources have been developed. Low power requirements and architectural compatibility between WSN nodes and RFEH circuits make RFEH a promising and feasible solution for WSN nodes. In this paper, a novel multi-stage decision-making policy (DMP) for RFEH enabled WSN nodes has been proposed. It offers an intelligence, via online learning algorithm, for characterization and selection of frequency bands based on their RF potential especially in the dynamic spectrum environment. Furthermore, proposed DMP supports multi-antenna multi-band harvesting capabilities of the RFEH circuits. The final contribution includes tunable RFEH duration that leads to significant improvement in the harvested energy and fewer number of frequency band switchings (FBS). Derived theoretical performance bounds and simulation results validate the superiority of proposed DMP in terms of the harvested RF energy and throughput of the WSN nodes. Furthermore, the fewer number of FBS makes the proposed DMP suitable for resource-constrained WSN nodes.
This is a preview of subscription content, access via your institution.





Notes
Indicator function:\(\mathbf {1}_{\{logical~expression\}}\)=1 if logical expression=true; else 0.
References
Akyildiz, I. F., Su, W., Sankarasubramaniam, Y., & Cayirco, E. (2002). A survey on sensor networks. IEEE Communications Magazine, 40(8), 102–114.
Rashid, B., & Rehmani, M. H. (2016). Applications of wireless sensor networks for urban areas: A survey. Journal of Network and Computer Applications, 60(1), 192–219.
Kamalinejad, P., Mahapatra, C., Sheng, Z., Mirabbasi, S., Leung, V. C. M., & Guan, Y. L. (2015). Wireless energy harvesting for the internet of things. IEEE Communications Magazine, 53(6), 102–108.
He, Y., Cheng, X., Peng, W., & Stuber, G. (2015). A survey of energy harvesting communications: Models and offline optimal policies. IEEE Communications Magazine, 53(6), 79–85.
Akhtar, F., & Rehmani, M. H. (2015). Energy replenishment using renewable and traditional energy resources for sustainable wireless sensor networks: A review. Renewable and Sustainable Energy Reviews, 45(1), 769–784.
Ulukus, S., Yener, A., Erkip, E., Simeone, O., Zorzi, M., Grover, P., et al. (2015). Energy harvesting wireless communications: A review of recent advances. IEEE Journal on Selected Areas in Communications, 33(3), 360–381.
Drayson Technologies. (2015) RF energy harvesting for the low energy internet of things. White paper.
Lu, X., Wang, P., Niyato, D., Kim, D. I., & Han, Z. (2015). Wireless networks with RF energy harvesting: A contemporary survey. IEEE Communications Surveys & Tutorials, 17(2), 757–789.
Costantine, J., Tawk, Y., Barbin, S., & Christodoulou, C. G. (2015). Reconfigurable antennas: Design and applications. IEEE Proceedings, 103(2), 424–437.
Li, P. K., Shao, Z. H., Wang, Q., & Cheng, Y. J. (2015). Frequency and pattern reconfigurable antenna for multistandard wireless applications. IEEE Antennas and Wireless Propagation Letters, 14(1), 333–336.
Pinuela, M., Mitcheson, P. D., & Lucyszyn, S. (2013). Ambient RF energy harvesting in urban and semi-urban environments. IEEE Transactions on Microwave Theory and Techniques, 61(7), 2715–2726.
Soyata, T., Copeland, L., & Heinzelman, W. (2016). RF energy harvesting for embedded systems: A survey of tradeoffs and methodology. IEEE Circuits and Systems Magazine, 16(1), 22–57.
Mohjazi, L., Dianati, M., Karagiannidis, G. K., Muhaidat, S., & Al-Qutayri, M. (2015). RF-powered cognitive radio networks: Technical challenges and limitations. IEEE Communications Magazine, 53(4), 94–100.
Mishra, D., De, S., Jana, S., Basagni, S., Chowdhury, K., & Heinzelman, W. (2015). Smart RF energy harvesting communications: Challenges and opportunities. IEEE Communications Magazine, 53(4), 70–78.
Talla, V., Kellogg, B., Ransford, B., Naderiparizi, S., Smith, J. R., & Gollakota, S. (2017). Powering the next billion devices with Wi-Fi. Communications of the ACM, 60(3), 83–91.
Valenta, C. R., & Durgin, G. D. (2014). Harvesting wireless power: Survey of energy-harvester conversion efficiency in far-field, wireless power transfer systems. IEEE Microwave Magazine, 15(4), 108–120.
Darak, S. J., Moy, C., & Palicot, J. (2016). Smart decision making policy for faster harvesting from ambient RF sources in wireless sensor nodes. In \(13th\) International Symposium on Wireless Communication Systems (ISWCS) (pp. 148–152). Poznan, Poland.
Baknina, A., & Ulukus, S. (2016). Online scheduling for energy harvesting broadcast channels with finite battery. In IEEE International Symposium on Information Theory (pp. 1984–1988), Barcelona, Spain.
Shaviv, D., OZGUR, A., & Permuter, H. H. (2016). Capacity of remotely powered communication. In IEEE International Symposium on Information Theory (pp. 1979–1983). Barcelona, Spain.
Hoang, D. T., Niyato, D., Wing, P., & Kim, D. I. (2014). Opportunistic channel access and RF energy harvesting in cognitive radio networks. IEEE Journal on Selected Areas in Communications, 32(11), 2039–2052.
Niyato, D., Wing, P., & Kim, D. I. (2015). Performance optimization for cooperative multiuser cognitive radio networks with RF energy harvesting capability. IEEE Transactions on Wireless Communication, 14(7), 3614–3629.
Darak, S. J., Zhang, H., Palicot, J., & Moy, C. (2015). An efficient policy for D2D communications and energy harvesting in cognitive radios: Go Bayesian!. In \(23th\) European Signal Processing Conference (EUSIPCO) (pp. 1236–1240). Nice, France.
Darak, S. J., Zhang, H., Palicot, J., & Moy, C. (2017). Decision making policy for RF energy harvesting enabled cognitive radios in decentralized wireless networks. Digital Signal Processing, 60, 33–45.
Auer, P., Cesa-Bianchi, N., & Fischer, P. (2002). Finite-time analysis of the multiarmed bandit problem. Machine Learning, 47(2), 235–256.
Garivier, A. & Cappé, O. (2011). The KL-UCB algorithm for bounded stochastic bandits and beyond. In Conference On Learning Theory (COLT) (pp. 359–376). Budapest, Hungary.
Komiyama, J., Honda, J., & Nakagawa, H. (2015). Optimal regret analysis of Thompson sampling in stochastic multi-armed bandit problem with multiple plays. In \(32nd\) International Conference on Machine Learning (ICML) (pp. 1152–1161). Lille, France.
Kaufmann, E., Cappé, O. & Garivier, A. (Apr. 2012). On Bayesian upper confidence bounds for bandit problems. In \(15th\) International Conference on Artificial Intelligence and Statistics (pp. 592–600). Canary Islands.
Anandkumar, A., Michael, N., Tang, A., & Swami, A. (2011). Distributed algorithms for learning and cognitive medium access with logarithmic regret. IEEE Journal on Selected Areas in Communications, 29(4), 731–745.
Darak, S. J., Dhabu, S., Moy, C., Zhang, H., Palicot, J., & Vinod, A. P. (2015). Decentralized spectrum learning and access for heterogeneous cognitive radio networks. Elsevier Digital Signal Processing, 37, 13–23.
Modi, N., Moy, C., Mary, P., & Darak, S. J. (2017). Proof-of-concept: Spectrum and energy efficient multi-user CR network via vacancy and quality based channel selection. accepted in 32nd General Assembly and Scientific Symposium of the URSI (URSI-GASS) Canada.
Bukhari, S., Rehmani, M. H., & Siraj, S. (2016). A survey of channel bonding for wireless networks and guidelines of channel bonding for futuristic cognitive radio sensor networks. IEEE Communications Surveys & Tutorials, 18(2), 924–948.
Chang, Z., Gong, J., Li, Y., Zhou, Z., Ristaniemi, T., Shi, G., et al. (2016). Energy efficient resource allocation for wireless power transfer enabled collaborative mobile clouds. IEEE Journal on Selected Areas in Communications, 34(12), 3438–3450.
Hanawal, M., Nguyen, D., & Krunz, M. (2015). Jamming attack on in-band full-duplex communications: Detection and countermeasures. In \(35th\) IEEE Annual International Conference on Computer Communications (pp. 1–9). San Francisco.
Nikfar, B., Maghsudi, S. & Vinck, A.J. (2015) Multi-armed bandit channel selection for power line communication. In IEEE International Conference on Smart Grid Communications (pp. 19–24). Florida.
Tang, W., Bi, S., & Zhang, Y. J. (2016). Online charging scheduling algorithms of electric vehicles in smart grid: An overview. IEEE Communications Magazine, 54(12), 76–83.
Acknowledgements
This work is supported by the DST Inspire Faculty Fellowship granted by the Department of Science and Technology, Govt. of India.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Darak, S.J., Moy, C. & Palicot, J. Distributed decision making policy for frequency band selection boosting RF energy harvesting rate in wireless sensor nodes. Wireless Netw 24, 3189–3203 (2018). https://doi.org/10.1007/s11276-017-1529-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11276-017-1529-7