Skip to main content

Exploiting Spatio-Temporal Correlation in RF Data Using Deep Learning

  • 806 Accesses

Part of the Advances in Intelligent Systems and Computing book series (AISC,volume 1232)

Abstract

The pervasive presence of wireless services and applications have become an integral part of our lives. We depend on wireless technologies not only for our smartphones but also for other applications like surveillance, navigation, jamming, anti-jamming, radar to name a few areas of applications. These recent advances of wireless technologies in radio frequency (RF) environments have warranted more autonomous deployments of wireless systems. With such large scale dependence on use of the RF spectrum, it becomes imperative to understand the ambient signal characteristics for optimal deployment of wireless infrastructure and efficient resource provisioning. In order to make the best use of such radio resources in both the spatial and time domains, past and current knowledge of the RF signals are important. Although sensing mechanisms can be leveraged to assess the current environment, learning techniques are the typically used for analyzing past observations and to predict the future occurrences of events in a given RF environment. Machine learning (ML) techniques, having already proven useful in various domains, are also being sought for characterizing and understanding the RF environment. Some of the goals of the learning techniques in the RF domain are transmitter or emitter fingerprinting, emitter localization, modulation recognition, feature learning, attention and saliency, autonomous RF sensor configuration and waveform synthesis. Moreover, in large-scale autonomous deployments of wireless communication networks, the signals received from one component play a crucial role in the decision-making process of other components. In order to efficiently implement such systems, each component of the network should be uniquely identifiable. ML techniques, that include recurrent structures, have shown promise in creating such autonomous deployments using the idea of radio frequency machine learning (RFML). Deep learning (DL) techniques with the ability to automatically learn features, can be used for characterization and recognition of different RF properties by automatically exploiting the inherent features in the signal data. In this chapter, we present an application of such deep learning techniques to the task of RF transmitter fingerprinting. The first section concentrates on the application areas in the field of RF where deep learning can be leveraged for futuristic autonomous deployments. Section 2 presents discussion of different deep learning approaches for the task of transmitter fingerprinting as well as the significance of leveraging recurrent structures through the use of recurrent neural network (RNN) models. Once we have established the basic knowledge and motivation, we dive deep into the application of deep learning for transmitter fingerprinting. Hence, a transmitter fingerprinting technique for radio device identification using recurrent structures, by exploiting the spatio-temporal properties of the received radio signal, is discussed in Sects. 3 and 4. We present three types of recurrent neural networks (RNNs) using different types of cell models: (i) long short-term memory (LSTM), (ii) gated recurrent unit (GRU), and (iii) convolutional long short-term memory (ConvLSTM) for that task. The proposed models are also validated with real data and evaluated using a framework implemented using Python. Section 5 describes the testbed setup and experimental design. The experimental results, computational complexity analysis, and comparison with state of the art are discussed in Sect. 6. The last section summarizes the chapter.

Keywords

  • RF fingerprinting
  • Recurrent neural network
  • Supervised learning
  • Software-defined radios

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-981-15-6759-9_7
  • Chapter length: 30 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   149.00
Price excludes VAT (USA)
  • ISBN: 978-981-15-6759-9
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   199.99
Price excludes VAT (USA)
Hardcover Book
USD   199.99
Price excludes VAT (USA)
Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

References

  1. M. Abadi et al., Tensorflow: large-scale machine learning on heterogeneous distributed systems. CoRR (2016)

    Google Scholar 

  2. S. Bai, M. Yan, Y. Luo, Q. Wan, RFedRNN: an end-to-end recurrent neural network for radio frequency path fingerprinting, in Recent Trends and Future Technology in Applied Intelligence (2018), pp. 560–571

    Google Scholar 

  3. C.M. Bishop, Pattern Recognition and Machine Learning (Information Science and Statistics) (Springer, 2006)

    Google Scholar 

  4. F. Chollet, et al., Keras: the python deep learning library (2015). https://keras.io

  5. J. Chung, C. Gülçehre, K. Cho, Y. Bengio, Empirical evaluation of gated recurrent neural networks on sequence modeling. CoRR (2014). arXiv:abs/1412.3555

  6. B. Danev, S. Capkun, Transient-based identification of wireless sensor nodes, in International Conference on Information Processing in Sensor Networks (2009), pp. 25–36

    Google Scholar 

  7. A. Devices, ADALM-PLUTO overview (2020). https://wiki.analog.com/university/tools/pluto

  8. R. Dey, F.M. Salemt, Gate-variants of gated recurrent unit (GRU) neural networks, in 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS) (2017), pp. 1597–1600

    Google Scholar 

  9. Ettus Research: USRP B200 (2020). https://www.ettus.com/all-products/ub200-kit/

  10. Ettus Research: USRP B210 (2020). https://www.ettus.com/product/details/UB210-KIT/

  11. Ettus Research: USRP X310 (2020). https://www.ettus.com/all-products/x310-kit/

  12. GNURadio: GNU Radio (2020). https://www.gnuradio.org

  13. I. Goodfellow, Y. Bengio, A. Courville, Deep Learning. MIT press (2016)

    Google Scholar 

  14. A. Gritsenko, Z. Wang, T. Jian, J. Dy, K. Chowdhury, S. Ioannidis, Finding a ‘New’ needle in the haystack: unseen radio detection in large populations using deep learning, in IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN) (2019), pp. 1–10

    Google Scholar 

  15. K. He, J. Sun, Convolutional neural networks at constrained time cost, in IEEE CVPR (2015)

    Google Scholar 

  16. S. Hochreiter, J. Schmidhuber, Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)

    Google Scholar 

  17. S. Ioffe, C. Szegedy, Batch normalization: accelerating deep network training by reducing internal covariate shift. CoRR (2015). arXiv:abs/1502.03167

  18. I.O. Kennedy, P. Scanlon, F.J. Mullany, M.M. Buddhikot, K.E. Nolan, T.W. Rondeau, Radio transmitter fingerprinting: a steady state frequency domain approach, in IEEE Vehicular Technology Conference (2008), pp. 1–5

    Google Scholar 

  19. B.P. Lathi, Modern Digital and Analog Communication Systems, 3rd edn. (Oxford University Press Inc, USA, 1998)

    Google Scholar 

  20. Y. LeCun, Y. Bengio, G. Hinton, Deep learning. Nature 521(7553), 436–444 (2015)

    CrossRef  Google Scholar 

  21. H.W. Lin, M. Tegmark, D. Rolnick, Why does deep and cheap learning work so well? J. Stat. Phys. 168(6), 1223–1247 (2017)

    CrossRef  MathSciNet  Google Scholar 

  22. R. Livni, S. Shalev-Shwartz, O. Shamir, On the computational efficiency of training neural networks, in Advances in Neural Information Processing Systems (2014), pp. 855–863

    Google Scholar 

  23. V. Nair, G.E. Hinton, Rectified linear units improve restricted boltzmann machines, in Proceedings of International Conference on International Conference on Machine Learning (2010), pp. 807–814

    Google Scholar 

  24. NooElec: USRP B210 (2018). http://www.nooelec.com/store/sdr/sdr-receivers/nesdr-mini-rtl2832-r820t.html

  25. Nuad: bladeRF 2.0 micro xA4 (2020). https://www.nuand.com/product/bladeRF-xA4/

  26. T.J. O’Shea, S. Hitefield, J. Corgan, End-to-end Radio traffic sequence recognition with recurrent neural networks, in IEEE Global Conference on Signal and Information Processing (GlobalSIP) (2016), pp. 277–281

    Google Scholar 

  27. T. O’Shea, N. West, Radio machine learning dataset generation with GNU radio. Proc. GNU Radio Conf. 1(1) (2016)

    Google Scholar 

  28. T.J. O’Shea, T.C. Clancy, R.W. McGwier, Recurrent neural radio anomaly detection. CoRR (2016). arXiv:abs/1611.00301

  29. T.J. O’Shea, J. Corgan, T.C. Clancy, Convolutional radio modulation recognition networks, in Engineering Applications of Neural Networks (2016), pp. 213–226

    Google Scholar 

  30. T. O’Shea, J. Hoydis, An introduction to deep learning for the physical layer. IEEE Trans. Cogn. Commun. Netw. 3(4), 563–575 (2017)

    Google Scholar 

  31. T.L. O’Shea, T. Roy, T.C. Clancy, Over-the-air deep learning based radio signal classification. IEEE J. Sel. Top. Signal Process. 12(1), 168–179 (2018)

    Google Scholar 

  32. radioML: RFML 2016 (2016). https://github.com/radioML/dataset

  33. S. Rajendran et al., Deep learning models for wireless signal classification with distributed low-cost spectrum sensors. IEEE Trans. Cogn. Commun. Netw. 4(3), 433–445 (2018)

    CrossRef  Google Scholar 

  34. J.S. Ren, Y. Hu, Y.W. Tai, C. Wang, L. Xu, W. Sun, Q. Yan, Look, listen and learn-a multimodal LSTM for speaker identification, in AAAI (2016), pp. 3581–3587

    Google Scholar 

  35. D. Roy, T. Mukherjee, M. Chatterjee, Machine learning in adversarial RF environments. IEEE Commun. Mag. 57(5), 82–87 (2019)

    CrossRef  Google Scholar 

  36. D. Roy, T. Mukherjee, M. Chatterjee, E. Blasch, E. Pasiliao, RFAL: adversarial learning for RF transmitter identification and classification. IEEE Trans. Cogn. Commun. Netw. (2019)

    Google Scholar 

  37. D. Roy, T. Mukherjee, M. Chatterjee, E. Pasiliao, Defense against PUE attacks in DSA networks using GAN based learning, in IEEE Global Communications Conference (2019)

    Google Scholar 

  38. D. Roy, T. Mukherjee, M. Chatterjee, E. Pasiliao, Primary user activity prediction in DSA networks using recurrent structures, in IEEE International Symposium on Dynamic Spectrum Access Networks (2019), pp. 1–10

    Google Scholar 

  39. D. Roy, T. Mukherjee, M. Chatterjee, E. Pasiliao, RF transmitter fingerprinting exploiting spatio-temporal properties in raw signal data, in IEEE International Conference on Machine Learning and Applications (2019), pp. 89–96

    Google Scholar 

  40. D. Roy, T. Mukherjee, M. Chatterjee, E. Pasiliao, Detection of rogue RF transmitters using generative adversarial nets, in IEEE Wireless Communications and Networking Conference (WCNC) (2019)

    Google Scholar 

  41. H. Rutagemwa, A. Ghasemi, S. Liu, Dynamic spectrum assignment for land mobile radio with deep recurrent neural networks, in IEEE International Conference on Communications Workshops (ICC Workshops) (2018), pp. 1–6

    Google Scholar 

  42. Y.B. Saied, A. Olivereau, D-HIP: a distributed key exchange scheme for HIP-based internet of things, in World of Wireless, Mobile and Multimedia Networks (WoWMoM) (2012), pp. 1–7

    Google Scholar 

  43. Sak, H., Senior, A.W., Beaufays, F.: Long short-term memory based recurrent neural network architectures for large vocabulary speech recognition. CoRR (2014). arXiv:abs/1402.1128

  44. K. Sankhe, M. Belgiovine, F. Zhou, L. Angioloni, F. Restuccia, S. D’Oro, T. Melodia, S. Ioannidis, K. Chowdhury, No radio left behind: radio fingerprinting through deep learning of physical-layer hardware impairments. IEEE Trans. Cogn. Commun. Netw. 1 (2019)

    Google Scholar 

  45. D. Shaw, W. Kinsner, Multifractal modelling of radio transmitter transients for classification, in IEEE WESCANEX (1997), pp. 306–312

    Google Scholar 

  46. X. Shi, Z. Chen, H. Wang, D.Y. Yeung, W.K. Wong, W.C. Woo, Convolutional LSTM network: a machine learning approach for precipitation nowcasting, in Proceedings of the 28th International Conference on Neural Information Processing Systems, vol. 1 (2015), pp. 802–810

    Google Scholar 

  47. Y. Shi, K. Davaslioglu, Y.E. Sagduyu, W.C. Headley, M. Fowler, G. Green, Deep learning for RF signal classification in unknown and dynamic spectrum environments, in IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN) (2019), pp. 1–10

    Google Scholar 

  48. S.W. Smith, The Scientist and Engineer’s Guide to Digital Signal Processing (California Technical Publishing, San Diego, CA, USA, 1997)

    Google Scholar 

  49. S. Soltani, Y.E. Sagduyu, R. Hasan, K. Davaslioglu, H. Deng, T. Erpek, Real-time experimentation of deep learning-based RF signal classifier on FPGA, in IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN) (2019), pp. 1–2

    Google Scholar 

  50. M. Stanislav, T. Beardsley, Hacking IoT: a case study on baby monitor exposures and vulnerabilities. Rapid 7 (2015)

    Google Scholar 

  51. J. Toonstra, W. Kinsner, A radio transmitter fingerprinting system ODO-1, in Canadian Conference on Electrical and Computer Engineering, vol. 1 (1996), pp. 60–63

    Google Scholar 

  52. D. Tse, P. Viswanath, Fundamentals of Wireless Communication (Oxford University Press Inc, USA, 2005)

    Google Scholar 

  53. E. Tsironi, P. Barros, C. Weber, S. Wermter, An analysis of convolutional long short-term memory recurrent neural networks for gesture recognition. Neurocomputing 268, 76–86 (2017)

    CrossRef  Google Scholar 

  54. N. Wagle, E. Frew, Spatio-temporal characterization of airborne radio frequency environments, in IEEE GLOBECOM Workshops (GC Wkshps) (2011), pp. 1269–1273

    Google Scholar 

  55. M.A. Wani, F.A. Bhat, S. Afzal, A.I. Khan, Advances in Deep Learning (Springer, 2020)

    Google Scholar 

  56. R.H. Weber, R. Weber, Internet of Things, vol. 12 (Springer, 2010)

    Google Scholar 

  57. S. Xu, L. Xu, Z. Xu, B. Huang, Individual radio transmitter identification based on spurious modulation characteristics of signal envelop, in IEEE MILCOM (2008), pp. 1–5

    Google Scholar 

  58. K. Youssef, L. Bouchard, K. Haigh, J. Silovsky, B. Thapa, C.V. Valk, Machine learning approach to RF transmitter identification. IEEE J. Radio Freq. Identif. 2(4), 197–205 (2018)

    CrossRef  Google Scholar 

  59. M.D. Zeiler, ADADELTA: an adaptive learning rate method. CoRR (2012). arXiv:abs/1212.5701

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Debashri Roy .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Verify currency and authenticity via CrossMark

Cite this chapter

Roy, D., Mukherjee, T., Pasiliao, E. (2021). Exploiting Spatio-Temporal Correlation in RF Data Using Deep Learning. In: Wani, M.A., Khoshgoftaar, T.M., Palade, V. (eds) Deep Learning Applications, Volume 2. Advances in Intelligent Systems and Computing, vol 1232. Springer, Singapore. https://doi.org/10.1007/978-981-15-6759-9_7

Download citation