Skip to main content
SpringerLink
Log in

Automatic Modulation Classification Based on Multimodal Coordinated Integration Architecture and Feature Fusion

  • Conference paper
  • First Online:
Mobile Multimedia Communications (MobiMedia 2021)

Included in the following conference series:

  • 1100 Accesses

Abstract

With the rapid advancement of the 5G wireless communication technology, automatic modulation classification (AMC) is not only faced with more complex communication environment, but also needs to deal with more modulation styles, which increases the difficulty of modulation recognition invisibly. However, most deep learning (DL)-based AMC approaches currently merely use time domain or frequency domain monomodal information and ignore the complementarities between multimodal information. To address the issue, we exploit a signal statistical graph domain-I/Q waveform domain multimodal fusion (SIMF) method to achieve AMC based on AlexNet, complex-valued networks and multimodal technology. The extracted multimodal features from signal statistical graph domain and I/Q waveform domain are fused to obtain a richer joint feature representation and T-SNE algorithm is used to visualize the extracted feature. Moreover, coordinated integration architecture was adopted to achieve mutual collaboration and constraints between multiple modalities to maintaining the unique characteristics and exclusivity of each modal. Simulation results demonstrate the superior performance of our proposed SIMF method compared with unimodal model and feature fusion model.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. You, X., Zhang, C., Tan, X., et al.: AI for 5G: research directions and paradigms. Sci. China Inf. Sci. 62(2), 1–13 (2019)

    Article  Google Scholar 

  2. You, X., Wang, C.X., Huang, J., et al.: Towards 6G wireless communication networks: Vision, enabling technologies, and new paradigm shifts. Sci. China Inf. Sci. 64(1), 1–74 (2021)

    Article  Google Scholar 

  3. Zhang, P., Kai, N.I.U., Hui, T., et al.: Technology prospect of 6G mobile communications. J. Commun. 40(1), 141 (2019)

    Google Scholar 

  4. Wang, Y., Wang, J., Zhang, W., et al.: Deep learning-based cooperative automatic modulation classification method for MIMO systems. IEEE Trans. Veh. Technol. 69(4), 4575–4579 (2020)

    Article  Google Scholar 

  5. Tu, Y., Lin, Y., Wang, J., et al.: Semi-supervised learning with generative adversarial networks on digital signal modulation classification. Comput. Mater. Continua 55(2), 243–254 (2018)

    Google Scholar 

  6. Lin, Y., Zhu, X., Zheng, Z., et al.: The individual identification method of wireless device based on dimensionality reduction and machine learning. J. Supercomput. 75(6), 3010–3027 (2019)

    Article  Google Scholar 

  7. Lin, Y., Tu, Y., Dou, Z.: An improved neural network pruning technology for automatic modulation classification in edge devices. IEEE Trans. Veh. Technol. 69(5), 5703–5706 (2020)

    Article  Google Scholar 

  8. Yun, L., Haojun, Z., Xuefei, M., et al.: Adversarial attacks in modulation recognition with convolutional neural networks. IEEE Trans. Reliab. 70(1), 389–401 (2021). https://doi.org/10.1109/TR.2020.3032744

    Article  Google Scholar 

  9. Lin, J., Wei, M.: Network security situation prediction based on combining 3D-CNNs and Bi-GRUs. Int. J. Perform. Eng. 16(12), 1875–1887 (2020)

    Google Scholar 

  10. Restuccia, F., Melodia, T.: Physical-Layer Deep Learning: Challenges and Applications to 5G and Beyond. arXiv preprint arXiv:2004.10113 (2020)

  11. Peng, S., Jiang, H., Wang, H., et al.: Modulation classification based on signal constellation diagrams and deep learning. IEEE Trans. Neural Netw. Learn. Syst. 30(3), 718–727 (2018)

    Article  Google Scholar 

  12. Jajoo, G., Kumar, Y., Yadav, S.K.: Blind signal PSK/QAM recognition using clustering analysis of constellation signature in flat fading channel. IEEE Commun. Lett. 23(10), 1853–1856 (2019)

    Article  Google Scholar 

  13. Lin Yun, T., Ya, D.Z., et al.: Contour stella image and deep learning for signal recognition in the physical layer. IEEE Trans. Cogn. Commun. Netw. 7(1), 34–46 (2021). https://doi.org/10.1109/TCCN.2020.3024610

    Article  Google Scholar 

  14. Zhang, Z., Luo, H., Wang, C., et al.: Automatic modulation classification using CNN-LSTM based dual-stream structure. IEEE Trans. Veh. Technol. 69(11), 13521–13531 (2020)

    Article  Google Scholar 

  15. Xu, J., Luo, C., Parr, G., et al.: A spatiotemporal multi-channel learning framework for automatic modulation recognition. IEEE Wirel. Commun. Lett. 9(10), 1629–1632 (2020)

    Article  Google Scholar 

  16. O’Shea, T.J., Roy, T., Clancy, T.C.: Over-the-air deep learning based radio signal classification. IEEE J. Sel. Top. Sig. Process. 12(1), 168–179 (2018)

    Article  Google Scholar 

  17. Cheng, X., He, J., He, J., et al.: Cv-CapsNet: complex-valued capsule network. IEEE Access 7, 85492–85499 (2019)

    Article  Google Scholar 

  18. Tu, Y., Lin, Y., Hou, C., et al.: Complex-valued networks for automatic modulation classification. IEEE Trans. Veh. Technol. 69(9), 10085–10089 (2020)

    Article  Google Scholar 

  19. Meng, F., Chen, P., Wu, L., et al.: Automatic modulation classification: a deep learning enabled approach. IEEE Trans. Veh. Technol. 67(11), 10760–10772 (2018)

    Article  Google Scholar 

  20. Li, R., Li, L., Yang, S., et al.: Robust automated VHF modulation recognition based on deep convolutional neural networks. IEEE Commun. Lett. 22(5), 946–949 (2018)

    Article  Google Scholar 

  21. Baltrušaitis, T., Ahuja, C., Morency, L.P.: Multimodal machine learning: a survey and taxonomy. IEEE Trans. Pattern Anal. Mach. Intell. 41(2), 423–443 (2018)

    Article  Google Scholar 

  22. Zhang, C., Yang, Z., He, X., et al.: Multimodal intelligence: Representation learning, information fusion, and applications. IEEE J. Sel. Top. Sig. Process. 14(3), 478–493 (2020)

    Article  Google Scholar 

  23. Zhang, Z., Wang, C., Gan, C., et al.: Automatic modulation classification using convolutional neural network with features fusion of SPWVD and BJD. IEEE Trans. Sig. Inf. Process. Netw. 5(3), 469–478 (2019)

    MathSciNet  Google Scholar 

  24. Wu, H., Li, Y., Zhou, L., et al.: Convolutional neural network and multi-feature fusion for automatic modulation classification. Electron. Lett. 55(16), 895–897 (2019)

    Article  Google Scholar 

  25. Qi, P., Zhou, X., Zheng, S., et al.: Automatic Modulation Classification Based on Deep Residual Networks with Multimodal Information. IEEE Trans. Cogn. Commun. Netw. 7, 21–33 (2020)

    Article  Google Scholar 

  26. Van der Maaten, L., Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9(11), 1–48 (2008)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Information and Communication Engineering, Harbin Engineering University, Harbin, 150001, China

    Xiao Zhang & Yun Lin

Authors
  1. Xiao Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yun Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yun Lin .

Editor information

Editors and Affiliations

  1. Fujian Normal University, Fuzhou, China

    Jinbo Xiong

  2. Illinois State University, Normal, IL, USA

    Shaoen Wu

  3. Guizhou University, Guiyang, China

    Changgen Peng

  4. Guizhou University, Guiyang, China

    Youliang Tian

Rights and permissions

Reprints and permissions

Copyright information

© 2021 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhang, X., Lin, Y. (2021). Automatic Modulation Classification Based on Multimodal Coordinated Integration Architecture and Feature Fusion. In: Xiong, J., Wu, S., Peng, C., Tian, Y. (eds) Mobile Multimedia Communications. MobiMedia 2021. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 394. Springer, Cham. https://doi.org/10.1007/978-3-030-89814-4_58

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-89814-4_58

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-89813-7

  • Online ISBN: 978-3-030-89814-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation