Skip to main content
SpringerLink
Log in

Federated Learning Research: Trends and Bibliometric Analysis

  • Chapter
  • First Online:
Federated Learning Systems

Part of the book series: Studies in Computational Intelligence ((SCI,volume 965))

Abstract

Federated learning (FL) allows machine learning algorithms to gain insights into a broad range of datasets located at different locations, enabling a privacy-preserving model development. Since its announcement in 2016, FL has gained interest from a variety of entities—both, in academia and industry. To understand what are the research trends in this area, a bibliometric analysis is conducted to objectively describe the research profile of the FL area. In this regard, 476 documents written in English were collected through a thorough systematic search in the Scopus database and examined from several perspectives (e.g., growth trends, top-cited papers, subject area), productivity measures of authors, institutions, and countries. Further, a co-word analysis through VOSviewer was carried out to identify the evolving research themes in FL. There has seen exponential growth in FL literature since 2018. There are five research themes, namely internet of things, wireless communication, privacy and security, data analytics, and learning and optimization, which were surfaced in the analysis. We also found that most of the documents related to FL were published in computer science, followed by engineering disciplines. It was also observed that China is at the forefront in terms of the frequency of documents in this area followed by the United States of America and Australia.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. E. Alpaydin, Introduction to Machine Learning (MIT Press, Cambridge, 2020)

    MATH  Google Scholar 

  2. H.B. McMahan, E. Moore, D. Ramage, S. Hampson, B. AgÃijera y Arcas, Communication-Efficient Learning of Deep Networks from Decentralized Data (2016). arXiv:1602.05629

  3. C. Dinh, N.H. Tran, M.N.H. Nguyen, C.S. Hong, W. Bao, A. Zomaya, V. Gramoli, Federated Learning over Wireless Networks: Convergence Analysis and Resource Allocation (2019). arXiv:1910.13067

  4. R.N. Kostoff, D.R. Toothman, H.J. Eberhart, J.A. Humenik, Text mining using database tomography and bibliometrics: a review. Technol. Forecast. Soc. Change 68(3), 223–253 (2001)

    Article  Google Scholar 

  5. N. Donthu, S. Kumar, D. Pattnaik, Forty-five years of journal of business research: a bibliometric analysis. J. Bus. Res. 109, 1–14 (2020)

    Article  Google Scholar 

  6. M.K. McBurney, P.L. Novak, What is bibliometrics and why should you care?, in Proceedings. IEEE International Professional Communication Conference (IEEE, 2002), pp. 108–114

    Google Scholar 

  7. M. Gaviria-Marin, J.M. Merigó, H. Baier-Fuentes, Knowledge management: a global examination based on bibliometric analysis. Technol. Forecast. Soc. Change 140, 194–220 (2019)

    Article  Google Scholar 

  8. H. Liao, M. Tang, L. Luo, C. Li, F. Chiclana, X.J. Zeng, A bibliometric analysis and visualization of medical big data research. Sustainability 10(1), 166 (2018)

    Article  Google Scholar 

  9. J.J.M. Ferreira, C.I. Fernandes, V. Ratten, A co-citation bibliometric analysis of strategic management research. Scientometrics 109(1), 1–32 (2016)

    Article  Google Scholar 

  10. N.V. Olijnyk, A quantitative examination of the intellectual profile and evolution of information security from 1965 to 2015. Scientometrics 105(2), 883–904 (2015)

    Article  Google Scholar 

  11. S.S. Bhattacharyya, S. Verma, The intellectual contours of corporate social responsibility literature. Int. J. Sociol. Soc. Policy (2020)

    Google Scholar 

  12. M. Mekhail, J. Salminen, L. Ple, J. Wirtz, Artificial intelligence in marketing; bibliometric analysis, topci modeling and research agenda. J. Bus. Res. forthcoming (2021)

    Google Scholar 

  13. S. Verma, A. Gustafsson, Investigating the emerging COVID-19 research trends in the field of business and management: a bibliometric analysis approach. J. Bus. Res. 118, 253–261 (2020)

    Article  Google Scholar 

  14. L.S. Adriaanse, C. Rensleigh, Web of science, scopus and Google Scholar. The Electronic Library (2013)

    Google Scholar 

  15. M.E. Falagas, E.I. Pitsouni, G.A. Malietzis, G. Pappas, Comparison of PubMed, Scopus, web of science, and Google scholar: strengths and weaknesses. FASEB J. 22(2), 338–342 (2008)

    Article  Google Scholar 

  16. F. de Moya-Anegón, Z. Chinchilla-Rodríguez, B. Vargas-Quesada, E. Corera-Álvarez, F. Muñoz-Fernández, A. González-Molina, V. Herrero-Solana, Coverage analysis of Scopus: a journal metric approach. Scientometrics 73(1), 53–78 (2007)

    Article  Google Scholar 

  17. M.J. Cobo, A.G. López-Herrera, E. Herrera-Viedma, F. Herrera, Science mapping software tools: review, analysis, and cooperative study among tools. J. Amer. Soc. Inf. Sci. Technol. 62, 1382–1402 (2011)

    Article  Google Scholar 

  18. N.J. Van Eck, L. Waltman, Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics 84, 523–538 (2010)

    Article  Google Scholar 

  19. P. Kairouz, H.B. McMahan, B. Avent, A. Bellet, M. Bennis, A.N. Bhagoji, K. Bonawitz, Z. Charles, G. Cormode, R. Cummings, R.G.L. D’Oliveira, S. El Rouayheb, D. Evans, J. Gardner, Z. Garrett, A. Gascón, B. Ghazi, P.B. Gibbons, M. Gruteser, Z. Harchaoui, C. He, L. He, Z. Huo, B. Hutchinson, J. Hsu, M. Jaggi, T. Javidi, G. Joshi, M. Khodak, J. Konečný, A. Korolova, F. Koushanfar, S. Koyejo, T. de Lepoint, Y. Liu, P. Mittal, M. Mohri, R. Nock, A. Özgür, R. Pagh, M. Raykova, H. Qi, D. Ramage, R. Raskar, D. Song, W. Song, S.U. Stich, Z. Sun, A.T. Suresh, F. Tramèr, P. Vepakomma, J. Wang, L. Xiong, Z. Xu, Q. Yang, F.X. Yu, H. Yu, S. Zhao, Advances and Open Problems in Federated Learning (2019). arXiv:1912.04977

  20. F. Chen, M. Luo, Z. Dong, Z. Li, X. He, Federated Meta-Learning with Fast Convergence and Efficient Communication (2019). arXiv:1802.07876

  21. V. Smith, C.-K. Chiang, M. Sanjabi, A.S. Talwalkar, Federated multi-task learning, in Advances in Neural Information Processing Systems, vol. 30,ed. by I. Guyon, U.V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, R. Garnett (Curran Associates, Inc., New York, 2017), pp. 4424–4434, http://papers.nips.cc/paper/7029-federated-multi-task-learning.pdf

  22. R.C. Geyer, T. Klein, M. Nabi, Differentially private federated learning: a client level perspective (2017). arxiv:1712.07557

  23. K. Bonawitz, V. Ivanov, B. Kreuter, A. Marcedone, H.B. McMahan, S. Patel, D. Ramage, A. Segal, K. Seth, Practical secure aggregation for privacy-preserving machine learning, in Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security (CCS’17) (ACM, New York, 2017), pp. 1175–1191. https://doi.org/10.1145/3133956.3133982

  24. B. McMahan, E. Moore, D. Ramage, S. Hampson, B.A. y Arcas, Communication-efficient learning of deep networks from decentralized data, in Artificial Intelligence and Statistics (PMLR, 2017), pp. 1273–1282

    Google Scholar 

  25. M.H. Rehman, K. Salah, E. Damiani, D. Svetinovic, Towards blockchain-based reputation-aware federated learning, in IEEE INFOCOM 2020 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Toronto, ON, Canada (2020), pp. 183–188. https://doi.org/10.1109/INFOCOMWKSHPS50562.2020.9163027

  26. K. Bonawitz, V. Ivanov, B. Kreuter, A. Marcedone, H.B. McMahan, S. Patel, D. Ramage, A. Segal, K. Seth, Practical secure aggregation for privacy-preserving machine learning, in Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security (2017), pp. 1175–1191

    Google Scholar 

  27. Q. Yang, Y. Liu, T. Chen, Y. Tong, Federated machine learning: concept and applications. ACM Trans. Intell. Syst. Technol. (TIST) 10(2), 1–19 (2019)

    Article  Google Scholar 

  28. Y. Zou, S. Feng, D. Niyato, Y. Jiao, S. Gong, W. Cheng, Mobile device training strategies in federated learning: an evolutionary game approach, in 2019 International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) (IEEE, 2019), pp. 874–879

    Google Scholar 

  29. S. Feng, D. Niyato, P. Wang, D.I. Kim, Y.C. Liang, Joint service pricing and cooperative relay communication for federated learning, in 2019 International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) (IEEE, 2019), pp. 815–820

    Google Scholar 

  30. J. Kang, Z. Xiong, D. Niyato, H. Yu, Y.C. Liang, D.I. Kim, Incentive design for efficient federated learning in mobile networks: a contract theory approach, in 2019 IEEE VTS Asia Pacific Wireless Communications Symposium (APWCS) (IEEE, 2019), pp. 1–5

    Google Scholar 

  31. Y. Zou, S. Feng, J. Xu, S. Gong, D. Niyato, W. Cheng, Dynamic games in federated learning training service market, in 2019 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM) (IEEE, 2019), pp. 1–6

    Google Scholar 

  32. T.T. Anh, N.C. Luong, D. Niyato, D.I. Kim, L.C. Wang, Efficient training management for mobile crowd-machine learning: a deep reinforcement learning approach. IEEE Wireless Commun. Lett. 8(5), 1345–1348 (2019)

    Article  Google Scholar 

  33. J. Kang, Z. Xiong, D. Niyato, S. Xie, J. Zhang, Incentive mechanism for reliable federated learning: a joint optimization approach to combining reputation and contract theory. IEEE Internet Things J. 6(6), 10700–10714 (2019)

    Article  Google Scholar 

  34. H. Yu, Z. Liu, Y. Liu, T. Chen, M. Cong, X. Weng, D. Niyato, Q. Yang, A fairness-aware incentive scheme for federated learning, in Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society (2020), pp. 393–399

    Google Scholar 

  35. J. Kang, Z. Xiong, D. Niyato, Y. Zou, Y. Zhang, M. Guizani, Reliable federated learning for mobile networks. IEEE Wireless Commun. 27(2), 72–80 (2020)

    Article  Google Scholar 

  36. H. Yu, Z. Liu, Y. Liu, T. Chen, M. Cong, X. Weng, D. Niyato, Q. Yang, A sustainable incentive scheme for federated learning. IEEE Intell. Syst. (2020)

    Google Scholar 

  37. W.Y.B. Lim, N.C. Luong, D.T. Hoang, Y. Jiao, Y.-C. Liang, Q. Yang, D. Niyato, C. Miao, Federated learning in mobile edge networks: a comprehensive survey. IEEE Commun. Surv. & Tutor. (2020)

    Google Scholar 

  38. Y. Liu, J.Q. James, J. Kang, D. Niyato, S. Zhang, Privacy-preserving traffic flow prediction: a federated learning approach. IEEE Internet Things J. (2020)

    Google Scholar 

  39. Y. Liu, J. Peng, J. Kang, A.M. Iliyasu, D. Niyato, A.A.A. El-Latif, A Secure Federated Learning Framework for 5G Networks (2020). arXiv:2005.05752

  40. S. Duan, D. Zhang, Y. Wang, L. Li, Y. Zhang, JointRec: a deep learning-based joint cloud video recommendation framework for mobile IoTs. IEEE Internet Things J. 1 (2019). https://doi.org/10.1109/jiot.2019.2944889

  41. A. Feraudo, P. Yadav, V. Safronov, D.A. Popescu, R. Mortier, S. Wang, P. Bellavista, J. Crowcroft, CoLearn: enabling federated learning in MUD-compliant IoT edge networks, in Proceedings of the Third ACM International Workshop on Edge Systems, Analytics and Networking (2020), pp. 25–30

    Google Scholar 

  42. Y. Lu, X. Huang, Y. Dai, S. Maharjan, Y. Zhang, Blockchain and federated learning for privacy-preserved data sharing in industrial IoT. IEEE Trans. Ind. Inf. 16(6), 4177–4186 (2019)

    Article  Google Scholar 

  43. X. Wu, Z. Liang, J. Wang, Fedmed: a federated learning framework for language modeling. Sensors 20(14), 4048 (2020)

    Article  Google Scholar 

  44. W.A.N.G. Luping, W.A.N.G. Wei, L.I. Bo, Cmfl: mitigating communication overhead for federated learning, in 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS) (IEEE, 2019), pp. 954–964

    Google Scholar 

  45. K. Chandiramani, D. Garg, N. Maheswari, Performance analysis of distributed and federated learning models on private data. Procedia Comput. Sci. 165, 349–355 (2019)

    Article  Google Scholar 

  46. N. Balachandar, K. Chang, J. Kalpathy-Cramer, D.L. Rubin, Accounting for data variability in multi-institutional distributed deep learning for medical imaging. J. Amer. Med. Inf. Ass. 27(5), 700–708 (2020)

    Article  Google Scholar 

  47. R. Doku, D.B. Rawat, C. Liu, Towards federated learning approach to determine data relevance in big data, in 2019 IEEE 20th International Conference on Information Reuse and Integration for Data Science (IRI) (IEEE, 2019), pp. 184–192

    Google Scholar 

  48. R. Zhao, Y. Yin, Y. Shi, Z. Xue, Intelligent intrusion detection based on federated learning aided long short-term memory. Phys. Commun. 42 (2020)

    Google Scholar 

  49. J. Schneible, A. Lu, Anomaly detection on the edge, in MILCOM 2017-2017 IEEE Military Communications Conference (MILCOM) (IEEE, 2017), pp. 678–682

    Google Scholar 

  50. T. Li, A.K. Sahu, A. Talwalkar, V. Smith, Federated learning: challenges, methods, and future directions. IEEE Signal Proc. Mag. 37(3), 50–60 (2020)

    Article  Google Scholar 

  51. S.K. Lo, Q. Lu, C. Wang, H. Paik, L. Zhu, A systematic literature review on federated machine learning: from a software engineering perspective (2020). arXiv:2007.11354

  52. V. Mothukuri, R.M. Parizi, S. Pouriyeh, Y. Huang, A. Dehghantanha, G. Srivastava, A survey on security and privacy of federated learning. Future Gener. Comput. Syst. 115, 619–640 (2020)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computing, University of Turku, 20500, Turku, Finland

    Ali Farooq

  2. University of Malaya Halal Research Centre (UMHRC), University of Malaya, 50603, Kuala Lumpur, Malaysia

    Ali Feizollah

  3. Center for Cyber-Physical Systems, Khalifa University of Science and Technology, 127788, Abu Dhabi, UAE

    Muhammad Habib ur Rehman

Authors
  1. Ali Farooq
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ali Feizollah
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Muhammad Habib ur Rehman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ali Farooq .

Editor information

Editors and Affiliations

  1. Center for Cyber-Physical Systems, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates

    Muhammad Habib ur Rehman

  2. School of Computing and Digital Technology, Birmingham City University, Birmingham, UK

    Mohamed Medhat Gaber

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Farooq, A., Feizollah, A., ur Rehman, M.H. (2021). Federated Learning Research: Trends and Bibliometric Analysis. In: Rehman, M.H.u., Gaber, M.M. (eds) Federated Learning Systems. Studies in Computational Intelligence, vol 965. Springer, Cham. https://doi.org/10.1007/978-3-030-70604-3_1

Download citation

Publish with us

Policies and ethics

Search

Navigation