Skip to main content

Application and Analysis of Three Common High-Performance Network Data Processing Frameworks

  • Conference paper
  • First Online:
Big Data Analytics for Cyber-Physical System in Smart City (BDCPS 2020)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1303))

Abstract

The rise of “cloud” industry and continuous innovation of network technology, more and more basic network architecture equipment is gradually integrated into the architecture based on the general processor platform, from traditional physical network management to virtual network management, gradually from flat the network structure model evolved into a layered network structure based on SDN. Network construction has become controllable and low cost, able to support the performance requirements of large-scale users or applications and massive data processing. There are many excellent high-performance network data processing frameworks on the market that integrate above technical solutions, such as 6wind, windriver, DPDK, PF_RING, Netmap, etc. This article introduces three common DPDK, PF_RING, Netmap high-performance network packet processing framework compares their advantages and disadvantages, and prospects for future development.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 299.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 379.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Pak, J.: A high-performance implementation of an IoT system using DPDK. 8(4) (2018). https://doi.org/10.3390/app8040550

  2. Begin, T., Baynat, B., Gallardo, G.A., et al.: An accurate and efficient modeling framework for the performance evaluation of DPDK-based virtual switches. IEEE Trans. Netw. Serv. Manage. 15(4), 1407–1421 (2018)

    Article  Google Scholar 

  3. Halfhill, T.R.: Broadwell accelerates the DPDK. Microprocess. Rep. 30(7), 19–22 (2016)

    Google Scholar 

  4. Moharir, M., Johar, D., Bhardwaj, D.: An experimental review on Intel DPDK L2 forwarding. Int. J. Appl. Eng. Res. 12(18 Pt.5), 7833–7837 (2017)

    Google Scholar 

  5. Li, G., Zhang, D., Li, Y., et al.: Toward energy-efficiency optimization of Pktgen-DPDK for green network testbeds. China Commun. 15(11), 199–207 (2018)

    Article  Google Scholar 

  6. Alizadeh, R., Belanger, N., Savaria, Y., et al.: DPDK and MKL; enabling technologies for near deterministic cloud-based signal processing. In: 2015 IEEE 13th International New Circuits and Systems Conference: 2015 IEEE 13th International New Circuits and Systems Conference (NEWCAS), Grenoble, France, 7–10 June 2015, pp. 1–4 (2015)

    Google Scholar 

  7. Gallenmuller, S., Emmerich, P., Wohlfart, F., et al.: Comparison of frameworks for high-performance packet IO. In: Eleventh 2015 ACM/IEEE Symposium on Architectures for Networking and Communications Systems: Eleventh 2015 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS 2013), Oakland, CA, USA, 7–8 May 2015, pp. 29–38 (2015)

    Google Scholar 

  8. Stoev, S.A., Michailidis, G., Bhattacharya, S., et al.: AMON: an open source architecture for online monitoring, statistical analysis, and forensics of multi-gigabit streams. IEEE J. Sel. Areas Commun. 34(6), 1834–1848 (2016)

    Article  Google Scholar 

  9. Du, J., Liu, P.: Design and implementation of efficient one-way isolation system based on PF_RING. In: 2012 Fourth International Conference on Multimedia Information Networking and Security [v.1], pp. 105–108 (2012)

    Google Scholar 

  10. Zabala, L., Pineda, A., Ferro, A., et al.: Comparing network traffic probes based on commodity hardware. In: The Thirteenth International Conference on Networks: ICN 2014, Nice, France, 23–27 February 2014, pp. 261–267 (2014)

    Google Scholar 

  11. Redzovic, H., Vesovic, M., Smiljanic, A., et al.: Energy-efficient network processing based on netmap framework. Electron. Lett. 53(10), 407–409 (2017)

    Article  Google Scholar 

  12. Garzarella, S., Lettieri, G., Rizzo, L.: Virtual device passthrough for high speed VM networking. In: Eleventh 2015 ACM/IEEE Symposium on Architectures for Networking and Communications Systems: Eleventh 2015 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS 2013), Oakland, CA, USA, 7–8 May 2015, pp. 99–110 (2015)

    Google Scholar 

  13. Mikkelsen, L.M., Thomsen, S.R., Pedersen, M.S., et al.: NetMap - creating a map of application layer QoS metrics of mobile networks using crowd sourcing. In: Internet of Things, Smart Spaces, and Next Generation Networks and Systems: 14th International Conference, NEW2AN 2014, and 7th Conference, ruSMART 2014, Proceedings, St. Petersburg, Russia, 27–29 August 2014, pp. 544–555 (2014)

    Google Scholar 

  14. Rizzo, L.: Portable packet processing modules for OS kernels. IEEE Netw. Mag. Comput. Commun. 28(2), 6–11 (2014)

    Google Scholar 

  15. Casoni, M., Grazia, C.A., Patriciello, N.: On the performance of Linux container with Netmap/VALE for networks virtualization. In: 2013 19th IEEE International Conference on Networks: 2013 19th IEEE International Conference on Networks (ICON), Singapore, Singapore, 11–13 December 2013, pp. 1–6 (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wen-bin Kang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhu, G., Kang, Wb. (2021). Application and Analysis of Three Common High-Performance Network Data Processing Frameworks. In: Atiquzzaman, M., Yen, N., Xu, Z. (eds) Big Data Analytics for Cyber-Physical System in Smart City. BDCPS 2020. Advances in Intelligent Systems and Computing, vol 1303. Springer, Singapore. https://doi.org/10.1007/978-981-33-4572-0_185

Download citation

  • DOI: https://doi.org/10.1007/978-981-33-4572-0_185

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-33-4573-7

  • Online ISBN: 978-981-33-4572-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics