Journal of Network and Systems Management

, Volume 24, Issue 1, pp 1–33

A Network Management System for Handling Scientific Data Flows

  • Zhenzhen Yan
  • Chris Tracy
  • Malathi Veeraraghavan
  • Tian Jin
  • Zhengyang Liu
Article

DOI: 10.1007/s10922-014-9336-2

Cite this article as:
Yan, Z., Tracy, C., Veeraraghavan, M. et al. J Netw Syst Manage (2016) 24: 1. doi:10.1007/s10922-014-9336-2

Abstract

Large scientific data transfers often occur at high rates causing increased burstiness in Internet traffic. To limit the adverse effects of these high-rate large-sized flows, which are referred to as \(\alpha \) flows, on delay-sensitive audio/video flows, a network management system called Alpha Flow Traffic Engineering System (AFTES) is proposed for intra-domain traffic engineering. An offline approach is used in which AFTES analyzes NetFlow records collected by routers, extracts source–destination address prefixes of \(\alpha \) flows, and uses these prefixes to configure firewall filters at ingress routers of a provider’s network to redirect future \(\alpha \) flows to traffic-engineered paths and isolated queues. The effectiveness of this scheme was evaluated through an analysis of 7 months of NetFlow data obtained from an ESnet router. For this data set, 91 % of bytes generated by \(\alpha \) flows during high-rate intervals would have been directed had AFTES been deployed. The negative aspect of using address prefixes in firewall filters, i.e., the redirection of \(\beta \) flows to \(\alpha \)-flow paths/queues, was also quantified.

Keywords

NetFlow traffic analysis Elephant flows Scientific computing Research and education networks (RENs) MPLS Virtual circuits 

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  • Zhenzhen Yan
    • 1
  • Chris Tracy
    • 2
  • Malathi Veeraraghavan
    • 1
  • Tian Jin
    • 3
  • Zhengyang Liu
    • 3
  1. 1.Department of Electrical and Computer EngineeringUniversity of VirginiaCharlottesvilleUSA
  2. 2.Energy Sciences Network (ESnet)Lawrence Berkeley National LaboratoryBerkeleyUSA
  3. 3.Department of Computer ScienceUniversity of VirginiaCharlottesvilleUSA

Personalised recommendations