Abstract
In this paper, we show the feasibility of real-time flow monitoring with controllable accuracy in today’s IP networks. Our approach is based on Netflow and A-GAP. A-GAP is a protocol for continuous monitoring of network state variables, which are computed from device metrics using aggregation functions, such as SUM, AVERAGE and MAX. A-GAP is designed to achieve a given monitoring accuracy with minimal overhead. A-GAP is decentralized and asynchronous to achieve robustness and scalability. The protocol incrementally computes aggregation functions inside the network and, based on a stochastic model, it dynamically configures local filters that control the overhead and accuracy. We evaluate a prototype in a testbed of 16 commercial routers and provide measurements from a scenario where the protocol continuously estimates the total number of FTP flows in the network. Local flow metrics are read out from Netflow buffers and aggregated in real-time. We evaluate the prototype for the following criteria. First, the ability to effectively control the trade off between monitoring accuracy and processing overhead; second, the ability to accurately predict the distribution of the estimation error; third, the impact of a sudden change in topology on the performance of the protocol. The testbed measurements are consistent with simulation studies we performed for different topologies and network sizes, which proves the feasibility of the protocol design, and, more generally, the feasibility of effective and efficient real-time flow monitoring in large network environments.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Chapter PDF
References
Dam, M., Stadler, R.: A Generic Protocol for Network State Aggregation, Radiovetenskap och Kommunication (RVK), Linkoping, Sweden (June 2005)
JSci (December 2006), http://jsci.sourceforge.net/
JFreeChart (December 2006), http://www.jfree.org/jfreechart/
Olston, C., et al.: Adaptive Precision Setting for Cached Approximate Values. In: ACM SIGMOD 2001, Santa Barbara, USA (May 2001)
IEEE. ANSI/IEEE Std 802.1D, 1998 edn. IEEE (1998)
Olston, C., Jiang, J., Widom, J.: Adaptive Filters for Continuous Queries over Distributed Data Streams. In: ACM SIGMOD 2003, San Diego, USA (June 2003)
Madden, S.R., et al.: TAG: a tiny aggregation service for ad-hoc sensor networks. In: 5th Symposium on Operating Systems Design and Implementation, Boston, USA (December 2002)
Zhao, J., et al.: Computing aggregates for monitoring wireless sensor networks. In: 1st IEEE International Workshop on Sensor Network Protocols and Applications, Anchorage, USA (May 2003)
Boulis, A., Ganeriwal, S., Srivastava, M.B.: Aggregation in sensor networks: an energy - accuracy tradeoff, Elsevier Ad-hoc Networks Journal (s.i. on sensor network protocols and applications) (2003)
Gonzalez Prieto, A.: Adaptive Management for Networked Systems, Licentiate thesis, KTH Royal Institute of Technology, Sweden (June 2006), Available at http://www.ee.kth.se/~gonzalez
Gonzalez Prieto, A., Stadler, R.: A-GAP: An Adaptive Protocol for Continuous Network Monitoring with Accuracy Objectives, IEEE Transactions on Network and Service Management 4(1) (June 2007)
Sharaf, M.A., et al.: Balancing energy efficiency and quality of aggregate data in sensor networks. ACM International Journal on Very Large Data Bases 13(4), 384–403 (2004)
Gonzalez Prieto, A., Stadler, R.: Implementation and Evaluation of A-GAP: Adaptive Monitoring with Controllable Accuracy, KTH Technical Report (January 2007), Available at http://www.ee.kth.se/~gonzalez
Cisco Netflow, http://www.cisco.com/warp/public/732/netflow/index.html
IETF IP Flow Information Export working group, http://www.ietf.org
Keys, K., Moore, D., Estan, C.: A robust system for accurate realtime summaries of internet traffic. SIGMETRICS Perform. Eval. Rev. 33(1), 85–96 (2005)
Molina, M., Chiosi, A., D’Antonio, S., Ventre, G.: Design principles and algorithms for effective high-speed IP flow monitoring. Computer Communications 29(10), 1653–1664 (2006)
Yang, L., Michailidis, G.: Sampled based estimation of network traffic flow characteristics. In: IEEE Infocom 2007, Anchorage, USA (May 2007)
Suh, K., Figueiredo, D.R., Kurose, J., Towsley, D.: Characterizing and detecting skype-relayed traffic. In: IEEE Infocom 2006, Barcelona, Spain (April 2006)
Mori, T., et al.: Identifying elephant flows through periodically sampled packets. In: 4th ACM SIGCOMM conference on Internet measurement, Taormina, Italy (October 2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 IFIP International Federation for Information Processing
About this paper
Cite this paper
Gonzalez Prieto, A., Stadler, R. (2007). Monitoring Flow Aggregates with Controllable Accuracy. In: Krishnaswamy, D., Pfeifer, T., Raz, D. (eds) Real-Time Mobile Multimedia Services. MMNS 2007. Lecture Notes in Computer Science, vol 4787. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75869-3_6
Download citation
DOI: https://doi.org/10.1007/978-3-540-75869-3_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75868-6
Online ISBN: 978-3-540-75869-3
eBook Packages: Computer ScienceComputer Science (R0)