Using Non-random Associations for Predicting Latency in WANs

  • Vladimir Zadorozhny
  • Louiqa Raschid
  • Avigdor Gal
  • Qiang Ye
  • Hyma Murthy
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3806)


In this paper, we propose a scalable performance management tool for Wide Area Applications. Our objective is to scalably identify non-random associations between pairs of individual Latency Profiles (iLPs) (i.e., latency distributions experienced by clients when connecting to a server) and exploit them in latency prediction. Our approach utilizes Relevance Networks (RNs) to manage tens of thousands of iLPs. Non-random associations between iLPs can be identified by topology-independent measures such as correlation and mutual information. We demonstrate that these non-random associations do indeed have a significant impact in improving the error of latency prediction.


Mutual Information Border Gateway Protocol Correlation Threshold Relevance Network Latency Prediction 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
  2. 2.
  3. 3.
    Krishnamurthy, B., Wang, J.: On network-aware clustering of web clients. In: Proc. SIGComm, pp. 97–110 (2000)Google Scholar
  4. 4.
    Li, W.: Mutual information functions versus correlation functions. Journal of Statistical Physics (60) (1990)Google Scholar
  5. 5.
    Mao, Z., Cranor, C., Douglis, F., Rabinovich, M., Spatscheck, O., Wang, J.: A precise and efficient evaluation of the proximity between web clients and their local dns servers (2002)Google Scholar
  6. 6.
    Mendenhall, W., Sincich, T.: Statistics for Engineering and the Sciences. Macmillan Publishing, Basingstoke (1985)Google Scholar
  7. 7.
    Ng, E.N., Zhang, H.: Towards global network positioning. In: Proceedings of ACM SIGCOMM Internet Measurement Workshop (2001)Google Scholar
  8. 8.
    The planetlab home page,
  9. 9.
    Raschid, L., Wen, H.-F., Gal, A., Zadorozhny, V.: Latency profiles: Performance monitoring for wide area applications. In: Proceedings of the Third IEEE Workshop on Internet Applications (WIAPP 2003), June 2003, San Jose, CA (2003)Google Scholar
  10. 10.
    Reza, F.: An Introduction to Information Theory. McGraw-Hill, New York (1961)Google Scholar
  11. 11.
    Rubenstein, D., Kurose, J., Towsley, D.: Detecting shared congestion of flows via end-to-end measurement. In: Proceedings of the ACM SIGMETRICS Conference (2000)Google Scholar
  12. 12.
    Sacerdoti, F., Katz, M., Massie, M., Culler, D.: Wide area cluster monitoring with ganglia. In: Proceedings of the IEEE Cluster 2003 Conference (2003)Google Scholar
  13. 13.
    Stemm, M., Seshan, S., Katz, R.: A network measurement architecture for adaptive applications. In: Proceedings of IEEE InfoComm (2000)Google Scholar
  14. 14.
    Sun, S., Lannom, L.: Handle system overview. IRDM/IRTF Draft (2001),
  15. 15.
    Swany, M., Wolski, R.: Multivariate resource performance forecasting in the network weather service. In: Proceedings of SC 2002 (2002)Google Scholar
  16. 16.
    Wolski, R.: Dynamically forecasting network performance to support dynamic scheduling using the network weather service. In: Proc. of the 6th High-Performance Distributed Computing Conference (1997)Google Scholar
  17. 17.
    Zadorozhny, V., Gal, A., Raschid, L., Ye, Q.: Wide area performance monitoring using aggregate latencyprofiles. In: Koch, N., Fraternali, P., Wirsing, M. (eds.) ICWE 2004. LNCS, vol. 3140, pp. 386–390. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  18. 18.
    Zadorozhny, V., Gal, A., Raschid, L., Ye, Q.: Arena: Adaptive distributed catalog infrastructure based on relevance networks. In: Proceedings of the International Conference on Very Large Data Bases (2005)Google Scholar
  19. 19.
    Zadorozhny, V., Raschid, L., Zhan, T., Bright, L.: Validating an access cost model for wide area applications. In: Batini, C., Giunchiglia, F., Giorgini, P., Mecella, M. (eds.) CoopIS 2001. LNCS, vol. 2172, p. 371. Springer, Heidelberg (2001)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Vladimir Zadorozhny
    • 1
  • Louiqa Raschid
    • 2
  • Avigdor Gal
    • 3
  • Qiang Ye
    • 1
  • Hyma Murthy
    • 2
  1. 1.University of PittsburghPittsburgh
  2. 2.University of MarylandCollege Park
  3. 3.Israel Institute of TechnologyHaifaIsrael

Personalised recommendations