Advertisement

Efficient Resource Management Scheme of TCP Buffer Tuned Parallel Stream to Optimize System Performance

  • Kun Myon Choi
  • Eui-Nam Huh
  • Hyunseung Choo
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3823)

Abstract

GridFTP is a high-performance, secure and reliable parallel data transfer protocol, used for transferring widely distributed data. Currently it allows users to configure the number of parallel streams and socket buffer size. However, the tuning procedure for its optimal combinations is a time consuming task. The socket handlers and buffers are important system resources and must therefore be carefully managed. In this paper, an efficient resource management scheme which predicts optimal combinations based on a simple regression equation is proposed. In addition, the equation is verified by comparing measured and predicted values and we apply the equation to an actual experiment on the KOREN. The result demonstrates that the equation predicts excellently with only 8% error boundary. This approach eliminates the time wasted tuning procedure. These results can be utilized directly and widely for the fast decision in typical applications such as GridFTP.

Keywords

Packet Loss Packet Loss Rate Aggregate Throughput Parallel Transfer Resource Management Scheme 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. 1.
    Chervenak, A., Foster, I., Kesselman, C., Salisbury, C., Tuecke, S.: The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets. Journal of Network and Computer Application 23, 187–200 (2001)CrossRefGoogle Scholar
  2. 2.
    Allcock, B., Mandrichenko, I., Perelmutov, T.: GridFTP v2 Protocol Description, Germi National Accelerator Laboratory (2004)Google Scholar
  3. 3.
    Kakadia, D.: Understanding Tuning TCP, Sun BluePrints (March 2004)Google Scholar
  4. 4.
    Tierney, B.: TCP Tuning Guide for Distributed Applications on WAN. In: USENIX&SAGE Login (February 2001), http://www-didc.lbl.gov/tcp-wan.html
  5. 5.
    Semke, J., Mahdavi, J., Mathis, M.: Automatic TCP Buffer Tuning. In: ACM SIGCOMM 1998, vol. 28(4) (1998)Google Scholar
  6. 6.
    Sivakumar, H., Bailey, S., Grossman, R.L.: PSockets: The Case for Application-level Network Striping for Data Intensive Applications using High Speed Wide Area Networks. In: IEEE/ACM SC 2000 (November 2000)Google Scholar
  7. 7.
    Grossman, R.L., Sivakumar, H., Bailey, S.: PSockets: The case for application-level network striping for data intensive applications using high speed wide area networks. In: Supercomputing, IEEE and ACM (2000)Google Scholar
  8. 8.
    Tierney, B.L., Gunter, D., Lee, J., Stoufer, M.: Enabling Network-Aware Applications. In: IEEE-HPDC (2001)Google Scholar
  9. 9.
    Gardner, M.K., Feng, W., Fisk, M.: Dynamic Right-Sizing in FTP (drsFTP): Enhancing Grid Performance in User-Space. In: IEEE Symposium on High-Performance Distributed Computing (HPDC-11/2002), Edinburgh, Scotland (July 2002), LA-UR 02-2799Google Scholar
  10. 10.
    Weigle, E., Feng, W.: Dynamic Right-Sizing: a Simulation Study. In: IEEE ICCCN (2001)Google Scholar
  11. 11.
    Weigle, E., Feng, W.: A Comparison of TCP Automatic Tuning Techniques for Distributed Computing. In: HPDC-11 (2002)Google Scholar
  12. 12.
    Mathis, M., Semke, J., Mahdavi, J., Ott, T.: The Macroscopic Behavior of the Congestion Avoidance Algorithm. Computer Communications Review 27(3) (July 1997)Google Scholar
  13. 13.
    Carson, M., Santay, D.: NIST Net: A Linux-based Network Emulation Tool. Computer Communication Review (June 2003)Google Scholar
  14. 14.
    Gates, M., Tirumala, A., Dugan, J., Gibbs, K.: Iperf NLANR (2003), http://dast.nlanr.net/Projects/Iperf/
  15. 15.
    TCP Extensions for High Performance, RFC1323Google Scholar
  16. 16.

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Kun Myon Choi
    • 1
  • Eui-Nam Huh
    • 2
  • Hyunseung Choo
    • 1
  1. 1.School of Information and Communication EngineeringSungkyunkwan UniversityKorea
  2. 2.College of Electronics and InformationKyung Hee UniversityKorea

Personalised recommendations