Abstract
GridFTP is a high-performance, secure and reliable parallel data transfer protocol, used for transferring widely distributed data. Currently it allows users to configure the number of parallel streams and socket buffer size. However, the tuning procedure for its optimal combinations is a time consuming task. The socket handlers and buffers are important system resources and must therefore be carefully managed. In this paper, an efficient resource management scheme which predicts optimal combinations based on a simple regression equation is proposed. In addition, the equation is verified by comparing measured and predicted values and we apply the equation to an actual experiment on the KOREN. The result demonstrates that the equation predicts excellently with only 8% error boundary. This approach eliminates the time wasted tuning procedure. These results can be utilized directly and widely for the fast decision in typical applications such as GridFTP.
This work was supported in parts by Brain Korea 21 and the Ministry of Information and Communication in Republic of Korea.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Chervenak, A., Foster, I., Kesselman, C., Salisbury, C., Tuecke, S.: The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets. Journal of Network and Computer Application 23, 187–200 (2001)
Allcock, B., Mandrichenko, I., Perelmutov, T.: GridFTP v2 Protocol Description, Germi National Accelerator Laboratory (2004)
Kakadia, D.: Understanding Tuning TCP, Sun BluePrints (March 2004)
Tierney, B.: TCP Tuning Guide for Distributed Applications on WAN. In: USENIX&SAGE Login (February 2001), http://www-didc.lbl.gov/tcp-wan.html
Semke, J., Mahdavi, J., Mathis, M.: Automatic TCP Buffer Tuning. In: ACM SIGCOMM 1998, vol. 28(4) (1998)
Sivakumar, H., Bailey, S., Grossman, R.L.: PSockets: The Case for Application-level Network Striping for Data Intensive Applications using High Speed Wide Area Networks. In: IEEE/ACM SC 2000 (November 2000)
Grossman, R.L., Sivakumar, H., Bailey, S.: PSockets: The case for application-level network striping for data intensive applications using high speed wide area networks. In: Supercomputing, IEEE and ACM (2000)
Tierney, B.L., Gunter, D., Lee, J., Stoufer, M.: Enabling Network-Aware Applications. In: IEEE-HPDC (2001)
Gardner, M.K., Feng, W., Fisk, M.: Dynamic Right-Sizing in FTP (drsFTP): Enhancing Grid Performance in User-Space. In: IEEE Symposium on High-Performance Distributed Computing (HPDC-11/2002), Edinburgh, Scotland (July 2002), LA-UR 02-2799
Weigle, E., Feng, W.: Dynamic Right-Sizing: a Simulation Study. In: IEEE ICCCN (2001)
Weigle, E., Feng, W.: A Comparison of TCP Automatic Tuning Techniques for Distributed Computing. In: HPDC-11 (2002)
Mathis, M., Semke, J., Mahdavi, J., Ott, T.: The Macroscopic Behavior of the Congestion Avoidance Algorithm. Computer Communications Review 27(3) (July 1997)
Carson, M., Santay, D.: NIST Net: A Linux-based Network Emulation Tool. Computer Communication Review (June 2003)
Gates, M., Tirumala, A., Dugan, J., Gibbs, K.: Iperf NLANR (2003), http://dast.nlanr.net/Projects/Iperf/
TCP Extensions for High Performance, RFC1323
Linux man page, http://www.die.net/doc/linux/man/man7/tcp.7.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Choi, K.M., Huh, EN., Choo, H. (2005). Efficient Resource Management Scheme of TCP Buffer Tuned Parallel Stream to Optimize System Performance. In: Enokido, T., Yan, L., Xiao, B., Kim, D., Dai, Y., Yang, L.T. (eds) Embedded and Ubiquitous Computing – EUC 2005 Workshops. EUC 2005. Lecture Notes in Computer Science, vol 3823. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11596042_71
Download citation
DOI: https://doi.org/10.1007/11596042_71
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30803-4
Online ISBN: 978-3-540-32296-2
eBook Packages: Computer ScienceComputer Science (R0)