Abstract
One of the most challenging aspects to designing a Java messaging system for HPC is the intermediate buffering layer. The lower and higher levels of the messaging software use this buffering layer to write and read messages. The Java New I/O package adds the concept of direct buffers, which—coupled with a memory management algorithm—opens the possibility of efficiently implementing this buffering layer. In this paper, we present our buffering strategy, which is developed to support efficient communications and derived datatypes in MPJ Express—our implementation of the Java MPI API. We evaluate the performance of our buffering layer and demonstrate the usefulness of direct byte buffers.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Baker, M., Carpenter, B., Fox, G., Ko, S.H., Lim, S.: An object-oriented Java interface to MPI. In: International Workshop on Java for Parallel and Distributed Computing, San Juan, Puerto Rico (April 1999)
Baker, M., Ong, H., Shafi, A.: A status report: Early experiences with the implementation of a message passing system using Java NIO. Technical Report DSGTR06102004, DSG (October 2004), http://dsg.port.ac.uk/projects/mpj/docs/res/DSGTR06102004.pdf
Chang, C.-C., von Eicken, T.: Javia: A Java interface to the virtual interface architecture. Concurrency - Practice and Experience 12(7), 573–593 (2000)
The Java Native Interface Specifications, http://java.sun.com/j2se/1.3/docs/guide/jni
Knuth, D.: The Art of Computer Programming: Fundamental Algorithms. Addison-Wesley, Reading (1973)
MPJ Express, http://dsg.port.ac.uk/projects/mpj
Myricom, The MX (Myrinet eXpress) library, http://www.myri.com
The Java New I/O Specifications, http://java.sun.com/j2se/1.4.2/docs/guide/nio
Welsh, M., Culler, D.: Jaguar: enabling efficient communication and I/O in Java. Concurrency: Practice and Experience 12(7), 519–538 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Baker, M., Carpenter, B., Shafi, A. (2006). An Approach to Buffer Management in Java HPC Messaging. In: Alexandrov, V.N., van Albada, G.D., Sloot, P.M.A., Dongarra, J. (eds) Computational Science – ICCS 2006. ICCS 2006. Lecture Notes in Computer Science, vol 3992. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11758525_126
Download citation
DOI: https://doi.org/10.1007/11758525_126
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-34381-3
Online ISBN: 978-3-540-34382-0
eBook Packages: Computer ScienceComputer Science (R0)