Cluster Computing

, Volume 5, Issue 3, pp 315–324 | Cite as

Open Metadata Formats: Efficient XML-Based Communication for High Performance Computing

  • Patrick Widener
  • Greg Eisenhauer
  • Karsten Schwan
  • Fabián E. Bustamante


High-performance computing faces considerable change as the Internet and the Grid mature. Applications that once were tightly-coupled and monolithic are now decentralized, with collaborating components spread across diverse computational elements. Such distributed systems most commonly communicate through the exchange of structured data. Definition and translation of metadata is incorporated in all systems that exchange structured data. We observe that the manipulation of this metadata can be decomposed into three separate steps: discovery, binding of program objects to the metadata, and marshaling of data to and from wire formats. We have designed a method of representing message formats in XML, using datatypes available in the XML Schema specification. We have implemented a tool, XMIT, that uses such metadata and exploits this decomposition in order to provide flexible run-time metadata definition facilities for an efficient binary communication mechanism. We also demonstrate that the use of XMIT makes possible such flexibility at little performance cost.

middleware metadata XML binary communication wire formats 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    R. Armstrong, D. Gannon, A. Geist, K. Keahey, S. Kohn, L. McInnes, S. Parker and B. Smolinski, Toward a common component architecture for high performance scientific computing, in: Proceedings of the 8th High Performance Distributed Computing (HPDC'99) (1999). Scholar
  2. [2]
    Blocks Extensible Exchange Protocol, Scholar
  3. [3]
    F. Bustamante, G. Eisenhauer, K. Schwan and P. Widener, Efficient wire formats for high performance computing, in: Proceedings of Supercomputing 2000 (November 2000).Google Scholar
  4. [4]
    J. Clark, Expat - XML parser toolkit, xml/expat.html.Google Scholar
  5. [5]
    Common Object Request Broker Architecture, http://www.omg. org/corba2.Google Scholar
  6. [6]
    Document Object Model, Scholar
  7. [7]
    G. Eisenhauer and L.K. Daley, Fast heterogenous binary data interchange, in: Proceedings of the Heterogeneous Computing Workshop (HCW2000) (3-5 May 2000).Google Scholar
  8. [8]
    The extensible markup language (XML), TR/1998/REC-xml-19980210.Google Scholar
  9. [9]
    M. Forum, MPI: A message passing interface standard, Technical report, University of Tennessee (1995).Google Scholar
  10. [10]
    I. Foster, C. Kesselman and S. Tuecke, The nexus approach to integrating multithreading and communication, Journal of Parallel and Distributed Computing (1996) 70-82.Google Scholar
  11. [11]
    A. Geist, A. Beguelin, J. Dongarra, W. Jiang, R. Manchek and V. Sunderam, PVM 3 Users Guide and Reference Manual, Oak Ridge National Laboratory, Oak Ridge, TN (May 1994).Google Scholar
  12. [12]
    Namespaces in XML, Scholar
  13. [13]
    NCSA, Environmental hydrology demo, Scholar
  14. [14]
    C.M. Pancerella, L.A. Rahn and C.L. Yang, The diesel combustion collaboratory: Combustion researchers collaborating over the internet, in: Proceedings of SC 99 (13-19 November 1999), http:// Scholar
  15. [15]
    B. Parvin, J. Taylor, G. Cong, M. O'Keefe and M.-H. Barcellos-Hoff, Deepview: A channel for distributed microscopy and informatics, in: Proceedings of SC 99 (13-19 November 1999), http:// Scholar
  16. [16]
    Simple Object Access Protocol, Scholar
  17. [17]
    P. Widener, K. Schwan and G. Eisenhauer, Open metadata formats for fast communication, Technical Report GIT-CC-00-21, College of Computing, Georgia Institute of Technology, Atlanta, Georgia (2000).Google Scholar
  18. [18]
    XDR: External data representation standard, IETF RFC 1014.Google Scholar
  19. [19]
    Xerces XML Parser, Scholar
  20. [20]
    XML-RPC specification, Scholar
  21. [21]
    XML Schema, Scholar

Copyright information

© Kluwer Academic Publishers 2002

Authors and Affiliations

  • Patrick Widener
    • 1
  • Greg Eisenhauer
    • 1
  • Karsten Schwan
    • 1
  • Fabián E. Bustamante
    • 1
  1. 1.College of ComputingGeorgia Institute of TechnologyAtlantaUSA

Personalised recommendations