Parallel I/O Support for HPF on Computational Grids

  • Peter Brezany
  • Jonghyun Lee
  • Marianne Winslett
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2327)


Recently several projects have started to implement large-scale high-performance computing on “computational grids” composed of heterogeneous and geographically distributed systems of computers, networks, and storage devices that collectively act as a single “virtual supercomuter”. One of the great challenges for this environment is to provide appropriate high-level programming models. High Performance Fortran (HPF) is a language of choice for development of data parallel components of Grid applications. Another challenge is to provide efficient access to data that is distributed across local and remote Grid resources. In this paper, constructs to specify parallel input and output (I/O) operations on multidimensional arrays on the Grid in the context of HPF are proposed. The paper also presents implementation concepts that are based on the HPF compiler VFC, the parallel I/O runtime system Panda, Internet, and Grid technologies. Preliminary experimental performance results are discussed in the context of a real application example.


Computational Grid Grid Service Grid Application Globus Toolkit Multidimensional Array 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bassow, F.:IBM AIX Parallel I/O File System: Installation, Administration, and Use. IBM, Doc. SH34-6065-00 (1995)Google Scholar
  2. 2.
    Benkner, S., Neuhold, Ch., Egger, M., Sanjari, K., Velkov, B.: VFC-The Vienna HPF+ Compiler. In: Proceedings of the International Conference on Compilers for Parallel Computers, Linkoping (1998)Google Scholar
  3. 3.
    Bester, J., Foster, I., Kesselman, C., Tedesco, J., Tuecke, S.: GASS: A Data Movement and Access Service for Wide Area Computing Systems. In: Proceedings of the 6th Workshop on I/O in Parallel and Distributed Systems (1999)Google Scholar
  4. 4.
    Bordawekar, R.R., Choudhary, A.N.: Language and Compiler Support for Parallel I/O. In: Proceedings of the Working Conference on Programming Environments for Massively Parallel Distributed Systems, Switzerland (1994)Google Scholar
  5. 5.
    Brezany, P., Gerndt, M., Mehrotra, P., Zima, H.: Concurrent File Operations in a High Performance FORTRAN. In: Proceedings of Supercomputing’ 92 (1992) 230–237Google Scholar
  6. 6.
    Brezany, P., Czerwinski, P., Winslett, M.: A Generic Interface for Parallel Access to Large Data Sets from HPF Applications. Future Generation Computer Systems, 17 (2001) 977–985zbMATHCrossRefGoogle Scholar
  7. 7.
    Brezany, P., Winslett, M.: Advanced Data Repository Support for Java Scientific Programming. In: HPCN Europe 1999, Lecture Notes in Computer Science, Vol. 1593, Springer-Verlag, Berlin Heidelberg New York (1999) 1127–1136Google Scholar
  8. 8.
    Carpenter, B., Fox, G.: HPJava: Data Parallel Extensions to Java. In: Proceedings of the ACM Workshop on Java for High-Performance Network Computing, Palo Alto (1998)Google Scholar
  9. 9.
    Chervenak, A., Foster, I., Kesselman, C., Salisbury, C., Tuecke, S.:The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets. Journal of Network and Computer Applications (2001)Google Scholar
  10. 10.
    Choudhary, A. et. al.: PASSION: Parallel and Scalable Software for Input-Output. Technical Report SCCS-636, ECE Department, Syracuse University (1994)Google Scholar
  11. 11.
    Czajkowski, K., Fitzgerald, S., Foster, I., Kesselman, C.: Grid Information Services for Distributed Resource Sharing. In: Proceeding of the International Symposium on High Performance Distributed Computing (2001)Google Scholar
  12. 12.
    Denis, A., Perez, C., Priol, T.: Towards High Performance CORBA and MPI Middlewares for Grid Computing. In: Lee, C.A. (ed.) Grid Computing-GRID 2001, 2nd Int. Workshop, Denver, Lecture Notes in Computer Science, Vol. 2242, Springer Verlag, Berlin Heidelberg New York (2001)Google Scholar
  13. 13.
    Foster, I., Kesselman, C.: Globus: A Metacomputing Infrastructure Toolkit. International Journal on Supercomputer Applications, 2 (1997) 115–128CrossRefGoogle Scholar
  14. 14.
    Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. International Journal on Supercomp. Applications (2001)Google Scholar
  15. 15.
    Foster, I, Kohr, D., Krishnaiyer, R., Mogill, J.: Remote I/O: Fast Access to Distant Storage. In: Proceedings of the 5th Workshop on I/O in Parallel and Distributed Systems (1997) 14–25Google Scholar
  16. 16.
    Global Grid Forum.
  17. 17.
    Globus Project. Globus Toolkit 2.0 Beta Release.
  18. 18.
    Grid Datafarm for Petascale Data Intensive Computing.
  19. 19.
    Grimshaw, A., Wulf, W., French, J., Weaver, A., Reynolds, P.: Legion: The Next Step toward a Nationwide Virtual Computer. Technical Report CS-94-21, Department of Computer Science, University of Virginia (1994)Google Scholar
  20. 20.
    High Performance Fortran Forum: High Performance Fortran. Version 2.0 (1997)Google Scholar
  21. 21.
    HPC++. High-Performance C++.
  22. 22.
    Huber, J., Elford, C.L., Reed, D.A., Chien, A.A., Bhune, S.S.: PPFS: A High-Performance Portable Parallel File System. In: Proceedings of the 9th ICS Conference, Barcelona (1995)Google Scholar
  23. 23.
  24. 24.
    Koppenhoefer, K., Gullerud, A., Ruggieri, C., Dodds, R. Jr.: WARP3D: Dynamic Nonlinear Analysis of Solids Using a Preconditioned Conjugate Gradient Software Architecture. Structural Research Series 596, University of Illinois (1994)Google Scholar
  25. 25.
    Laure, E.: Distributed High Performance Computing with OpusJava. In: Proceedings of the ParCo99 Conference, Delft (1999)Google Scholar
  26. 26.
    Lee, J.: Web-based Data Migration for High-performance Scientific Codes. MS thesis, Department of Computer Science, University of Illinois at Urbana-Champaign (1999)Google Scholar
  27. 27.
    Messina, P.: Distributed Supercomputing Applications. In: Foster, I. Kesselman, C. (eds.), The Grid. Blueprint for a New Computing Infrastructure. Morgan Kaufmann (1999)Google Scholar
  28. 28.
    Metcalf, M., Reid, C.: Fortran 90/95 Explained. Oxford University Press (1996)Google Scholar
  29. 29.
    Moyer, S.A., Sunderam, V.S.: PIOUS: A Scalable Parallel I/O System for Distributed Computing Environment. In: Proceedings of the Scalable High-Performance Computing Conference (1994)Google Scholar
  30. 30.
    Nieplocha, J., Foster, I.: Disk Resident Arrays: An Array-Oriented I/O Library for Out-Of-Core Computations. In: Proceedings of the 6th Symposium on the Frontiers of Massively Parallel Computation, IEEE Computer Society Press, October (1996) 196–204Google Scholar
  31. 31.
    Nieuwejaar, M., Kotz, D.: The Galley Parallel File System. Parallel Computing, North-Holland (Elsevier Scientific) 23 (1997) 447–476zbMATHCrossRefGoogle Scholar
  32. 32.
    Numrich, R.W., Reid, J.K.: Co-Array Fortran for Parallel Programming. ACM Fortran Forum (1998)Google Scholar
  33. 33.
    Oldfield, R.: Summary of Existing and Developing Data Grids. White paper for the Remote Data Access group of the Global Grid Forum 1, Amsterdam (2001)Google Scholar
  34. 34.
    Oldfield, R., Kotz, D.: Armada: A Parallel File System for Computational Grids. In: Proceedings of the International Symposium on Cluster Computing and the Grid, Brisbane, Australia (2001) 194–201Google Scholar
  35. 35.
    OpenMP Consortium: OpenMP Fortran API, version 1.0 (1997)Google Scholar
  36. 36.
    Seamons, K.E., Winslett, M.: Multidimensional Array I/O in Panda 1.0. Journal of Supercomputing 10 (1995) 191–211Google Scholar
  37. 37.
    Segal, B.: Datagrid-Data Management. Deliverable DataGrid-D2.2 (2001)Google Scholar
  38. 38.
    Snir, M.: Proposal for I/O. Posted to HPFF I/O Forum (1992)Google Scholar
  39. 39.
    Stockinger, H.: Database Replication in World-Wide Distributed Data Grids. PhD Thesis, Institute of Computer Science and Business Informatics, University of Vienna, Austria (2001)Google Scholar
  40. 40.
    Thakur, R., Gropp, W., Lusk, E.: On Implementing MPI-IO Portably and with High Performance. In: Proceedings of the 6th Workshop on I/O in Parallel and Distributed Systems, ACM Press, (1999) 23–32Google Scholar
  41. 41.
    Weissman, J.: Smart File Objects: A Remote File Access Paradigm. In: Proceedings of the 6th Workshop on I/O in Parallel and Distributed Systems (1999)Google Scholar
  42. 42.
    Wolski, R., Spring, N., Hayes, J.: The Network Weather Service: A Distributed Resource Performance Forecasting Service for Metacomputing. Journal of Future Generation Computing Systems 15 (1999) 757–768CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Peter Brezany
    • 1
  • Jonghyun Lee
    • 2
  • Marianne Winslett
    • 2
  1. 1.Institute for Software ScienceUniversity of ViennaViennaAustria
  2. 2.Department of Computer ScienceUniversity of IllinoisUrbanaUSA

Personalised recommendations