Skip to main content

Annai: An Integrated Parallel Programming Environment for Multicomputers

  • Chapter
Tools and Environments for Parallel and Distributed Systems

Abstract

We are currently developing an integrated tool environment for multicomputer as part of the Joint CSCS-ETH/NEC Collaboration in Parallel Processing. As we design and implement a sequence of tool prototypes these are used and evaluated by a team of application developers. This close interaction allows rapid feedback, as requests from the application developers for functionality enhancements can be promptly considered for inclusion in future tool designs and prototypes.

Our tool environment, Annai, consists of an extended High Performance Fortran (HPF) compiler, a performance monitor and analyzer, and a source-level debugger for distributed programs, all sharing a common user interface. The recently-defined Message Passing Interface (MPI) serves as our low-level machine interface and allows portability independent of the target hardware architecture. The key features of the tool environment comprise HPF language extensions to allow dynamic data distributions, and support for both high-level data-parallel and low-level message-passing programming paradigms by the interactive debugger and the interactive performance monitor and analyzer. The language extensions are particularly useful for the efficient parallelization of unstructured problems, and they are fully supported by both the debugger and performance analyzer.

To introduce the Annai tool environment, its structure is outlined and the functionality of its components summarized. New features currently in development (since [1]) are highlighted, based on suggestions provided by our pilot users and their experiences using Annai. Finally, an example user session is demonstrated and preliminary performance results presented from two multicomputer.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. C. Clémençon, A. Endo, J. Fritscher, A. Müller, R. Rühl, and B. J. N. Wylie, “The “Annai” Environment for Portable Distributed Parallel Programming,” in Proceedings of the 28th Hawaii International Conference on System Sciences, Volume n, (Maui, Hawaii), pp. 242–251, IEEE Computer Society Press, Jan. 1995, ISBN: 0-8186-6935-7.

    Google Scholar 

  2. High Performance Fortran Forum, “High Performance Fortran Language Specification: Version 1.0,” Scientific Programming, vol. 2, no. 1&2, 1993.

    Google Scholar 

  3. Message Passing Interface Forum, “MPI: A Message-Passing Interface Standard,” Supercomputer Applications and High-Performance Computing, vol. 8, no. 3/4,1994.

    Google Scholar 

  4. D. Y. Cheng, “A Survey of Parallel Programming Languages and Tools,” Tech. Rep. RND-93-005,NASA Ames Research Center, Moffet Field, CA, USA, Mar. 1993.

    Google Scholar 

  5. C. Clémençon, K. M. Decker, A. Endo, J. Fritscher, G. Jost, N. Masuda, A. Müller, R. Rühl, W. Sawyer, E. de Sturler, B. J. N. Wylie, and F. Zimmermann, “Application-Driven Development of an Integrated Tool Environment for Distributed Memory Parallel Processors,” in Proceedings of the 1st International Workshop on Parallel Processing, (Bangalore, India), pp. 110–116, Tata McGraw-Hill Publishing (New Delhi), 1994, ISBN: 0-07-462332-X.

    Google Scholar 

  6. C. Clémençon, K. M. Decker, V. R. Deshpande, A. Endo, J. Fritscher, N. Masuda, A. Müller, R. Rühl, W. Sawyer, B. J. N. Wylie, and F. Zimmermann,’ Tool Supported Development of Parallel Application Kernels,” Tech. Rep. CSCS-TR-95-03, Centro Svizzero di Calcolo Scientifico, CH-6928 Manno, Switzerland, Apr. 1995.

    Google Scholar 

  7. S. Sistare, D. Allen, R. Bowker, K. Jourdenais, J. Simons, and R. Title, “Data Visualization and Performance Analysis in the Prism Programming Environment,” in Programming Environments for Parallel Computing (N. Topham, R. Ibbett, and T. Bemmerl, eds.), pp. 37–52, North-Holland, Apr. 1992.

    Google Scholar 

  8. R. Berrendorf, H. C. Burg, U. Detert, R. Esser, M. Gerndt, and R. Knecht, “Intel Paragon XP/S — Architecture, Software Environment, and Performance,” Tech. Rep. KFA-ZAM-IB-9409, KFA Jülich, D-52425 Jülich, Germany, May 1994.

    Google Scholar 

  9. C. M. Pancake, “Transportable Programs for Parallel and Heterogeneous Systems,” in Proceedings of the 27th Hawaii International Conference on System Sciences (Volume II) (H. El-Rewini and B. D. Shriver, eds.), pp. 581–585, IEEE Computer Society Press, 1994.

    Google Scholar 

  10. B. J. N. Wylie and A. Endo, “Design and Realization of the Annai Integrated Parallel Programming Environment Performance Monitor and Analyzer,” Tech. Rep. CSCS-TR-94-07, Centro Svizzero di Calcolo Scientifico, CH-6928 Manno, Switzerland, Aug. 1994.

    Google Scholar 

  11. A. Müller and R. Rühl, “Extending High Performance Fortran for the Support of Unstructured Computations,” Tech. Rep. CSCS-TR-94-08, Centro Svizzero di Calcolo Scientifico, CH-6928 Manno, Switzerland, 1994. Short version appears in Proceedings of the 9th International Conference on Supercomputing’ 95, (Barcelona, Spain), pp. 127-136, ACM, Jul. 1994, ISBN: 0-89791-728-6.

    Google Scholar 

  12. C. Clémençon, J. Fritscher, and R. Rühl, “Execution Control, Visualization and Replay of Massively Parallel Programs with Annai’s Debugging Tool,” Tech. Rep. CSCS-TR-94-09, Centro Svizzero di Calcolo Scientifico, CH-6928 Manno, Switzerland, 1994. Short version appears in Proceedings of the High Performance Computing Symposium’ 95, (Montréal, Canada), pp. 393-404, IEEE, Jul. 1994, ISBN: 2-921316-12-9.

    Google Scholar 

  13. C. Pommerell and R. Rühl, “Migration of Vectorized Iterative Solvers to Distributed Memory Architectures,” in Preliminary Proceedings of the Colorado Conference on Iterative Methods, (Breckenridge, CO, USA), Apr. 1994.

    Google Scholar 

  14. H. Berryman, J. Saltz, and J. Shroggs, “Execution Time Support for Adaptive Scientific Algorithms on Distributed Memory Architectures,” Concurrency: Practice and Experience, vol. 3, June 1991.

    Google Scholar 

  15. R. Rühl, A Parallelizing Compiler for Distributed-Memory Parallel Processors. PhD thesis, ETH-Zürich, 1992. Published by Hartung-Gorre Verlag, Konstanz, Germany.

    Google Scholar 

  16. I. Beg, W. Ling, A. Müller, P. Przybyszewski, R. Rühl, and W. Sawyer, “PLUMP: Parallel Library for Unstructured Mesh Problems,” Tech. Note SeRD-CSCS-TN-94-12, Centro Svizzero di Calcolo Scientifico, CH-6928 Manno, Switzerland, Sept. 1994. Appears in Proceedings of the Irregular’94 IFIP International Workshop on Parallel Algorithms for Irregularly Structured Problems, (Geneva, Switzerland), Kluwer Academic Publishers, Aug. 1994.

    Google Scholar 

  17. B. Chapman, P. Mehrotra, and H. P. Zima, “Extending HPF for Advanced Data Parallel Applications,” Tech. Rep. TR 94–7, Institute for Software Technology and Parallel Systems, University of Vienna, Austria, 1994.

    Google Scholar 

  18. M. Annaratone, M. Fillo, M. Halbherr, R. Rühl, P. Steiner, and M. Viredaz, “The K2 Distributed Memory Parallel Processor: Architecture, Compiler, and Operating System,” in Proceedings of Supercomputing’ 91, (Albuquerque, NM, USA), ACM-IEEE, Nov. 1991.

    Google Scholar 

  19. R. Das, J. Saltz, and R. von Hanxleden, “Slicing Analysis and Indirect Access to Distributed Arrays,” in Proceedings of the 6th Workshop on Languages and Compilers for Parallel Computing, (Portland, OR, USA), Aug. 1993.

    Google Scholar 

  20. C. Chase and A. Reeves, “Data Remapping for Distributed-Memory Multicomputers,” in Proceedings of the Scalable High Performance Computing Conference, (Williamsburg, VA, USA), pp. 137–144, Apr. 1992.

    Google Scholar 

  21. R. H. B. Netzer and B. P. Miller, “Optimal Tracing and Replay for Debugging Message-Passing Parallel Programs,” in Proceedings of Supercomputing’ 92, (Minneapolis, MN, USA), pp. 502–511, Nov. 1992.

    Google Scholar 

  22. M. T. Heath and J. A. Etheridge, “Visualizing the Performance of Parallel Programs,” IEEE Software, vol. 8, no. 5, pp. 29–39, 1991.

    Article  Google Scholar 

  23. D. H. Bailey, E. Barszcz, L. Dagum, and H. D. Simon, “NAS Parallel Benchmarks Results,” Tech. Rep. RNR-94-006,NASA Ames Research Center, CA, USA, Oct. 1994.

    Google Scholar 

  24. S. Doi, T. Washio, K. Muramatsu, and T. Nakata, “Implementing a CFD Solver on Cenju-3 Parallel Computer,” in Preprints of Parallel CFD’ 94, (Kyoto Institute of Technology, Japan), pp. 31-36, May 1994.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1996 Springer Science+Business Media New York

About this chapter

Cite this chapter

Clémençon, C., Endo, A., Fritscher, J., Müller, A., Rühl, R., Wylie, B.J.N. (1996). Annai: An Integrated Parallel Programming Environment for Multicomputers. In: Zaky, A., Lewis, T. (eds) Tools and Environments for Parallel and Distributed Systems. The Springer International Series in Software Engineering, vol 2. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-4123-3_3

Download citation

  • DOI: https://doi.org/10.1007/978-1-4615-4123-3_3

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4613-6849-6

  • Online ISBN: 978-1-4615-4123-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics