MPI Applications on Grids: A Topology Aware Approach

  • Camille Coti
  • Thomas Herault
  • Franck Cappello
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5704)


Porting on grids complex MPI applications involving collective communications requires significant program modification, usually dedicated to a single grid structure. The difficulty comes from the mismatch between programs organizations and grid structures: 1) large grids are hierarchical structures aggregating parallel machines through an interconnection network, decided at runtime and 2) the MPI standard does not currently provide any specific information for topology-aware applications, so almost all MPI applications have been developed following a non-hierarchical and non-flexible vision. In this paper, we propose a generic programming method and a modification of the MPI runtime environment to make MPI applications topology aware. In contrary to previous approaches, topology requirements for the application are given to the grid scheduling system, which exposes the compatible allocated topology to the application.


Parallel Machine Message Passing Interface Virtual Topology Collective Communication Physical Topology 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Atanassov, E.I., Gurov, T.V., Karaivanova, A., Nedjalkov, M.: Monte carlo grid application for electron transport. In: Alexandrov, V.N., van Albada, G.D., Sloot, P.M.A., Dongarra, J. (eds.) ICCS 2006. LNCS, vol. 3993, pp. 616–623. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  2. 2.
    Barnett, M., Gupta, S., Payne, D.G., Shuler, L., van de Geijn, R., Watts, J.: Building a high-performance collective communication library. In: Proc. of SC 1994, pp. 107–116. IEEE, Los Alamitos (1994)Google Scholar
  3. 3.
    Boutammine, S., Millot, D., Parrot, C.: An adaptive scheduling method for grid computing. In: Nagel, W.E., Walter, W.V., Lehner, W. (eds.) Euro-Par 2006. LNCS, vol. 4128, pp. 188–197. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  4. 4.
    Branford, S., Sahin, C., Thandavan, A., Weihrauch, C., Alexandrov, V.N., Dimov, I.T.: Monte carlo methods for matrix computations on the grid. Future Gener. Comput. Syst. 24(6), 605–612 (2008)CrossRefGoogle Scholar
  5. 5.
    Cappello, F., Caron, E., Dayde, M., et al.: Grid’5000: A large scale and highly reconfigurable grid experimental testbed. In: Proc. The 6th Intl. Workshop on Grid Computing, pp. 99–106 (2005)Google Scholar
  6. 6.
    Cappello, F., Fraigniaud, P., Mans, B., Rosenberg, A.L.: HiHCoHP: Toward a realistic communication model for hierarchical hyperclusters of heterogeneous processors. In: Proc. of IPDPS. IEEE, Los Alamitos (2001)Google Scholar
  7. 7.
    Charlot, M., De Fabritis, G., Garcia de Lomana, A.L., Gomez-Garrido, A., Groen, D., et al.: The QosCosGrid project. In: Ibergrid 2007 conference, Centro de Supercomputacion de Galicia (2007)Google Scholar
  8. 8.
    Coti, C., Herault, T., Peyronnet, S., Rezmerita, A., Cappello, F.: Grid services for MPI. In: Proc. of CCGRID, pp. 417–424. IEEE, Los Alamitos (2008)Google Scholar
  9. 9.
    Foster, I.T.: Globus toolkit version 4: Software for service-oriented systems. J. Comput. Sci. Technol. 21(4), 513–520 (2006)CrossRefGoogle Scholar
  10. 10.
    Gabriel, E., Resch, M.M., Beisel, T., Keller, R.: Distributed computing in a heterogeneous computing environment. In: Alexandrov, V.N., Dongarra, J. (eds.) PVM/MPI 1998. LNCS, vol. 1497, pp. 180–187. Springer, Heidelberg (1998)CrossRefGoogle Scholar
  11. 11.
    Gropp, W., Lusk, E., Doss, N., Skjellum, A.: High-performance, portable implementation of the MPI message passing interface standard. Parallel Computing 22(6), 789–828 (1996)CrossRefzbMATHGoogle Scholar
  12. 12.
    Grunberg, M., Genaud, S., Mongenet, C.: Parallel seismic ray tracing in a global earth model. In: Proc. of PDPTA, vol. 3, pp. 1151–1157. CSREA Press (2002)Google Scholar
  13. 13.
    Karonis, N.T., de Supinski, B.R., Foster, I., Gropp, W., Lusk, E., Bresnahan, J.: Exploiting hierarchy in parallel computer networks to optimize collective operation performance. In: Proc. of SPDP, pp. 377–386. IEEE, Los Alamitos (2000)Google Scholar
  14. 14.
    Karonis, N.T., Toonen, B.R., Foster, I.T.: MPICH-G2: A grid-enabled implementation of the message passing interface. In: CoRR, cs.DC/0206040 (2002)Google Scholar
  15. 15.
    Kielmann, T., Hofman, R.F.H., Bal, H.E., Plaat, A., Bhoedjang, R.A.F.: MAGPIE: MPI’s collective communication operations for clustered wide area systems. In: Proc. of PPoPP. ACM Sigplan, vol. 34.8, pp. 131–140. ACM Press, New York (1999)Google Scholar
  16. 16.
    Kravtsov, V., Carmeli, D., Schuster, A., Yoshpa, B., Silberstein, M., Dubitzky, W.: Quasi-opportunistic supercomputing in grids, hot topic paper. In: Proc. of HPDC (2007)Google Scholar
  17. 17.
    Kravtsov, V., Swain, M., Dubin, U., Dubitzky, W., Schuster, A.: A fast and efficient algorithm for topology-aware coallocation. In: Bubak, M., van Albada, G.D., Dongarra, J., Sloot, P.M.A. (eds.) ICCS 2008, Part I. LNCS, vol. 5101, pp. 274–283. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  18. 18.
    Matsuda, M., Kudoh, T., Kodama, Y., Takano, R., Ishikawa, Y.: TCP adaptation for MPI on long-and-fat networks. In: Proc. of CLUSTER, pp. 1–10. IEEE, Los Alamitos (2005)Google Scholar
  19. 19.
    Nascimento, P., Sena, C., da Silva, J., Vianna, D., Boeres, C., Rebello, V.: Managing the execution of large scale mpi applications on computational grids. In: Proc. of SBAC-PAD, pp. 69–76 (2005)Google Scholar
  20. 20.
    Rabenseifner, R.: Optimization of collective reduction operations. In: Bubak, M., van Albada, G.D., Sloot, P.M.A., Dongarra, J. (eds.) ICCS 2004. LNCS, vol. 3036, pp. 1–9. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  21. 21.
    Thain, D., Tannenbaum, T., Livny, M.: Condor and the grid. In: Grid Computing: Making the Global Infrastructure a Reality. John Wiley & Sons Inc., Chichester (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Camille Coti
    • 1
  • Thomas Herault
    • 1
    • 2
  • Franck Cappello
    • 1
  1. 1.INRIAOrsayFrance
  2. 2.Univ Paris Sud, LRIOrsayFrance

Personalised recommendations