Skip to main content

From Static Domains to Graph Decomposition for Heterogeneous Cluster Programming

  • Conference paper
  • First Online:
High Performance Computing on Vector Systems 2009
  • 574 Accesses

Abstract

In this paper we present the development of two finished projects that have given us enough knowledge to begin with the implementation of a middleware application based on the MPI extension. This ongoing project is also presented in this document. This middleware allow us to dynamically generate a set of domains that fits to the problem to be solved on an heterogeneous cluster. The main goal is to adapt the partitioning to dynamic and unpredictable load changes on the nodes. We want to adapt the architecture to the problem and not the problem to the architecture.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Sander, L., Meakin, P., Ramanlal, P., Ball, R.C.: Ballistic deposition on surfaces. Phys. Rev. A 1, 34 (1986)

    Google Scholar 

  2. Krug, J.: The columnar growth angle in obliquely evaporated thin films. Matterwissen Werkstofft. 26, 22–26 (1995)

    Article  Google Scholar 

  3. Vicsek, T.: Fractal Growth Phenomena. World Scientific, Singapore (1989)

    MATH  Google Scholar 

  4. Hara, T.: A stochastic model and the moment dynamics of the growth of amorphous films. J. Theor. Biol. 1, 109 (1984)

    MathSciNet  Google Scholar 

  5. Meakin, P., Krug, J., Kassner, K., Family, F.: Laplacian needle growth. Europhys. Lett. 1, 27 (1993)

    Google Scholar 

  6. Krug, J.: Origins if Scale Invariance in Growth Processes. Taylor & Francis, London (1997)

    Google Scholar 

  7. Oliva, A.I., Anguiano, E., Sacedón, J.L., Aguilar, M., Méndez, J.A., Aznérez, J.A.: Extended statistical analysis of rough growth fronts in gold films prepared by thermal evaporation. Phys. Rev. B 60, 2720–2727 (1999)

    Article  Google Scholar 

  8. Mandelbrot, B.B.: The Fractal Geometry of Nature. Freeman, New York (1982)

    MATH  Google Scholar 

  9. Meakin, P.: Fractals, Scaling & Growth Far from Equilibrium. Cambridge University Press, Cambridge (1998)

    MATH  Google Scholar 

  10. Family, F., Vicsek, T.: Dynamics of Fractal Surfaces. World Scientific, Singapore (1989)

    Google Scholar 

  11. Mullins, W.W.: Solid Surface Morphologies Governed by Capillarity, Metal Surfaces Structure, Energetics and Kinetics. Gjostein, N.A., Robertson, W.D. (1963)

    Google Scholar 

  12. Michely, T., Krug, J.: Islands, Mounds, and Atoms. Patterns and Processes in Crystal Growth Far from Equilibrium. Springer Series in Surface Sciences, vol. 42. Springer, Berlin (2004)

    Google Scholar 

  13. Castañeda-Marroquín, C., Navarrete, C.B., Ortega, A., Alfonseca, M., Anguiano, E.: Parallel Metropolis-Montecarlo simulation for Potts model using an adaptable network topology based on dynamic graph partitioning. In: ISPDC ’08 (2008)

    Google Scholar 

  14. Andrew, R.S.: Reliability in LAM/MPI

    Google Scholar 

  15. Burns, G., Daoud, R., Vaigl, J.: LAM: An open cluster environment for MPI

    Google Scholar 

  16. Forum, M.P.I.: MPI: A message-passing interface standard. Technical Report UT-CS-94-230 (1994)

    Google Scholar 

  17. Mascagni, M., Chi, H.: Parallel linear congruential generators with Sophie-Germain moduli. Parallel Comput. 30(11), 1217–1231 (2004)

    Article  MathSciNet  Google Scholar 

  18. Culler, D.E., Gupta, A., Singh, J.P.: Parallel Computer Architecture: A Hardware/Software Approach. Kaufmann, San Francisco (1997)

    Google Scholar 

  19. Alexander, A., Mark, C., Rejniak, K.A.: Single-Cell-Based Models in Biology and Medicine. Birkhäuser, Basel (2007)

    Google Scholar 

  20. Graner, J.G.F.: Simulation of biological cell sorting using a 2-dimensional extended Potts model. Phys. Rev. Lett. 69(13), 2013–2016 (1992)

    Article  Google Scholar 

  21. Poplawski, N.J., Swat, M., Gens, J.S., Glazier, J.A.: Adhesion between cells, diffusion of growth factors, and elasticity of the aer produce the paddle shape of the chick limb. Phys. A, Stat. Theor. Phys. 373, 521–532 (2007)

    Article  Google Scholar 

  22. Turner, S., Sherratt, J.A.: Intercellular adhesion and cancer invasion: a discrete simulation using the extended Potts model

    Google Scholar 

  23. Rosenbluth, M., Teller, A., Teller, E., Metropolis, N., Rosenbluth, A.: Equation of state calculations by fast computing machines. J. Chem. Phys. 21(13), 1087–1092 (1953)

    Google Scholar 

  24. Chen, N., Glazier, J.A., Izaguirre, J.A., Alber, M.S.: A parallel implementation of the cellular Potts model for simulation of cell-based morphogenesis. Comput. Phys. Commun. 176(11–12), 670–681 (2007)

    Article  Google Scholar 

  25. Cercato, F.P., Mombach, J.C.M., Cavalheiro, G.G.H.: High performance simulations of the cellular Potts model. In: High Performance Computing Systems and Applications, Annual International Symposium on, 0:28 (2006)

    Google Scholar 

  26. Gusatto, E., Mombach, J.C.M., Cercato, F.P., Cavalheiro, G.H.: An efficient parallel algorithm to evolve simulations of the cellular Potts model. Parallel Process. Lett. 15(12), 199–208 (2005)

    Article  MathSciNet  Google Scholar 

  27. Chen, N., Glazier, J.A., Izaguirre, J.A., Alber, M.B.: A parallel implementation of the cellular Potts model for simulation of cell-based morphogenesis. Comput. Phys. Commun. 176(11–12), 670–681 (2007)

    Article  Google Scholar 

  28. Canal, R., Parcerisa, J., Gonzalez, A.: Dynamic cluster assignment mechanisms. In: HPCA, p. 133 (2000)

    Google Scholar 

  29. Bhargava, R., John, L.: Improving dynamic cluster assignment for clustered trace cache processors. Technical report (2003)

    Google Scholar 

  30. Amiri, K., Petrou, D., Ganger, G., Gibson, G.: Dynamic function placement in active storage clusters. Technical report (1999)

    Google Scholar 

  31. Lastovetsky, A.: Scientific programming for heterogene us systems—bridging the gap between algorithms and applications. In: PARELEC’06 IEEE Proceedings, pp. 3–8 (2006)

    Google Scholar 

  32. von Hanxleden, R., Scott, L.R.: Load balancing on message passing architectures. J. Parallel Distrib. Comput. 13(3), 312–324 (1991)

    Article  Google Scholar 

  33. Nicol, D.M., Saltz, J.H.: Dynamic remapping of parallel computations with varying resource demands. IEEE Trans. Comput. 37(9), 1073–1087 (1988)

    Article  Google Scholar 

  34. Kumar, S., Das, S.K., Biswas, R.: Graph partitioning for parallel applications in heterogeneous grid environments. In: IPDPS ’02: Proceedings of the 16th International Symposium on Parallel and Distributed Processing, p. 66 (2002)

    Google Scholar 

  35. Bacigalupo, D.A., Jarvis, S.A., He, L., Spooner, D.P., Nudd, G.R.: Comparing layered queuing and historical performance models of a distributed enterprise application. In: IASTED International Conference on Parallel and Distributed Computing and Networks, pp. 608–613 (2005)

    Google Scholar 

  36. Bacigalupo, D.A., Jarvis, S.A., He, L., Spooner, D., Pelych, D., Nudd, G.R.: A comparative evaluation of two techniques for predicting the performance of dynamic enterprise systems. In: PARCO, pp. 163–170 (2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to C. B. Navarrete .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Navarrete, C.B., Anguiano, E. (2010). From Static Domains to Graph Decomposition for Heterogeneous Cluster Programming. In: Resch, M., Roller, S., Benkert, K., Galle, M., Bez, W., Kobayashi, H. (eds) High Performance Computing on Vector Systems 2009. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03913-3_11

Download citation

Publish with us

Policies and ethics