waLBerla: Optimization for Itanium-based Systems with Thousands of Processors

  • S. Donath
  • J. Götz
  • C. Feichtinger
  • K. Iglberger
  • U. Rüde
Conference paper


Performance optimization is an issue at different levels, in particular for computing and communication intensive codes like free surface lattice Boltzmann. This method is used to simulate liquid-gas flow phenomena such as bubbly flows and foams. Due to a special treatment of the gas phase, an aggregation of bubble volume data is necessary in every time step. In order to accomplish efficient parallel scaling, the all-to-all communication schemes used up to now had to be replaced with more sophisticated patterns that work in a local vicinity. With this approach, scaling could be improved such that simulation runs on up to 9 152 processor cores are possible with more than 90% efficiency. Due to the computation of surface tension effects, this method is also computational intensive. Therefore, also optimization of single core performance plays a tremendous role. The characteristics of the Itanium processor require programming techniques that assist the compiler in efficient code vectorization, especially for complex C++ codes like the waLBerla framework. An approach using variable length arrays shows promising results.


Lattice Boltzmann Method Bubble Coalescence Code Vectorization Lattice Boltzmann Equation D3Q19 Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Donath, S., Feichtinger, C., Götz, J., Deserno, F., Iglberger, K., Rüde, U.: waLBerla: On implementation details of a localized parallel algorithm for bubble coalescence. Tech. Rep. 09-3, Computer Science Department 10 (System Simulation), University of Erlangen-Nuremberg (2009) Google Scholar
  2. 2.
    Feichtinger, C., Götz, J., Donath, S., Iglberger, K., Rüde, U.: Concepts of waLBerla Prototype 0.1. Tech. Rep. 07–10, Computer Science Department 10 (System Simulation), University of Erlangen-Nuremberg (2007) Google Scholar
  3. 3.
    Götz, J., Feichtinger, C., Iglberger, K., Donath, S., Rüde, U.: Large scale simulation of fluid structure interaction using lattice Boltzmann methods and the ‘physics engine’. In: G.N. Mercer, A.J. Roberts (eds.) Proceedings of CTAC 2008, ANZIAM J., vol. 50, pp. C166–C188 (2008) Google Scholar
  4. 4.
    Hänel, D.: Molekulare Gasdynamik. Springer (2004) Google Scholar
  5. 5.
    He, X., Luo, L.S.: Theory of the lattice Boltzmann method: From the Boltzmann equation to the lattice Boltzmann equation. Phys. Rev. E 56(6), 6811–6817 (1997). DOI  10.1103/PhysRevE.56.6811 CrossRefGoogle Scholar
  6. 6.
    Information on the HLRB. (2007)
  7. 7.
    Körner, C., Thies, M., Hofmann, T., Thürey, N., Rüde, U.: Lattice Boltzmann Model for Free Surface Flow for Modeling Foaming. Journal of Statistical Physics 121(1-2), 179–196 (2005). zbMATHCrossRefMathSciNetGoogle Scholar
  8. 8.
    Körner, C., Thies, M., Singer, R.F.: Modeling of metal foaming with lattice Boltzmann automata. Adv. Eng. Mat. 4, 765–769 (2002) CrossRefGoogle Scholar
  9. 9.
    Mei, R., Shyy, W., Yu, D., Luo, L.S.: Lattice Boltzmann Method for 3-D Flows with Curved Boundary. J. Comp. Phys. 161, 680–699 (2000) zbMATHCrossRefGoogle Scholar
  10. 10.
    Parker, B.J., Youngs, D.L.: Two and three dimensional Eulerian simulation of fluid flow with material interfaces. Tech. Rep. 01/92, UK Atomic Weapons Establishment, Berkshire (1992) Google Scholar
  11. 11.
    Pohl, T.: High Performance Simulation of Free Surface Flows Using the Lattice Boltzmann Method. Ph.D. thesis, Univ. of Erlangen (2008) Google Scholar
  12. 12.
    Succi, S.: The Lattice Boltzmann Equation – For Fluid Dynamics and Beyond. Clarendon Press (2001) Google Scholar
  13. 13.
    Thürey, N., Rüde, U.: Free surface lattice-Boltzmann fluid simulations with and without level sets. pp. 199–208. VMV, IOS Press (2004) Google Scholar
  14. 14.
    Wellein, G., Zeiser, T., Hager, G., Donath, S.: On the single processor performance of simple lattice boltzmann kernels. Computers & Fluids 35(8–9), 910–919 (2006) zbMATHCrossRefGoogle Scholar
  15. 15.
    Yu, D., Mei, R., Luo, L.S., Shyy, W.: Viscous flow computation with method of lattice Boltzmann equation. Progress in Aerospace Sciences 39(5), 329–367 (2003) CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • S. Donath
    • 1
  • J. Götz
    • 1
  • C. Feichtinger
    • 1
  • K. Iglberger
    • 1
  • U. Rüde
    • 1
  1. 1.Computer Science Department 10 (System Simulation)University of Erlangen-NurembergErlangenGermany

Personalised recommendations