Improving the Efficiency of Parallel FEM Simulations on Voxel Domains

  • N. Kosturski
  • S. Margenov
  • Y. Vutov
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7116)


In this work, we consider large-scale finite element modeling on voxel grids. We are targeting the IBM Blue Gene/P computer, which features a 3D torus interconnect. Our previous parallelization approach was to divide the domain in one spatial direction only, which lead to limited parallelism. Here, we extend it to all three spatial directions in order to match the interconnect topology.

As a sample problem, we consider the simulation of the thermal and electrical processes, involved in the radio-frequency (RF) ablation procedure. RF ablation is a low invasive technique for the treatment of hepatic tumors, utilizing AC current to destroy the tumor cells by heating. A 3D voxel approach is used for finite element method (FEM) approximation of the involved partial differential equations. After the space discretization, the backward Euler scheme is used for the time stepping.

We study the impact of the domain partitioning on the performance of a parallel preconditioned conjugate gradient (PCG) solver for the arising large linear systems. As a preconditioner, we use BoomerAMG – a parallel algebraic multigrid implementation from the package Hypre, developed in LLNL, Livermore. The implementation is tested on the IBM Blue Gene/P massively parallel computer.


Preconditioned Conjugate Gradient Voxel Grid Preconditioned Conjugate Gradient Iteration Finite Element Method Discretization Linear Finite Element Method 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Axelsson, O.: Iterative Solution Methods. Cambridge University Press (1996)Google Scholar
  2. 2.
    Brenner, S., Scott, L.: The mathematical theory of finite element methods. Texts in applied mathematics, vol. 15. Springer, Heidelberg (1994)zbMATHGoogle Scholar
  3. 3.
    Hairer, E., Norsett, S.P., Wanner, G.: Solving ordinary differential equations I, II. Springer Series in Comp. Math. 2000 (2002)Google Scholar
  4. 4.
    Henson, V.E., Yang, U.M.: BoomerAMG: A parallel algebraic multigrid solver and preconditioner. Applied Numerical Mathematics 41(1), 155–177 (2002)MathSciNetzbMATHCrossRefGoogle Scholar
  5. 5.
    Kosturski, N., Margenov, S.: Supercomputer Simulation of Radio-Frequency Hepatic Tumor Ablation. In: AMiTaNS 2010 Proceedings. AIP CP, vol. 1301, pp. 486–493 (2010)Google Scholar
  6. 6.
    Tungjitkusolmun, S., Staelin, S.T., Haemmerich, D., Tsai, J.Z., Cao, H., Webster, J.G., Lee, F.T., Mahvi, D.M., Vorperian, V.R.: Three-dimensional finite-element analyses for radio-frequency hepatic tumor ablation. IEEE Transactions on Biomedical Engineering 49(1), 3–9 (2002)CrossRefGoogle Scholar
  7. 7.
    Tungjitkusolmun, S., Woo, E.J., Cao, H., Tsai, J.Z., Vorperian, V.R., Webster, J.G.: Thermal-electrical finite element modelling for radio frequency cardiac ablation: Effects of changes in myocardial properties. Medical and Biological Engineering and Computing 38(5), 562–568 (2000)CrossRefGoogle Scholar
  8. 8.
    Lawrence Livermore National Laboratory, Scalable Linear Solvers Project,

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • N. Kosturski
    • 1
  • S. Margenov
    • 1
  • Y. Vutov
    • 1
  1. 1.Institute of Information and Communication TechnologiesBulgarian Academy of SciencesSofiaBulgaria

Personalised recommendations