Abstract
For image registration of breast MRI and X-ray mammography we apply detailed biomechanical models. Synthesizing X-ray mammograms from these models is an important processing step for optimizing registration parameters and deriving images for multi-modal diagnosis. A fast computation time for creating synthetic images is essential to enable a clinically relevant application. In this paper we present a method to create synthetic X-ray attenuation images with an hardware-optimized ray tracing algorithm on recent graphics processing units’ (GPU) ray tracing (RT) cores. The ray tracing algorithm is able to calculate the attenuation of the X-rays by tracing through a triangular polygon-mesh. We use the Vulkan API, which enables access to RT cores. One frame for a triangle mesh with over 5 million triangles in the mesh and a detector resolution of \(1080\times 1080\) can be calculated and transferred to and from the GPU in about 0.76 s on NVidia RTX 2070 Super GPU. Calculation duration of an interactive application without the transfer overhead allows real time application with more than 30 frames per second (fps) even for very large polygon models. The presented method is able to calculate synthetic X-ray images in a short time and has the potential for real-time applications. Also it is the very first implementation using RT cores for this purpose. The toolbox will be available as an open source.
Keywords
- X-ray simulation
- Ray tracing
- GPU
- Triangular mesh
- Multi-modal image registration
- Bio-mechanical Model
This is a preview of subscription content, access via your institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Fang, Q., Boas, D.A.: Tetrahedral mesh generation from volumetric binary and grayscale images. In: 2009 IEEE ISBI: From Nano to Macro, pp. 1142–1145 (2009). https://doi.org/10.1109/ISBI.2009.5193259
Folkerts, M., Jia, X., Gu, X., Choi, D., Majumdar, A., Jiang, S.: MO-FF-A4-05: implementation and evaluation of various DRR algorithms on GPU. Med. Phys. 37(6Part6), 3367 (2010). https://doi.org/10.1118/1.3469159
Hanke, R., Fuchs, T., Uhlmann, N.: X-ray based methods for non-destructive testing and material characterization. Nucl. Instrum. Methods Phys. Res. 591(1), 14–18 (2008). https://doi.org/10.1016/j.nima.2008.03.016
Hopp, T., et al.: Automatic multimodal 2D/3D breast image registration using biomechanical FEM models and intensity-based optimization. Med. Image Anal. 17(2), 209–218 (2013). https://doi.org/10.1016/j.media.2012.10.003
Hopp, T., Baltzer, P., Dietzel, M., Kaiser, W.A., Ruiter, N.V.: 2D/3D image fusion of X-ray mammograms with breast MRI: visualizing dynamic contrast enhancement in mammograms. IJCARS 7(3), 339–348 (2012). https://doi.org/10.1007/s11548-011-0623-z
Lickteig, S.: Segmentierung & Visualisierung von Blutgefößen, Seminar paper, University of Cooperative Education, Karlsruhe (2021)
Oliveira, F.P.M., Tavares, J.M.R.S.: Medical image registration: a review. CMBBE 17(2), 73–93 (2014). https://doi.org/10.1080/10255842.2012.670855
Rineau, L., Yvinec, M.: 3D Surface Mesh Generation (2008). https://doc.cgal.org/latest/Surface_mesher/index.html. Accessed 26 July 2021
Rueckert, D., Schnabel, J.A.: Medical image registration. In: Deserno, T.M. (ed.) Biomedical Image Processing. BIOMEDICAL, pp. 131–154. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-15816-2_5
Said, S., Clauser, P., Ruiter, N.V., Baltzer, P.A.T., Hopp, T.: Image registration between MRI and spot mammograms for X-ray guided stereotactic breast biopsy: preliminary results. In: Linte, C.A., Siewerdsen, J.H. (eds.) Medical Imaging 2021: Image-Guided Procedures, Robotic Interventions, and Modeling, p. 45. SPIE (15022021–20022021). https://doi.org/10.1117/12.2581820
Si, H., Gärtner, K.: Meshing piecewise linear complexes by constrained delaunay tetrahedralizations. In: Hanks, B.W. (ed.) Proceedings of the 14th International Meshing Roundtable, pp. 147–163. Springer, Heidelberg (2005). https://doi.org/10.1007/3-540-29090-7_9
Vidal, F.P., Garnier, M., Freud, N., Létang, J.M., John, N.W.: Simulation of X-ray attenuation on the GPU. In: Tang, W., Collomosse, J. (eds.) Theory and Practice of Computer Graphics. The Eurographics Association (2009). https://doi.org/10.2312/LocalChapterEvents/TPCG/TPCG09/025-032
Vidal, F.P., Villard, P.F.: Development and validation of real-time simulation of X-ray imaging with respiratory motion. CMIG 49, 1–15 (2016). https://doi.org/10.1016/j.compmedimag.2015.12.002
Vulkan: Home—Vulkan—Cross platform 3D Graphics (2021). https://www.vulkan.org/. Accessed 20 May 2021
Willems, Sascha: SaschaWillems/Vulkan Examples (28052021). https://github.com/SaschaWillems/Vulkan. Accessed 28 May 2021
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Maul, J., Said, S., Ruiter, N., Hopp, T. (2021). X-ray Synthesis Based on Triangular Mesh Models Using GPU-Accelerated Ray Tracing for Multi-modal Breast Image Registration. In: Svoboda, D., Burgos, N., Wolterink, J.M., Zhao, C. (eds) Simulation and Synthesis in Medical Imaging. SASHIMI 2021. Lecture Notes in Computer Science(), vol 12965. Springer, Cham. https://doi.org/10.1007/978-3-030-87592-3_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-87592-3_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87591-6
Online ISBN: 978-3-030-87592-3
eBook Packages: Computer ScienceComputer Science (R0)
-
Published in cooperation with
http://miccai.org/
