Skip to main content

CPU–GPU mixed implementation of virtual node method for real-time interactive cutting of deformable objects using OpenCL

International Journal of Computer Assisted Radiology and Surgery volume 10, pages 1477–1491 (2015)Cite this article

Abstract

Purpose

Surgical simulators need to simulate interactive cutting of deformable objects in real time. The goal of this work was to design an interactive cutting algorithm that eliminates traditional cutting state classification and can work simultaneously with real-time GPU-accelerated deformation without affecting its numerical stability.

Methods

A modified virtual node method for cutting is proposed. Deformable object is modeled as a real tetrahedral mesh embedded in a virtual tetrahedral mesh, and the former is used for graphics rendering and collision, while the latter is used for deformation. Cutting algorithm first subdivides real tetrahedrons to eliminate all face and edge intersections, then splits faces, edges and vertices along cutting tool trajectory to form cut surfaces. Next virtual tetrahedrons containing more than one connected real tetrahedral fragments are duplicated, and connectivity between virtual tetrahedrons is updated. Finally, embedding relationship between real and virtual tetrahedral meshes is updated. Co-rotational linear finite element method is used for deformation. Cutting and collision are processed by CPU, while deformation is carried out by GPU using OpenCL.

Results

Efficiency of GPU-accelerated deformation algorithm was tested using block models with varying numbers of tetrahedrons. Effectiveness of our cutting algorithm under multiple cuts and self-intersecting cuts was tested using a block model and a cylinder model. Cutting of a more complex liver model was performed, and detailed performance characteristics of cutting, deformation and collision were measured and analyzed.

Conclusions

Our cutting algorithm can produce continuous cut surfaces when traditional minimal element creation algorithm fails. Our GPU-accelerated deformation algorithm remains stable with constant time step under multiple arbitrary cuts and works on both NVIDIA and AMD GPUs. GPU–CPU speed ratio can be as high as 10 for models with 80,000 tetrahedrons. Forty to sixty percent real-time performance and 100–200 Hz simulation rate are achieved for the liver model with 3,101 tetrahedrons. Major bottlenecks for simulation efficiency are cutting, collision processing and CPU–GPU data transfer. Future work needs to improve on these areas.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

43,34 €

Price includes VAT (Finland)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

References

  1. Zerbato D, Baschirotto D, Baschirotto D, Botturi D, Fiorini P (2011) GPU-based physical cut in interactive haptic simulations. Int J Comput Assist Radiol Surg 6(2):265–272

    Article  PubMed  Google Scholar 

  2. Cotin S, Delingette H, Ayache N (1999) Real-time elastic deformations of soft tissues for surgical simulation. IEEE Trans Vis Comput Graph 5(1):62–73

    Article  Google Scholar 

  3. Cotin S, Delingette H, Ayache N (2000) A hybrid elastic model allowing real time cutting, deformations and force-feedback for surgery training and simulation. Vis Comput 16(8):437–452

    Article  Google Scholar 

  4. Müller M, Dorsey J, McMillan L, Jagnow R, Cutler B (2002) Stable real-time deformations. In: Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on computer animation, pp 49–54

  5. Müller M, Hennix BHM, Ratcliff J (2006) Position based dynamics. In: Proceedings of virtual reality interactions and physical simulations, pp 71–80

  6. Bender J, Koschier D, Charrier P, Weber D (2014) Position-based simulation of continuous materials. Comput Graph 44:1–10

    Article  Google Scholar 

  7. Becker M, Ihmsen M, Teschner M (2009) Corotated SPH for deformable solids. In: Proceedings of the fifth eurographics conference on natural phenomena, pp 27–34

  8. Steinemann D, Otaduy MA, Gross M (2009) Splitting meshless deforming objects with explicit surface tracking. Graph Models 71(6):209–220

    Article  Google Scholar 

  9. Pietroni N, Ganovelli F, Cignoni P, Scopigno R (2009) Splitting cubes—a fast and robust technique for virtual cutting. Vis Comput 25(3):227–239

    Article  Google Scholar 

  10. Taylor ZA, Comas O, Cheng M, Passenger J, Hawkes DJ, Atkinson D, Ourselin S (2009) On modelling of anisotropic viscoelasticity for soft tissue simulation: numerical solution and GPU execution. Med Image Anal 13(2):234–244

    CAS  Article  PubMed  Google Scholar 

  11. Joldes GR, Wittek A, Miller K (2010) Real-time nonlinear finite element computations on GPU—application to neurosurgical simulation. Comput Methods Appl Mech Eng 199(49–52):3305–3314

    PubMed Central  Article  PubMed  Google Scholar 

  12. Dick C, Georgii J, Westermann R (2011) A real-time multigrid finite hexahedra method for elasticity simulation using CUDA. Simul Model Pract Theory 19(2):801–816

    Article  Google Scholar 

  13. LeBlanc S, Boyer P, Joslin C (2014) Modelling and animation of impact and damage with smoothed particle hydrodynamics. Vis Comput 30(6–8):909–917

    Article  Google Scholar 

  14. Wu J, Westermann R, Dick C (2014) Physically-based simulation of cuts in deformable bodies: a survey. Eurographics 2014 State-of-the-Art Report, pp 1–19

  15. Bielser D, Maiwald VA, Gross MH (1999) Interactive cuts through 3-dimensional soft tissue. Comput Graph Forum 18(3):31–38

    Article  Google Scholar 

  16. Bielser D, Gross MH (2000) Interactive simulation of surgical cuts. In: Proceedings of pacific graphics, pp 116–125

  17. Mor AB (2001) Progressive cutting with minimal new element creation of soft tissue models for interactive surgical simulation. Doctoral dissertation. Robotics Institute, Carnegie Mellon University

  18. Steinemann D, Harders M, Gross M, Szekely G (2006) Hybrid cutting of deformable solids. In: Proceedings of IEEE conference on virtual reality, pp 35–42

  19. Bielser D, Glardon P, Teschner M, Gross M (2004) A state machine for real-time cutting of tetrahedral meshes. Graph Models 66(6):398–417

    Article  Google Scholar 

  20. Zhang J, Gu L, Li X, Fang M (2009) An advanced hybrid cutting method with an improved state machine for surgical simulation. Comput Medical Imaging Graph 33(1):63–71

    Article  Google Scholar 

  21. Metzger MC, Gissler M, Asal M, Teschner M (2009) Simultaneous cutting of coupled tetrahedral and triangulated meshes and its application in orbital reconstruction. Int J Comput Assist Radiol Surg 4(5):409–416

    Article  PubMed  Google Scholar 

  22. Molino N, Bao Z, Fedkiw R (2004) A virtual node algorithm for changing mesh topology during simulation. In: ACM transactions on graphics—proceedings of the 2004 SIGGRAPH conference 2004, vol 23(3), pp 385–392

  23. Sifakis E, Der KG, Fedkiw R (2007) Arbitrary cutting of deformable tetrahedralized objects. In: Proceedings of the 2007 ACM SIGGRAPH/Eurographics symposium on computer animation, pp 73–80

  24. Jeřábková L, Kuhlen T (2009) Stable cutting of deformable objects in virtual environments using xfem. IEEE Comput Graph Appl 29(2):61–71

    Article  PubMed  Google Scholar 

  25. Turkiyyah GM, Karam WB, Ajami Z, Nasri A (2011) Mesh cutting during real-time physical simulation. Comput Aided Des 43(7):809–819

    Article  Google Scholar 

  26. Kaufmann P, Martin S, Botsch M, Grinspun E, Gross M (2009) Enrichment textures for detailed cutting of shells. In: ACM transactions on graphics—proceedings of ACM SIGGRAPH 2009, vol 28(3), pp 50:1–50:10

  27. Jeřábková L, Bousquet G, Barbier S, Faure F, Allard J (2010) Volumetric modeling and interactive cutting of deformable bodies. Prog Biophys Mol Biol 103(2–3):217–224

    Article  PubMed  Google Scholar 

  28. Dick C, Georgii J, Westermann R (2011) A hexahedral multigrid approach for simulating cuts in deformable objects. IEEE Trans Vis Comput Graph 17(11):1663–1675

  29. Seiler M, Steinemann D, Spillmann J, Harders M (2011) Robust interactive cutting based on an adaptive octree simulation mesh. Vis Comput 27(6–8):519–529

    Article  Google Scholar 

  30. Wu J, Dick C, Westermann R (2013) Efficient collision detection for composite finite element simulation of cuts in deformable bodies. Vis Comput 29(6–8):739–749

    Article  Google Scholar 

  31. Wu W, Heng PA (2005) An improved scheme of an interactive finite element model for 3D soft-tissue cutting and deformation. Vis Comput 21(8–10):707–716

    Article  Google Scholar 

  32. Courtecuisse H, Jung H, Allard J, Duriez C, Lee DY, Cotin S (2010) GPU-based real-time soft tissue deformation with cutting and haptic feedback. Prog Biophys Mol Biol 103(2–3):159–168

    Article  PubMed  Google Scholar 

  33. Teschner M, Heidelberger B, Mueller M, Pomeranets D, Gross M (2003) Optimized spatial hashing for collision detection of deformable objects. In: Proceedings of vision, modeling, and visualization, pp 47–54

  34. Heidelberger B, Teschner M, Keiser R, Mueller M, Gross M (2004) Consistent penetration depth estimation for deformable collision response. In: Proceedings of vision, modeling, and visualization, pp 339–346

  35. Jean-Marc S, Marc D, Denis R, Christian M, Denis L (2005) Modelling liver tissue properties using a non-linear visco-elastic model. Med Image Anal 9(2):103–112

    Article  Google Scholar 

Download references

Acknowledgments

The work described in this paper is supported by the Science and Technology Development Programme of Shandong Province (Grant No. 2014GGX101048) and the Natural Science Foundation of China (Grant No. 61303078).

Conflict of interest

None.

Author information

Affiliations

  1. College of Information Engineering, Qingdao University, Qingdao, 266071, Shandong, People’s Republic of China

    Shiyu Jia, Weizhong Zhang, Xiaokang Yu & Zhenkuan Pan

Authors
  1. Shiyu Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Weizhong Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaokang Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhenkuan Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shiyu Jia.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 2 (mpg 13260 KB)

Supplementary material 3 (mpg 6034 KB)

Supplementary material 1 (txt 24 KB)

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Jia, S., Zhang, W., Yu, X. et al. CPU–GPU mixed implementation of virtual node method for real-time interactive cutting of deformable objects using OpenCL. Int J CARS 10, 1477–1491 (2015). https://doi.org/10.1007/s11548-014-1147-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-014-1147-0

Keywords

  • Surgical simulation
  • Deformable object
  • Interactive cutting
  • Virtual node method
  • GPU acceleration
  • OpenCL