Skip to main content
SpringerLink
Log in

Visual-motor control methods for interactive real-time MRI-cardiac imaging

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The purpose of this study was to evaluate and compare three kinds of scan plane manipulation tools for real-time magnetic resonance imaging (MRI). The first one was a Line-Projection tool which was clinically used on a General Electric’s MRI system (Signa™) in its real-time imaging mode. The second one was called rtViewer, which was a custom designed tri-planner graphical user interface for volumetric image visualization. The third kind, using a Plane Navigator (PN) as a representative, was an arm-like mechanical armature with coordinated 6-degree-of-freedom (DoF) input capability. Two usability experiments were conducted to compare their effects in a simulated interactive MRI setting. Twelve cardiac practitioners were recruited to prescribe diagnostic views of a familiar object, i.e., a beating heart, and to prescribe an unfamiliar object, i.e., a custom designed phantom. Results indicated that the coordinated 6-DoF Plane Navigator outperformed both the Line-Projection tool and rtViewer in terms of task completion time and accuracy for prescribing both simple and complex views, though rtViewer performed best for through plane translation. The Plane Navigator saved about 50% of the time needed by the Line-Projection tool or rtViewer for prescribing unfamiliar double-oblique phantom views. Thanks to its desirable features including coordinated 6-DoF input, rich kinesthetic feedback, visual cue, and stay-put due to its static balance, the Plane Navigator tool may be used to manipulate the scan plane for fast visualization of a dynamic beating heart during real-time cardiac MRI and for the visualization of a surgical tool during an interventional MRI-guided minimum invasive surgery, or for interactive visualization of large-sized volumetric dataset including pre-acquired medical volumetric images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Caputo FM, Emporio M, Giachetti A (2018) The smart pin: An effective tool for object manipulation in immersive virtual reality environments. Comput Graph-UK 74:225–233

  2. Debbins JP, SJRPD, Rossman PJ, Grimm RC, Felmlee JP, Breen JF, Ehman RL (1996) Cardiac magnetic resonance fluoroscopy. Magn Reson Med 36:588–595

    Article  Google Scholar 

  3. Dirk Voit SZ, Unterberg-Buchwald C, Sohns JM, Lotz J, Frahm J (2013) Real-time cardiovascular magnetic resonance at 1.5 T using balanced SSFP and 40 ms resolution. J Cardiovasc Magn Reson 15(1)

  4. DiMaio SP SE, Fischer G, Iordachita I, Fichtinger G, Jolesz F, Tempany CM (2007) Dynamic MRI scan plane control for passive tracking of instruments and devices. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, p 50–58

  5. Douglas P, Perrin NVV, Novotny P, Stoll J, Howe RD, Dupont PE, Salgo IS, del Nido PJ (2009) Image guided surgical interventions current problems in surgery 46(9):730–766

    Google Scholar 

  6. Gobbi DG, Peters TM (2003) Generalized 3D nonlinear transformations for medical imaging: an object-oriented implementation in VTK. Comput Med Imaging Graph 27(4):255–265

  7. Hayward VaG, Astley O (1998) Freedom-7: A high fidelity seven axis haptic device with application to surgical training. experimental robotics V. Casals A, de Almeida AT (eds) Lecture Notes in Control and Information Science 232, 445–456

  8. Hernoux F, Christmann O (2015) A seamless solution for 3D real-time interaction: design and evaluation. Virtual Reality 19(1):1–20

    Article  Google Scholar 

  9. Kerr A, Pauly JM, Hu BS, Li KC, Hardy CJ, Meyer CH, Macovski A, Nishimura DG (1997) Real-time interactive MRI on a conventional scanner. Magn Reson Med 38(3):355–367

    Article  Google Scholar 

  10. Kim HSS, Mechatronics (2014) Multi-DoF counterbalance mechanism for a service robot arm. IEEE/ASME Trans PP(99):1–8

    Google Scholar 

  11. Kim M et al (2020) Inside-reachable and see-through augmented reality Shell for 3D visualization and tangible interaction. Multimed Tools Appl 79(9–10):5941–5963

    Article  Google Scholar 

  12. Krishna S, Nayak PaBSH (2005) The future of real-time cardiac magnetic resonance imaging. Curr Cardiol Rep 7:7

    Google Scholar 

  13. Liu Y, Nie L, Han L, Zhang L, Rosenblum DS (2015) Action2Activity: recognizing complex activities from sensor data. in IJCAI’15. Proceedings of the 24th International Conference on Artificial Intelligence, July pp 1617–1623

  14. Lo J, MJ, Wedlake C, Guiraudon G, Eagleson R, Peters T (2009) Surgeon-controlled visualization techniques for virtual reality-guided cardiac surgery. Stud Health Technol Inform 142:162

  15. Moore JT, Kiaii CM, Bainbridge B, Guiraudon D, Wedlake G, Currie C, Rajchl M, Patel M, TM P (2013) A navigation platform for guidance of beating heart transapical mitral valve repair. IEEE Trans Biomed Eng Spec Issue Surg Robot 60:1034

    Article  Google Scholar 

  16. Paul J et al (2016) Realtime cardiac function using compressed sensing: initial clinical evaluation. J Cardiovasc Magn Reson 18(1):Q1

    Article  Google Scholar 

  17. Peters T (2006) Image-guidance for surgical procedures. Phys Med Biol 51(14):R505–R540

    Article  Google Scholar 

  18. Radau PaH, Stainsby J, Wright GA (2004) Visualization system for real-time scan plane and catheter navigation. In: 12th Scientific Meeting and Exhibition of the International Society for Magnetic Resonance in Medicine

  19. Rogers T et al (2015) Realtime MR guided endomyocardial biopsy with an active visualization bioptome. J Cardiovasc Magn Reson 17(1):P235

    Article  Google Scholar 

  20. Salerno M et al (2017) Recent advances in cardiovascular magnetic resonance techniques and applications. Circ Cardiovasc Imaging 10(6)

  21. Sohns JM et al (2013) Real-time cardiac phase contrast MRI blood flow including Valsalva and Mueller maneuver. Initial experiences. J Cardiovasc Magn Reson 15(1):E17

    Article  Google Scholar 

  22. Teistler M, Breiman RS, Bott OJ, Pretschner DP, Aziz A, Nowinski WL (2008) Simplifying the exploration of voluketric images: Development of a 3D user interface for the Radiologist’s Workplace. J Digit Imaging 21(Suppl 1):S2-s12

  23. Wacker FK, Hillenbrand ED, Duerk CM, Lewin JL (2004) The catheter-driven MRI scanner: a new approach to intravascular catheter tracking and imaging-parameter adjustment for interventional MRI. AJR Am J Roentgenol 183(2):5

    Article  Google Scholar 

  24. Walczak P et al (2017) Real-time MRI for precise and predictable intra-arterial stem cell delivery to the central nervous system. J Cereb Blood Flow Metab 37(7):2346–2358

    Article  Google Scholar 

  25. Xu R et al (2015) Respiratory motion model based correction for improving the targeting accuracy of MRI-guided intracardiac electrophysiology procedures. J Cardiovasc Magn Reson 17(1):O24

    Article  Google Scholar 

  26. Yi D, Stainsby JA, Wright G (2004) Intuitive and efficient control of real-time MRI scan plane using a six-degree-of-freedom hardware plane navigator. Lect Notes Comput Sci 3217:8

  27. Zhang Q, Peters ER (2011) Volume visualization: a technical overview with a focus on medical applications. J Digit Imaging 24:640

    Article  Google Scholar 

  28. Zhang Q, Peters T, Fenster A (2019) Layer-based visualization and biomedical information exploration of multi-channel large histological data. Comput Med Imaging Graph 72:34–46

Download references

Acknowledgements

This study was sponsored by the National Natural Science Foundation of China (NSFC) (grant no. 51775200). Dr. Linghua Kong was also supported by the Digital Fujian Industrial Manufacturing IOT Lab. The authors are grateful to Dr. Ranjith Kumar Kankala for his proofreading of this manuscript.

Author information

Authors and Affiliations

  1. College of Mechanical Engineering and Automation, Huaqiao University, No. 668 Jimei Avenue, Xiamen, Fujian Province, 361021, China

    Dingrong Yi

  2. School of Mechanical and Automotive Engineering, Fujian University of Technology, 33rd South Xuefu Road, Fuzhou, University New Territory, 350118, China

    Linghua Kong

  3. Sunnybrook Health Sciences Centre, Imaging Research, S6-65 Research Building, 2075 Bayview Avenue, ON, M4N 3M5, Toronto, Canada

    Graham A. Wright

Authors
  1. Dingrong Yi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Linghua Kong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Graham A. Wright
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dingrong Yi.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yi, D., Kong, L. & Wright, G.A. Visual-motor control methods for interactive real-time MRI-cardiac imaging. Multimed Tools Appl 82, 1087–1103 (2023). https://doi.org/10.1007/s11042-022-13239-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13239-7

Keywords

Search

Navigation