Skip to main content
SpringerLink
Log in

A Framework to Visualize and Interact with Multimodal Medical Images

  • Conference paper
Book cover Volume Graphics 2001

Part of the book series: Eurographics ((EUROGRAPH))

Abstract

The simultaneous use of images obtained from different sources is common in medical diagnosis. However, even though the quality of these images has been improving, the integration of multimodality data into a unique 3D representation is still non-trivial. To overcome this problem, multimodal visualization techniques provide better insight by fording suitable strategies to integrate different characteristics of multiple data sets into a single visual representation. This paper describes a framework for interactive multimodal visualization of 3D medical images, focusing on the multimodal visualization model and requirements for developing such systems. A short overview of multimodal visualization systems and techniques is also presented.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. J. B. A. Maintz and M. A. Viergever, Survey of Medical Image Registration. Medical Image Analysis, 2 (1), 1998, 1–36.

    Article  Google Scholar 

  2. J. P. W. Pluim and J. B. A. Maintz, Registration of Multimodal medical images. Available at http://www.cv.ruu.nl/Research/Registration/registration-frame.html(March 2000 ).

  3. G. Q. Maguire Jr., M. E. Noz, H. Rusinek et al. Graphics Applied to Medical Image Registration. IEEE Computer Graphics & Applications, March, 1991, 20–28.

    Google Scholar 

  4. R. Stokking, Integrated Visualization of Functional and Anatomical Brain Images(Netherlands: Universiteit Utrecht, 1998, Ph.D. Thesis).

    Google Scholar 

  5. R. A. Robb, Visualization Methods for Analysis of Multimodality Images. In: R. W. Thatcher, M. Hallet, T. Zeffiro et al. (eds). Functional Neuroimaging: Technical Foundations. Academic Press, 1994.

    Google Scholar 

  6. Computer Graphics and Image Processing Group, VPat - Visualization and interaction with Virtual Patients. Available at http://www.inf.ufrgs.br/cg/projects.html#vpat (July 2000).

  7. M. R. M. Silva, Ray Casting Based Volume Visualization Techniques(Porto Alegre: Instituto de Informatica/UFRGS, 2000, Master Thesis).

    Google Scholar 

  8. L. G. Brown. A Survey of Image Registration Techniques. ACM Computing Surveys, 24 (4), 1992, 325–376.

    Article  Google Scholar 

  9. J. K. Udupa and G. T. Herman, 3D Imaging in Medicine (CRC Press LLC, 2000, 2th ed.).

    Google Scholar 

  10. K. J. Zuiderveld, A. H. J. Koning, R. Stokking, et al. Multimodality Visualization of Medical Volume Data. Computers&Graphics, 20 (6), 1996, 775–791.

    Google Scholar 

  11. A. Collignon, Multi-Modality Medical Image Registration by Maximization of Mutual Information(Belgium: Katholieke Universiteit Leuven, 1998, Ph.D. Thesis).

    Google Scholar 

  12. F. Maes, Segmentation and Registration of Multimodal Medical Images(Belgium: Katholieke Universiteit Leuven, 1998, Ph.D. Thesis).

    Google Scholar 

  13. J. B. A. Maintz, Retrospective Registration of Tomographic Brain Images(Netherlands: Universiteit Utrecht, 1996, Ph.D. Thesis).

    Google Scholar 

  14. A. Collignon, F. Maes, D. Delaere, et al. Automated multi-modality image registration based on information theory. Information Processing in Medical Imaging. Kluwer Academic Publishers, 1995, p. 263–274.

    Google Scholar 

  15. P. Viola and W. M. Wells III, Alignment by maximization of mutual information. In Proceedings of International Conference On Computer Vision, pages 16–23. IEEE Computer Society Press, 1995.

    Google Scholar 

  16. D. N. Levin, X. Hu, K. K. Tan et al. The Brain: Integrated Three-Dimensional Display of MRI and PET Images. Radiology, 172 (3), 1989, 783–789.

    Google Scholar 

  17. K. J. Zuiderveld, Visualization of Multimodality Medical Volume Data using Object-Oriented Methods(Netherlands: Universiteit Utrecht, 1995. Ph.D. Thesis).

    Google Scholar 

  18. W. Cai and G. Sakas. Data Intermixing and Multi-Volume Rendering. Computer Graphics Forum, Cambridge, 18(3), 1999, C359–C368. Proceedings EUROGRAPHICS, Milan, Italy.

    Google Scholar 

  19. M. Levoy, Efficient Ray Tracing of Volume Data, ACM Transactions on Graphics, 9 (3), 1990, 245–261.

    Article  MATH  Google Scholar 

  20. H. J. Noordmans, Interactive Analysis of 3D Microscope Images(Netherlands: Universiteit Utrecht, 1997, Ph.D. Thesis).

    Google Scholar 

  21. B. Lichtenbelt, R. Crane and S. Naqvi, Introduction to Volume Rendering(Prentice Hall, 1998 ).

    Google Scholar 

  22. P. Hastreiter and T. Ertl, Integrated Registration and Visualization of Medical Image Data. In Proceeding of Computer Graphics International’98, (Hannover, Germany, 1998), pages 78–85. IEEE Computer Society Press, 1998.

    Google Scholar 

  23. C. Rezk-Salama, K. Engel, M. Bauer et al. Interactive Volume Rendering on Standard PC Graphics Hardware Using Multi-Textures and Multi-Stage Rasterization. In Proceedings of SIGGraph/Eurographics Workshop on Graphics Hardware 2000(Interlaken, Switzerland, August 21–22, 2000 ).

    Google Scholar 

  24. F. Buschmann, R. Meunier, H. Rohnert et al. Pattern-Oriented Software Architecture, A System of Patterns (John Wiley & Sons, 1996)

    Google Scholar 

  25. C. Larman, Applying UML and Patterns - An Introduction to Object-Oriented Analysis and Design(Prentice-Hall, 1997 ).

    Google Scholar 

  26. B. Spitzak, FLTK - The Fast Light Tool Kit Home Page. Available at http://fltk.easysw.com (March 2000).

  27. E. Gamma, R. Helm, R. Johnson et al. Design patterns: elements of reusable object-oriented software(Addison-Wesley, 1995 ).

    Google Scholar 

  28. R. Mullick, N. Bryan and J. Butman. Confocal Volume Rendering: Fast Segmentation-Free Visualization of Internal Structures. In Proceedings of SPIE 00–Annual Meeting International Symposium on Optical Science and Technology( San Diego, California, 2000 ), pages 144–154.

    Google Scholar 

  29. CPAD - Research Center in High Performance Computing. Available at http://www.cpad.pucrs.br (April 2001).

  30. R. Buyya. High Performance Cluster Computing Architectures and System(Prentice Hall, 1999 ).

    Google Scholar 

  31. O. Sommer, A. Dietz, R. Westermann et al. An Interactive Visualization and Navigation Tool for Medical Volume Data. In Proceedings of WSCG’98(Plzen - Bory, Czech Republic, February 9–13, 1998 ).

    Google Scholar 

  32. R. A. Robb, Visualization Methods for Analysis of Multimodality Images. In: R. W. Thatcher, M. Hallet, T. Zeffiro et al. (eds). Functional Neuroimaging: Technical Foundations. San Diego, CA: Academic Press, 1994.

    Google Scholar 

  33. C. Johnson, S. G. Parker, C. Hansen et al. Interactive Simulation and Visualization. Computer, 32 (12), 1999, 59–65.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. UFRGS - Universidade Federal do Rio Grande do Sul, II/PGCC, Caixa Postal 15064, 91501-970, Porto Alegre, RS, Brazil

    Isabel Manssour, Luciana Nedel & Carla Freitas

  2. PUCRS - Pontifícia Universidade Católica do Rio Grande do Sul, FACIN, Av. Ipiranga 6681, Prédio 30, Bloco 4, 90619-900, Porto Alegre, RS, Brazil

    Isabel Manssour & Luciana Nedel

  3. InCor - Instituto do Coração, HC-FMUSP, Unidade de Pesquisa e Desenvolvimento, Av. Dr. Enéas de Carvalho Aguiar, 44, 05403-000, São Paulo, SP, Brazil

    Sérgio Furuie

Authors
  1. Isabel Manssour
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sérgio Furuie
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Luciana Nedel
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Carla Freitas
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science, State University of New York at Stony Brook, Stony Brook, NY, USA

    Klaus Mueller PhD  & Arie E. Kaufman PhD  & 

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag/Wien

About this paper

Cite this paper

Manssour, I., Furuie, S., Nedel, L., Freitas, C. (2001). A Framework to Visualize and Interact with Multimodal Medical Images. In: Mueller, K., Kaufman, A.E. (eds) Volume Graphics 2001. Eurographics. Springer, Vienna. https://doi.org/10.1007/978-3-7091-6756-4_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-7091-6756-4_27

  • Publisher Name: Springer, Vienna

  • Print ISBN: 978-3-211-83737-5

  • Online ISBN: 978-3-7091-6756-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation