Abstract
The simultaneous use of images obtained from different sources is common in medical diagnosis. However, even though the quality of these images has been improving, the integration of multimodality data into a unique 3D representation is still non-trivial. To overcome this problem, multimodal visualization techniques provide better insight by fording suitable strategies to integrate different characteristics of multiple data sets into a single visual representation. This paper describes a framework for interactive multimodal visualization of 3D medical images, focusing on the multimodal visualization model and requirements for developing such systems. A short overview of multimodal visualization systems and techniques is also presented.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
J. B. A. Maintz and M. A. Viergever, Survey of Medical Image Registration. Medical Image Analysis, 2 (1), 1998, 1–36.
J. P. W. Pluim and J. B. A. Maintz, Registration of Multimodal medical images. Available at http://www.cv.ruu.nl/Research/Registration/registration-frame.html(March 2000 ).
G. Q. Maguire Jr., M. E. Noz, H. Rusinek et al. Graphics Applied to Medical Image Registration. IEEE Computer Graphics & Applications, March, 1991, 20–28.
R. Stokking, Integrated Visualization of Functional and Anatomical Brain Images(Netherlands: Universiteit Utrecht, 1998, Ph.D. Thesis).
R. A. Robb, Visualization Methods for Analysis of Multimodality Images. In: R. W. Thatcher, M. Hallet, T. Zeffiro et al. (eds). Functional Neuroimaging: Technical Foundations. Academic Press, 1994.
Computer Graphics and Image Processing Group, VPat - Visualization and interaction with Virtual Patients. Available at http://www.inf.ufrgs.br/cg/projects.html#vpat (July 2000).
M. R. M. Silva, Ray Casting Based Volume Visualization Techniques(Porto Alegre: Instituto de Informatica/UFRGS, 2000, Master Thesis).
L. G. Brown. A Survey of Image Registration Techniques. ACM Computing Surveys, 24 (4), 1992, 325–376.
J. K. Udupa and G. T. Herman, 3D Imaging in Medicine (CRC Press LLC, 2000, 2th ed.).
K. J. Zuiderveld, A. H. J. Koning, R. Stokking, et al. Multimodality Visualization of Medical Volume Data. Computers&Graphics, 20 (6), 1996, 775–791.
A. Collignon, Multi-Modality Medical Image Registration by Maximization of Mutual Information(Belgium: Katholieke Universiteit Leuven, 1998, Ph.D. Thesis).
F. Maes, Segmentation and Registration of Multimodal Medical Images(Belgium: Katholieke Universiteit Leuven, 1998, Ph.D. Thesis).
J. B. A. Maintz, Retrospective Registration of Tomographic Brain Images(Netherlands: Universiteit Utrecht, 1996, Ph.D. Thesis).
A. Collignon, F. Maes, D. Delaere, et al. Automated multi-modality image registration based on information theory. Information Processing in Medical Imaging. Kluwer Academic Publishers, 1995, p. 263–274.
P. Viola and W. M. Wells III, Alignment by maximization of mutual information. In Proceedings of International Conference On Computer Vision, pages 16–23. IEEE Computer Society Press, 1995.
D. N. Levin, X. Hu, K. K. Tan et al. The Brain: Integrated Three-Dimensional Display of MRI and PET Images. Radiology, 172 (3), 1989, 783–789.
K. J. Zuiderveld, Visualization of Multimodality Medical Volume Data using Object-Oriented Methods(Netherlands: Universiteit Utrecht, 1995. Ph.D. Thesis).
W. Cai and G. Sakas. Data Intermixing and Multi-Volume Rendering. Computer Graphics Forum, Cambridge, 18(3), 1999, C359–C368. Proceedings EUROGRAPHICS, Milan, Italy.
M. Levoy, Efficient Ray Tracing of Volume Data, ACM Transactions on Graphics, 9 (3), 1990, 245–261.
H. J. Noordmans, Interactive Analysis of 3D Microscope Images(Netherlands: Universiteit Utrecht, 1997, Ph.D. Thesis).
B. Lichtenbelt, R. Crane and S. Naqvi, Introduction to Volume Rendering(Prentice Hall, 1998 ).
P. Hastreiter and T. Ertl, Integrated Registration and Visualization of Medical Image Data. In Proceeding of Computer Graphics International’98, (Hannover, Germany, 1998), pages 78–85. IEEE Computer Society Press, 1998.
C. Rezk-Salama, K. Engel, M. Bauer et al. Interactive Volume Rendering on Standard PC Graphics Hardware Using Multi-Textures and Multi-Stage Rasterization. In Proceedings of SIGGraph/Eurographics Workshop on Graphics Hardware 2000(Interlaken, Switzerland, August 21–22, 2000 ).
F. Buschmann, R. Meunier, H. Rohnert et al. Pattern-Oriented Software Architecture, A System of Patterns (John Wiley & Sons, 1996)
C. Larman, Applying UML and Patterns - An Introduction to Object-Oriented Analysis and Design(Prentice-Hall, 1997 ).
B. Spitzak, FLTK - The Fast Light Tool Kit Home Page. Available at http://fltk.easysw.com (March 2000).
E. Gamma, R. Helm, R. Johnson et al. Design patterns: elements of reusable object-oriented software(Addison-Wesley, 1995 ).
R. Mullick, N. Bryan and J. Butman. Confocal Volume Rendering: Fast Segmentation-Free Visualization of Internal Structures. In Proceedings of SPIE 00–Annual Meeting International Symposium on Optical Science and Technology( San Diego, California, 2000 ), pages 144–154.
CPAD - Research Center in High Performance Computing. Available at http://www.cpad.pucrs.br (April 2001).
R. Buyya. High Performance Cluster Computing Architectures and System(Prentice Hall, 1999 ).
O. Sommer, A. Dietz, R. Westermann et al. An Interactive Visualization and Navigation Tool for Medical Volume Data. In Proceedings of WSCG’98(Plzen - Bory, Czech Republic, February 9–13, 1998 ).
R. A. Robb, Visualization Methods for Analysis of Multimodality Images. In: R. W. Thatcher, M. Hallet, T. Zeffiro et al. (eds). Functional Neuroimaging: Technical Foundations. San Diego, CA: Academic Press, 1994.
C. Johnson, S. G. Parker, C. Hansen et al. Interactive Simulation and Visualization. Computer, 32 (12), 1999, 59–65.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag/Wien
About this paper
Cite this paper
Manssour, I., Furuie, S., Nedel, L., Freitas, C. (2001). A Framework to Visualize and Interact with Multimodal Medical Images. In: Mueller, K., Kaufman, A.E. (eds) Volume Graphics 2001. Eurographics. Springer, Vienna. https://doi.org/10.1007/978-3-7091-6756-4_27
Download citation
DOI: https://doi.org/10.1007/978-3-7091-6756-4_27
Publisher Name: Springer, Vienna
Print ISBN: 978-3-211-83737-5
Online ISBN: 978-3-7091-6756-4
eBook Packages: Springer Book Archive