Abstract
We survey and extend nonlinear signal decompositions based on morphological pyramids, and their application to multiresolution maximum intensity projection (MIP) volume rendering with progressive refinement and perfect reconstruction. The structure of the resulting multiresolution rendering algorithm is very similar to wavelet splatting. Several existing classes of pyramids are discussed, and their limitations indicated. To enhance the approximation quality of visualizations from reduced data (higher levels of the pyramid), two approaches are explored. First, a new class of morphological pyramids, involving connectivity enhancing operators, is considered. In the pyramidal analysis phase, a conditional dilation operator is used, with a given number n of iterations. The corresponding pyramids for n = 0 and n = 1 are known as the adjunction pyramid and Sun-Maragos pyramid, respectively. We show that the approximation quality when rendering from higher levels of the pyramid does increase as a function of the number of iterations n of the conditional dilation operator, but the improvement for n > 1 is limited. The second new approach, called streaming MIP-splatting, again starts from the adjunction pyramid. The new element is that detail coefficients of all levels are considered simultaneously and are resorted with respect to decreasing magnitude of a suitable error measure. All resorted coefficients are projected successively, until a desired accuracy of the resulting MIP image is obtained. We show that this method outperforms the previous methods based on morphological pyramids, both with respect to image quality with a fixed amount of detail data, and in terms of flexibility of controlling approximation error or computation time.
Similar content being viewed by others
References
P.J. Burt and E.H. Adelson, “The Laplacian pyramid as a compact image code”IEEE Trans. Communications, Vol. 31, pp. 532–540, 1983.
W. Cai and G. Sakas, “Maximum Intensity projection using splatting in sheared object space”Computer Graphics Forum (Proc. Eurographics’98), Vol. 17, No. 3, pp. C113–C124, 1998.
R.A. Drebin, L. Carpenter, and P. Hanrahan, “Volume rendering” Computer Graphics (SIGGRAPH ‘88 proceedings), Vol. 22, No. 4, pp. 65–74, 1988.
J. Goutsias and H.J.A.M. Heijmans, “Multiresolution signal decomposition schemes. Part 1: Linear and morphological pyramids”IEEE Trans. Image Processing, Vol. 9, No. 11, pp. 1862–1876, 2000.
R. Grosso and T. Ertl, “Biorthogonal wavelet filters for frequency domain volume rendering” inProceedings of Visualization in Scientific Computing ’95, J. van Wijk, R. Scateni, and P. Zanarini (Eds.), 1995.
H.J.A.M. Heijmans and J. Goutsias, “Multiresolution signal decomposition schemes. Part 2: morphological wavelets”IEEE Trans. Image Processing, Vol. 9, No. 11, pp. 1897–1913, 2000.
L. Lippert and M.H. Gross, “Fast wavelet based volume rendering by accumulation of transparent texture maps”Computer Graphics Forum, Vol. 14, No. 3, pp. 431–443, 1995.
L. Lippert, M.H. Gross, and C. Kurmann, “Compression domain volume rendering for distributed environments” inProc. Eurographics’97, 1997, pp. 95–107.
S. Mallat,A Wavelet Tour of Signal Processing, Academic Press: New York, 1998.
L. Mroz, A. Köonig, and E. Gröoller, “Maximum intensity projection at warp speed”Computers & Graphics, Vol. 24, pp. 343–352, 2000.
S. Muraki, “Volume data and wavelet transforms”IEEE Computer Graphics and Applications, Vol. 13, No. 4, pp. 50–56, 1993.
J.B.T.M. Roerdink, “Multiresolution maximum intensity volume rendering by morphological pyramids” inData Visualization 2001. Proc. Joint Eurographics—IEEE TCVG Symposium on Visualization, D. Ebert, J.M. Favre, and R. Peikert (Eds.), May 28–30, 2001, Ascona, Switzerland, Springer, Wien, New York, 2001, pp. 45–54.
J.B.T.M. Roerdink, “Comparison of morphological pyramids for multiresolution MIP volume rendering” inData Visualization 2002. Proc. Eurographics—IEEE TCVG Symposium, D. Ebert, P. Brunet, and I. Navazo (Eds.), May 27–29, 2002, Barcelona, Spain, ACM: New York, 2002, pp. 61–70.
J.B.T.M. Roerdink, “Multiresolution maximum intensity volume rendering by morphological adjunction pyramids”IEEE Trans. Image Processing, Vol. 12, No. 6, pp. 653–660, 2003a.
J.B.T.M. Roerdink, “A new class of morphological pyramids for multiresolution image analysis” inGeometry, Morphology, and Computational Imaging, Vol. 2616 ofLecture Notes in Computer Science, T. Asano, R. Klette, and C. Ronse (Eds.), Springer, Wien: New York, 2003b, pp. 165–175.
J.B.T.M. Roerdink and M.A. Westenberg, “Wavelet-based volume visualization” Nieuw Archief voor Wiskunde, Vol. 17 (Fourth Series), No. 2, pp. 149–158, 1999.
J. Serra,Image Analysis and Mathematical Morphology, Academic Press, New York, 1982.
F.K. Sun and P. Maragos, “Experiments on image compression using morphological piramids” inSPIE Conf. Vis. Comm. Im. Proc. IV, Vol. 1199, 1989, pp. 1303–1312.
W. Sweldens, “Wavelets and the lifting scheme: A 5 minute tour”Z. Angew. Math. Mech., Vol. 76 (Suppl. 2), pp. 41–44, 1996.
M.A. Westenberg and J.B.T.M. Roerdink, “Frequency domain volume rendering by the wavelet X-ray transform”IEEE Trans. Image Processing, Vol. 9, No. 7, pp. 1249–1261, 2000.
R. Westermann and T. Ertl, “A multiscale approach to integrated volume segmentation and rendering” inProc. Eurographics’97, D. Fellner and L. Szirmay-Kalos (Eds.), Vienna, Vol. 16(3). 1997, pp. C-117–C-127.
K.J. Zuiderveld, A.H.J. Koning, and M.A. Viergever, “Techniques for speeding up high-quality perspective Maximum Intensity Projection”Pattern Recognition Letters, Vol. 15, pp. 507–517, 1994.
Author information
Authors and Affiliations
Corresponding author
Additional information
Jos B.T.M. Roerdink received his M.Sc. (1979) in theoretical physics from the University of Nijmegen, the Netherlands. Following his Ph.D. (1983) from the University of Utrecht and a two-year position (1983–1985) as a Postdoctoral Fellow at the University of California, San Diego, both in the area of stochastic processes, he joined the Centre for Mathematics and Computer Science in Amsterdam. There he worked from 1986–1992 on image processing and tomographic reconstruction. He was appointed associate professor (1992) and full professor (2003), respectively, at the Institute for Mathematics and Computing Science of the University of Groningen, where he currently holds a chair in Scientific Visualization and Computer Graphics. His current research interests include morphological image processing, biomedical visualization, neuroimaging and bioinformatics.
Rights and permissions
About this article
Cite this article
Roerdink, J.B.T.M. Morphological Pyramids in Multiresolution MIP Rendering of Large Volume Data: Survey and New Results. J Math Imaging Vis 22, 143–157 (2005). https://doi.org/10.1007/s10851-005-4887-1
Issue Date:
DOI: https://doi.org/10.1007/s10851-005-4887-1