Abstract
We generalize image-based rendering by exploiting texture-mapping graphics hardware to decompress ray-traced “animations”. Rather than ID time, our animations are parameterized by two or more arbitrary variables representing view/lighting changes and rigid object motions. To best match the graphics hardware rendering to the input ray-traced imagery, we describe a novel method to infer parameterized texture maps for each object by modeling the hardware as a linear system and then performing least-squares optimization. The parameterized textures are compressed as a multidimensional Laplacian pyramid on fixed size blocks of parameter space. This scheme captures the coherence in parameterized animations and, unlike previous work, decodes directly into texture maps that load into hardware with a few, simple image operations. We introduce adaptive dimension splitting in the Laplacian pyramid and separate diffuse and specular lighting layers to further improve compression. High-quality results are demonstrated at compression ratios up to 800:1 with interactive playback on current consumer graphics cards.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Adelson, E., and J. Bergen, “The Plenoptic Function and the Elements of Early Vision,” In Computational Models of Visual Processing, MIT Press, Cambridge, MA, 1991, pp. 3–20.
Bastos, R., K. Hoff, W. Wynn, and A. Lastra. “Increased Photorealism for Interactive Architectural Walkthroughs,” 1999 ACM Symposium on Interactive 3D Graphics, April 1999, pp. 183–190.
Burt, P., and E. Adelson, “The Laplacian Pyramid as a Compact Image Code,” IEEE Transactions on Communications, Vol. Com-31, No. 4, April 1983, pp. 532–540.
Chen, S.E., and L. Williams, “View Interpolation for Image Synthesis,” SIGGRAPH 93, August 1993, pp. 279–288.
Cohen-Or, D., Y. Mann, and S. Fleishman, “Deep Compression for Streaming Texture Intensive Animations,” SIGGRAPH 99, August 1999, pp. 261–265.
Debevec, P., C. Taylor, and J. Malik, “Modeling and Rendering Architecture from Photographs: A Hybrid Geometry- and Image-Based Approach,” SIGGRAPH 96, August 1996, pp. 11–20.
Debevec, P.Y. Yu, and G. Borshukov, “Efficient View-Dependent Image-Based Rendering with Projective Texture Maps,” In 9th Eurographics Rendering Workshop, June 1998, pp. 105–116.
Diefenbach, P. J., Pipeline Rendering: Interaction and Realism Through Hardware-Based Multi-Pass Rendering, Ph.D. Thesis, University of Pennsylvania, 1996.
Gersho, A., and R. Gray, Vector Quantization and Signal Compression, Kluwer Academic, Boston, 1992, pp. 606–610.
Gortler, S., R. Grzeszczuk, R. Szeliski, and M. Cohen, “The Lumigraph,” SIGGRAPH 96, pp. 43–54.
Guenter, B., H. Yun, and R. Mersereau, “Motion Compensated Compression of Computer Animation Frames,” SIGGRAPH 93, August 1993, pp. 297–304.
Hakura, Z., J. Lengyel, and J. Snyder, “Parameterized Animation Compression”, MSR-TR-2000–50, June 2000.
Halle, M., “Multiple Viewpoint Rendering,” SIGGRAPH 98, August 1998, 243–254.
Heidrich, W., H. Lensch, and H. P. Seidel. “Light Field Techniques for Reflections and Refractions,” In 10th Eurographics Rendering Workshop, June 1999, pp. 195–204, p. 375.
Lalonde, P. and A. Fournier, “Interactive Rendering of Wavelet Projected Light Fields,” Graphics Interface ‘99, June 1999, pp. 107–114.
Lengyel, J., and J. Snyder, “Rendering with Coherent Layers,” SIGGRAPH 97, August 1997, pp. 233–242.
Levoy, M., “Polygon-Assisted JPEG and MPEG compression of Synthetic Images,” SIGGRAPH 95, August 1995, pp. 21–28.
Levoy, M., and P. Hanrahan, “Light Field Rendering,” SIGGRAPH 96, August 1996, pp. 31–41.
Lischinski, D., and A. Rappoport, “Image-Based Rendering for Non-Diffuse Synthetic Scenes,” In 9th Eurographics Workshop on Rendering, June 1998.
Luettgen, M., W. Karl, and A Willsky, “Efficient Multiscale Regularization with Applications to the Computation of Optical Flow,” IEEE Transactions on Image Processing, 3(1), 1994, pp. 41–64.
Maillot, J., H. Yahia, A. Verroust, “Interactive Texture Mapping,” SIGGRAPH 93, pp. 27–34.
Marschner, S. R., Inverse Rendering for Computer Graphics, Ph.D. Thesis, Cornell University, August 1998.
McMillan, L., and G. Bishop, “Plenoptic Modeling,” SIGGRAPH 95, pp. 39–46.
Microsoft MPEG-4 Visual Codec FDIS 1.02, ISO/IEC 14496–5 FDIS1, August 1999.
Miller, G., S. Rubin, and D. Poncelen, “Lazy Decompression of Surface Light Fields for Pre-computed Global Illumination,” In 9th Eurographics Rendering Workshop, June 1998, pp. 281–292.
Nimeroff, J., J. Dorsey, and H. Rushmeier, “Implementation and Analysis of an Image-Based GLobal Illumination Framework for Animated Environments,” IEEE Transactions on Visualization and Computer Graphics, 2(4), Dec. 1996, pp. 283–298.
Nishino, K., Y Sato, and K. Ikeuchi, “Eigen-Texture Method: Appearance Compression based on 3D Model,” Proceedings of 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Fort Collins, CO, June, 1999, pp. 618–24 Vol. 1.
Said, A., and W. Pearlman, “A New, Fast, and Efficient Image Codec Based on Set Partitioning in Hierarchical Trees,” IEEE Transactions on Circuits and Systems for Video Technology, Vol. 6, June 1996, pp. 243–250.
Sato, Y, M. Wheeler, and K. Ikeuchi, “Object Shape and Reflectance Modeling from Observation,” SIGGRAPH 97, August 1997, pp. 379–387.
Shade, J., S. Gortler, L. He, and R. Szeliski, “Layered Depth Images,” SIGGRAPH 98, August 1998, pp. 75–82.
Shirley, Wang and Zimmerman, “Monte Carlo Methods for Direct Lighting Calculations,” ACM Transactions on Graphics, January 1996, pp. 1–36.
Stamminger, M., A. Scheel, et al., “Efficient Glossy Global Illumination with Interactive Viewing,” Graphics Interface ‘99, June 1999, pp. 50–57.
Stiirzlinger, W. and R. Bastos, “Interactive Rendering of Globally Illuminated Glossy Scenes,” Eurographics Rendering Workshop 1997, June 1997, pp. 93–102.
Udeshi, T. and C. Hansen, “Towards interactive, photorealistic rendering of indoor scenes: A hybrid approach,” Eurographics Rendering Workshop 1999, June 1999, pp. 71–84 and pp. 367–368.
Wong, T T, P. A. Heng, S. H. Or, and W. Y Ng, “Image-based Rendering with Controllable Illumination,” Eurographics Rendering Workshop 1997, June 1997, pp. 13–22.
Wallace, J., M. Cohen, and D. Greenberg, “A Two-Pass Solution to the Rendering Equation: A Synthesis of Ray-Tracing and Radiosity Methods,” SIGGRAPH 87, July 1987, pp. 311–320.
Wallach, D., S. Kunapalli, and M. Cohen, “Accelerated MPEG Compression of Dynamic Polygonal Scenes,” SIGGRAPH 94, July 1997, pp. 193–196.
Walter, B., G. Alppay, E. Lafortune, S. Fernandez, and D. Greenberg, “Fitting Virtual Lights for Non-Diffuse Walkthroughs,” SIGGRAPH 97, August 1997, pp. 45–48.
Yu, Y, P. Debevec, J. Malik, and T. Hawkins, “Inverse Global Illumination: Recovering Reflectance Models of Real Scenes From Photographs,” SIGGRAPH 99, August 1999, pp. 215–224.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Wien
About this paper
Cite this paper
Hakura, Z.S., Lengyel, J.E., Snyder, J.M. (2000). Parameterized Animation Compression. In: Péroche, B., Rushmeier, H. (eds) Rendering Techniques 2000. EGSR 2000. Eurographics. Springer, Vienna. https://doi.org/10.1007/978-3-7091-6303-0_10
Download citation
DOI: https://doi.org/10.1007/978-3-7091-6303-0_10
Published:
Publisher Name: Springer, Vienna
Print ISBN: 978-3-211-83535-7
Online ISBN: 978-3-7091-6303-0
eBook Packages: Springer Book Archive