Parameterized Animation Compression

  • Ziyad S. Hakura
  • Jerome E. Lengyel
  • John M. Snyder
Part of the Eurographics book series (EUROGRAPH)

Abstract

We generalize image-based rendering by exploiting texture-mapping graphics hardware to decompress ray-traced “animations”. Rather than ID time, our animations are parameterized by two or more arbitrary variables representing view/lighting changes and rigid object motions. To best match the graphics hardware rendering to the input ray-traced imagery, we describe a novel method to infer parameterized texture maps for each object by modeling the hardware as a linear system and then performing least-squares optimization. The parameterized textures are compressed as a multidimensional Laplacian pyramid on fixed size blocks of parameter space. This scheme captures the coherence in parameterized animations and, unlike previous work, decodes directly into texture maps that load into hardware with a few, simple image operations. We introduce adaptive dimension splitting in the Laplacian pyramid and separate diffuse and specular lighting layers to further improve compression. High-quality results are demonstrated at compression ratios up to 800:1 with interactive playback on current consumer graphics cards.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Adelson, E., and J. Bergen, “The Plenoptic Function and the Elements of Early Vision,” In Computational Models of Visual Processing, MIT Press, Cambridge, MA, 1991, pp. 3–20.Google Scholar
  2. 2.
    Bastos, R., K. Hoff, W. Wynn, and A. Lastra. “Increased Photorealism for Interactive Architectural Walkthroughs,” 1999 ACM Symposium on Interactive 3D Graphics, April 1999, pp. 183–190.Google Scholar
  3. 3.
    Burt, P., and E. Adelson, “The Laplacian Pyramid as a Compact Image Code,” IEEE Transactions on Communications, Vol. Com-31, No. 4, April 1983, pp. 532–540.CrossRefGoogle Scholar
  4. 4.
    Chen, S.E., and L. Williams, “View Interpolation for Image Synthesis,” SIGGRAPH 93, August 1993, pp. 279–288.Google Scholar
  5. 5.
    Cohen-Or, D., Y. Mann, and S. Fleishman, “Deep Compression for Streaming Texture Intensive Animations,” SIGGRAPH 99, August 1999, pp. 261–265.Google Scholar
  6. 6.
    Debevec, P., C. Taylor, and J. Malik, “Modeling and Rendering Architecture from Photographs: A Hybrid Geometry- and Image-Based Approach,” SIGGRAPH 96, August 1996, pp. 11–20.Google Scholar
  7. 7.
    Debevec, P.Y. Yu, and G. Borshukov, “Efficient View-Dependent Image-Based Rendering with Projective Texture Maps,” In 9th Eurographics Rendering Workshop, June 1998, pp. 105–116.Google Scholar
  8. 8.
    Diefenbach, P. J., Pipeline Rendering: Interaction and Realism Through Hardware-Based Multi-Pass Rendering, Ph.D. Thesis, University of Pennsylvania, 1996.Google Scholar
  9. 9.
    Gersho, A., and R. Gray, Vector Quantization and Signal Compression, Kluwer Academic, Boston, 1992, pp. 606–610.MATHCrossRefGoogle Scholar
  10. 10.
    Gortler, S., R. Grzeszczuk, R. Szeliski, and M. Cohen, “The Lumigraph,” SIGGRAPH 96, pp. 43–54.Google Scholar
  11. 11.
    Guenter, B., H. Yun, and R. Mersereau, “Motion Compensated Compression of Computer Animation Frames,” SIGGRAPH 93, August 1993, pp. 297–304.Google Scholar
  12. 12.
    Hakura, Z., J. Lengyel, and J. Snyder, “Parameterized Animation Compression”, MSR-TR-2000–50, June 2000.Google Scholar
  13. 13.
    Halle, M., “Multiple Viewpoint Rendering,” SIGGRAPH 98, August 1998, 243–254.Google Scholar
  14. 14.
    Heidrich, W., H. Lensch, and H. P. Seidel. “Light Field Techniques for Reflections and Refractions,” In 10th Eurographics Rendering Workshop, June 1999, pp. 195–204, p. 375.Google Scholar
  15. 15.
    Lalonde, P. and A. Fournier, “Interactive Rendering of Wavelet Projected Light Fields,” Graphics Interface ‘99, June 1999, pp. 107–114.Google Scholar
  16. 16.
    Lengyel, J., and J. Snyder, “Rendering with Coherent Layers,” SIGGRAPH 97, August 1997, pp. 233–242.CrossRefGoogle Scholar
  17. 17.
    Levoy, M., “Polygon-Assisted JPEG and MPEG compression of Synthetic Images,” SIGGRAPH 95, August 1995, pp. 21–28.Google Scholar
  18. 18.
    Levoy, M., and P. Hanrahan, “Light Field Rendering,” SIGGRAPH 96, August 1996, pp. 31–41.Google Scholar
  19. 19.
    Lischinski, D., and A. Rappoport, “Image-Based Rendering for Non-Diffuse Synthetic Scenes,” In 9th Eurographics Workshop on Rendering, June 1998.Google Scholar
  20. 20.
    Luettgen, M., W. Karl, and A Willsky, “Efficient Multiscale Regularization with Applications to the Computation of Optical Flow,” IEEE Transactions on Image Processing, 3(1), 1994, pp. 41–64.CrossRefGoogle Scholar
  21. 21.
    Maillot, J., H. Yahia, A. Verroust, “Interactive Texture Mapping,” SIGGRAPH 93, pp. 27–34.Google Scholar
  22. 22.
    Marschner, S. R., Inverse Rendering for Computer Graphics, Ph.D. Thesis, Cornell University, August 1998.Google Scholar
  23. 23.
    McMillan, L., and G. Bishop, “Plenoptic Modeling,” SIGGRAPH 95, pp. 39–46.Google Scholar
  24. 24.
    Microsoft MPEG-4 Visual Codec FDIS 1.02, ISO/IEC 14496–5 FDIS1, August 1999.Google Scholar
  25. 25.
    Miller, G., S. Rubin, and D. Poncelen, “Lazy Decompression of Surface Light Fields for Pre-computed Global Illumination,” In 9th Eurographics Rendering Workshop, June 1998, pp. 281–292.Google Scholar
  26. 26.
    Nimeroff, J., J. Dorsey, and H. Rushmeier, “Implementation and Analysis of an Image-Based GLobal Illumination Framework for Animated Environments,” IEEE Transactions on Visualization and Computer Graphics, 2(4), Dec. 1996, pp. 283–298.CrossRefGoogle Scholar
  27. 27.
    Nishino, K., Y Sato, and K. Ikeuchi, “Eigen-Texture Method: Appearance Compression based on 3D Model,” Proceedings of 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Fort Collins, CO, June, 1999, pp. 618–24 Vol. 1.Google Scholar
  28. 28.
    Said, A., and W. Pearlman, “A New, Fast, and Efficient Image Codec Based on Set Partitioning in Hierarchical Trees,” IEEE Transactions on Circuits and Systems for Video Technology, Vol. 6, June 1996, pp. 243–250.CrossRefGoogle Scholar
  29. 29.
    Sato, Y, M. Wheeler, and K. Ikeuchi, “Object Shape and Reflectance Modeling from Observation,” SIGGRAPH 97, August 1997, pp. 379–387.CrossRefGoogle Scholar
  30. 30.
    Shade, J., S. Gortler, L. He, and R. Szeliski, “Layered Depth Images,” SIGGRAPH 98, August 1998, pp. 75–82.Google Scholar
  31. 31.
    Shirley, Wang and Zimmerman, “Monte Carlo Methods for Direct Lighting Calculations,” ACM Transactions on Graphics, January 1996, pp. 1–36.Google Scholar
  32. 32.
    Stamminger, M., A. Scheel, et al., “Efficient Glossy Global Illumination with Interactive Viewing,” Graphics Interface ‘99, June 1999, pp. 50–57.Google Scholar
  33. 33.
    Stiirzlinger, W. and R. Bastos, “Interactive Rendering of Globally Illuminated Glossy Scenes,” Eurographics Rendering Workshop 1997, June 1997, pp. 93–102.CrossRefGoogle Scholar
  34. 34.
    Udeshi, T. and C. Hansen, “Towards interactive, photorealistic rendering of indoor scenes: A hybrid approach,” Eurographics Rendering Workshop 1999, June 1999, pp. 71–84 and pp. 367–368.Google Scholar
  35. 35.
    Wong, T T, P. A. Heng, S. H. Or, and W. Y Ng, “Image-based Rendering with Controllable Illumination,” Eurographics Rendering Workshop 1997, June 1997, pp. 13–22.Google Scholar
  36. 36.
    Wallace, J., M. Cohen, and D. Greenberg, “A Two-Pass Solution to the Rendering Equation: A Synthesis of Ray-Tracing and Radiosity Methods,” SIGGRAPH 87, July 1987, pp. 311–320.CrossRefGoogle Scholar
  37. 37.
    Wallach, D., S. Kunapalli, and M. Cohen, “Accelerated MPEG Compression of Dynamic Polygonal Scenes,” SIGGRAPH 94, July 1997, pp. 193–196.Google Scholar
  38. 38.
    Walter, B., G. Alppay, E. Lafortune, S. Fernandez, and D. Greenberg, “Fitting Virtual Lights for Non-Diffuse Walkthroughs,” SIGGRAPH 97, August 1997, pp. 45–48.CrossRefGoogle Scholar
  39. 39.
    Yu, Y, P. Debevec, J. Malik, and T. Hawkins, “Inverse Global Illumination: Recovering Reflectance Models of Real Scenes From Photographs,” SIGGRAPH 99, August 1999, pp. 215–224.Google Scholar

Copyright information

© Springer-Verlag Wien 2000

Authors and Affiliations

  • Ziyad S. Hakura
    • 1
  • Jerome E. Lengyel
    • 2
  • John M. Snyder
    • 2
  1. 1.Stanford UniversityUSA
  2. 2.Microsoft ResearchUSA

Personalised recommendations