Rapid Classification of Surface Reflectance from Image Velocities

  • Katja Doerschner
  • Dan Kersten
  • Paul Schrater
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5702)


We propose a method for rapidly classifying surface reflectance directly from the output of spatio-temporal filters applied to an image sequence of rotating objects. Using image data from only a single frame, we compute histograms of image velocities and classify these as being generated by a specular or a diffusely reflecting object. Exploiting characteristics of material-specific image velocities we show that our classification approach can predict the reflectance of novel 3D objects, as well as human perception.


specular flow rapid surface reflectance classification velocity histogram material perception spatio-temporal filtering 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ihrke, I., Kutulakos, K., Lensch, H., Magnor, M., Heidrich, W.: State of the Art in Transparent and Specular Object Reconstruction (2008)Google Scholar
  2. 2.
    Oren, M., Nayar, S.: A Theory of Specular Surface Geometry. International Journal of Computer Vision 24(2), 105–124 (1997)CrossRefGoogle Scholar
  3. 3.
    Roth, S., Black, M.: Specular Flow and the Recovery of Surface Structure. In: Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2, pp. 1869–1876 (2006)Google Scholar
  4. 4.
    Healey, G., Binford, T.: Local shape for specularity. Jones and Bartlett Publishers, Inc., USA (1992)Google Scholar
  5. 5.
    Nayar, S., Fang, X., Boult, T.: Removal of specularities using color and polarization. In: 1993 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Proceedings CVPR 1993, pp. 583–590 (1993)Google Scholar
  6. 6.
    Chung, Y.-C., Chang, S.-L., Cherng, S., Chen, S.-W.: Dichromatic Reflection Separation from a Single Image. In: Yuille, A.L., Zhu, S.-C., Cremers, D., Wang, Y. (eds.) EMMCVPR 2007. LNCS, vol. 4679, pp. 225–241. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  7. 7.
    Hartung, B., Kersten, D.: Distinguishing shiny from matte. J. Vis. 2(7), 551–551 (2002)CrossRefGoogle Scholar
  8. 8.
    Doerschner, K., Kersten, D.: Perceived rigidity of rotating specular superellipsoids under natural and not-so-natural illuminations. J. Vis. 7(9), 838–838 (2007)Google Scholar
  9. 9.
    Roth, S., Domini, F., Black, M.: Specular Flow and the Perception of Surface Reflectance. J. Vis. 3(9), 413–413 (2003)Google Scholar
  10. 10.
    Koenderink, J., Van Doorn, A.: Photometric invariants related to solid shape. Journal of Modern Optics 27(7), 981–996 (1980)CrossRefGoogle Scholar
  11. 11.
    Blake, A.: Specular stereo. In: Proc. Int. J. Conf. on Artificial Intell., pp. 973–976 (1985)Google Scholar
  12. 12.
    Derpanis, K., Gryn, J.: Three-dimensional nth derivative of Gaussian separable steerable filters. In: IEEE International Conference on Image Processing (2005)Google Scholar
  13. 13.
    Simoncelli, E.: Distributed analysis and representation of visual motion. Ph.D. Thesis, Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, Cambridge, MA (1993)Google Scholar
  14. 14.
    Botev, Z., Botev, Z.: A Novel Nonparametric Density Estimator. The University of Queensland (2006)Google Scholar
  15. 15.
    Nabney, I.: NETLAB: algorithms for pattern recognition. Springer, Heidelberg (2002)zbMATHGoogle Scholar
  16. 16.
    O’Grady, P.D., Pearlmutter, B.A.: Convolutive non-negative matrix factorisation with a sparseness constraint. In: Proceedings of the IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2006), Maynooth, Ireland, September 2006, pp. 427–432 (2006)Google Scholar
  17. 17.
    Larsen, G., Shakespeare, R.: Rendering with Radiance: The Art and Science of Lighting Visualisation (1998)Google Scholar
  18. 18.
    Fleming, R.: Rendering Sticky Reflections with Radiance. Personal Communication (2007)Google Scholar
  19. 19.
    Fleming, R., Dror, R., Adelson, E.: Real-world illumination and the perception of surface reflectance properties. Journal of Vision 3(5), 347–368 (2003)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Katja Doerschner
    • 1
  • Dan Kersten
    • 2
  • Paul Schrater
    • 2
    • 3
  1. 1.National Research Center for Magnetic Resonance (UMRAM) and Dept. of PsychologyBilkent University 
  2. 2.Dept. of PsychologyUniversity of Minnesota 
  3. 3.Dept. of Comp. Science & Eng.University of Minnesota 

Personalised recommendations