Rapid Inference of Object Rigidity and Reflectance Using Optic Flow
Rigidity and reflectance are key object properties, important in their own rights, and they are key properties that stratify motion reconstruction algorithms. However, the inference of rigidity and reflectance are both difficult without additional information about the object’s shape, the environment, or lighting. For humans, relative motions of object and observer provides rich information about object shape, rigidity, and reflectivity. We show that it is possible to detect rigid object motion for both specular and diffuse reflective surfaces using only optic flow, and that flow can distinguish specular and diffuse motion for rigid objects. Unlike nonrigid objects, optic flow fields for rigid moving surfaces are constrained by a global transformation, which can be detected using an optic flow matching procedure across time. In addition, using a Procrustes analysis of structure from motion reconstructed 3D points, we show how to classify specular from diffuse surfaces.
KeywordsOptic flow rigidity detection specular motion reflectance classification
Unable to display preview. Download preview PDF.
- 2.Zisserman, A., Giblin, P., Blake, A.: The information available to a moving observer from specularities. IVC 7(1), 38–42Google Scholar
- 3.Roth, S., Black, M.J.: Specular flow and the recovery of surface structure. In: CVPR 2006: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1869–1876 (2006)Google Scholar
- 4.Adato, Y., Vasilyev, Y., Ben Shahar, O., Zickler, T.: Toward a theory of shape from specular flow. In: ICCV 2007, pp. 1–8 (2007)Google Scholar
- 5.Vasilyev, Y., Adato, Y., Zickler, T., Ben Shahar, O.: Dense specular shape from multiple specular flows. In: CVPR 2008, pp. 1–8 (2008)Google Scholar
- 6.Healey, G., Binford, T.: Local shape from specularity. CVGIP 42(1), 62–86 (1988)Google Scholar
- 7.Bhat, D., Nayar, S.: Binocular stereo in the presence of specular reflection. In: ARPA 1994, pp. 1305–1315 (1994)Google Scholar
- 8.Saito, M., Kashiwagi, H., Sato, Y., Ikeuchi, K.: Measurement of surface orientations of transparent objects using polarization in highlight. In: Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p. 1381 (1999)Google Scholar
- 16.Gonzalez, R.C., Woods, R.E.: Digital Image Processing. Addison-Wesley, Reading (1992)Google Scholar