A Theory of Multiple Orientation Estimation
Estimation of local orientations in multivariate signals (including optical flow estimation as special case of orientation in space-time-volumes) is an important problem in image processing and computer vision. Modelling a signal using only a single orientation is often too restrictive, since occlusions and transparency happen frequently, thus necessitating the modelling and analysis of multiple orientations.
In this paper, we therefore develop a unifying mathematical model for multiple orientations: beyond describing an arbitrary number of orientations in multivariate vector-valued image data such as color image sequences, it allows the unified treatment of transparently and occludingly superimposed oriented structures. Based on this model, we derive novel estimation schemes for an arbitrary number of superimposed orientations in bivariate images as well as for double orientations in signals of arbitrary signal dimensionality. The estimated orientations themselves, but also features like the number of local orientations or the angles between multiple orientations (which are invariant under rotation) can be used for various inspection, tracking and segmentation problems. We evaluate the performance of our framework on both synthetic and real data.
KeywordsLocal Orientation Symmetric Tensor Structure Tensor Orientation Vector Outer Product
Unable to display preview. Download preview PDF.
- 1.Förstner, W.: A feature based corresponding algorithm for image matching. Intl. Arch. of Photogrammetry and Remote Sensing 26, 150–166 (1986)Google Scholar
- 2.Bigün, J., Granlund, G.H.: Optimal orientation detection of linear symmetry. In: Proc. ICCV 1987, London, UK, pp. 433–438 (1987)Google Scholar
- 3.Mester, R.: The generalization, optimization and information-theoretic justification of filter-based and autocovariance based motion estimation. In: IEEE International Conference on Image Processing, Barcelona, Spain (2003)Google Scholar
- 5.Eberly, D., Gardner, R., Morse, B., Pizer, S., Scharlach, C.: Ridges for image analysis. Technical Report TR93-055, Dep. of Computer Science, Univ. of North Carolina, Chapel Hill, NC, USA (1993)Google Scholar
- 8.Köthe, U.: Integrated edge and junction detection with the boundary tensor. In: Proc. ICCV 2003, Nice, France, vol. 1, pp. 424–431 (2003)Google Scholar
- 10.Shizawa, M., Mase, K.: Simultaneous multiple optical flow estimation. In: Proc. Int. Conf. Pattern Recognition, pp. 274–278 (1990)Google Scholar
- 11.Shizawa, M., Mase, K.: A unified computational theory for motion transparency and motion boundaries based on eigenenergy analysis. In: Proc. CVPR 1991, pp. 289–295 (1991)Google Scholar
- 12.Shizawa, M., Iso, T.: Direct representation and detecting of multi-scale, multi-orientation fields using local differentiation filters. In: Proc. CVPR 1993, pp. 508–514 (1993)Google Scholar
- 13.Aach, T., Stuke, I., Mota, C., Barth, E.: Estimation of multiple local orientations in image signals. In: Proc. ICASSP 2004, Montreal, Canada, pp. 553–556 (2004)Google Scholar
- 14.Mota, C., Aach, T., Stuke, I., Barth, E.: Estimation of multiple orientations in multi-dimensional signals. In: Proc. ICIP 2004, Singapore, pp. 2665–2668 (2004)Google Scholar
- 17.Förstner, W., Gülch, E.: A fast operator for detection and precise location of distinct points, corners and centres of circular patterns. In: Proc. ISPRS Intercomm. Workshop, pp. 281–305 (1987)Google Scholar