Affine matching of intermediate symbolic representations

  • Axel Pinz
  • Manfred Prantl
  • Harald Ganster
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 970)


Spatial registration of images, features and symbols is important for the comparison of these entities, as well as for the fusion of visual information gathered from diverse sources. We introduce a method for spatial registration, which relies on the coarse correspondence of structures extracted from the images, and which does not require the establishment of point correspondences. These structures (tokens) are points, chains, polygons and regions at the level of intermediate symbolic representation (ISR). The conformai (4 affine parameter) transformation is found by a combination of hierarchical hypothesize and test, stepwise refinement of parameters, and parameter variation avoiding local minima. Since belief values guide the probability that a certain token is selected for correspondence, and many-to-many correspondences are possible, the method is very robust against a broad variety of common disturbances like incomplete segmentations, missing tokens or partial overlap. This is demonstrated using synthetic test data as well as quite complicated multisource medical images. The establishment of this kind of spatial relationships between different ISR data sets is used as one module of a system for information fusion in image understanding.


Registration Information Fusion Image Understanding 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    M.A. Abidi and R.C. Gonzalez, editors. Data Fusion in Robotics and Machine Intelligence. Academic Press, 1992.Google Scholar
  2. 2.
    Renate Bartl, Axel Pinz, and Werner Schneider. A framework for information fusion and an application to remote sensing data. In S.J. Pöppl and H. Handels, editors, Mustererkennung 1993, Informatik aktuell, pages 313–320. Springer, 1993.Google Scholar
  3. 3.
    J.R. Beveridge, R. Weiss, and E.M. Riseman. Combinatorial optimization applied to variable scale model matching. In Proc. of the 10th ICPR, volume I, pages 18–23, 1990.Google Scholar
  4. 4.
    J. Brolio, B.A. Draper, J.R. Beveridge, and A.R. Hanson. ISR: A database for symbolic processing in computer vision. IEEE Computer, pages 22–30, 1989.Google Scholar
  5. 5.
    P.J. Burt and R.J. Kolczynski. Enhanced image capture through fusion. In Proc. 4.ICCV, pages 173–182, 1993.Google Scholar
  6. 6.
    V. Clement, G. Giraudon, St. Houzelle, and F. Sandakly. Interpretation of remotely sensed images in a context of multisensor fusion using a multispecialist architecture. IEEE Transactions on Geoscience and Remote Sensing, 31(4):779–791, 1993.Google Scholar
  7. 7.
    R.T. Collins and J.R. Beveridge. Matching perspective views of coplanar structures using projective unwarping and similarity matching. In Proc.Int.Conf. of Computer Vision and Pattern Recognition, CVPR, pages 240–245, 1993.Google Scholar
  8. 8.
    Bruce A. Draper, Allen R. Hanson, and Edward M. Riseman. Learning blackboard-based scheduling algorithms for computer vision. International Journal on Pattern Recognition and Artificial Intelligence, 7(2):309–328, 1993.Google Scholar
  9. 9.
    J. Flusser and T. Suk. A moment-based approach to registration of images with affine geometric distortions. IEEE Transactions on Geoscience and Remote Sensing, 32(2):382–387, 1994.Google Scholar
  10. 10.
    W.E.L. Grimson, D.P. Huttenlocher, and D.W. Jacobs. A study of affine matching with bounded sensor error. International Journal of Computer Vision, 13(1):7–32, 1994.Google Scholar
  11. 11.
    R.C. Luo and M.G. Kay. Data fusion and sensor integration: State-of-the-art 1990s. In M.A. Abidi and R.C. Gonzalez, editors, Data Fusion in Robotics and Machine Intelligence, chapter 2, pages 7–135. Academic Press, 1992.Google Scholar
  12. 12.
    P. Meer, D. Mintz, A. Montanvert, and A. Rosenfeld. Consensus vision. In Proceedings of the AAAI-90 Workshop on Qualitative Vision, pages 111–115, 1990.Google Scholar
  13. 13.
    A. Pinz, M. Prantl, and P. Datlinger. Mapping the human retina. In Proceedings 9th SCIA, Scandinavian Conference on Image Analysis, Uppsala, volume 1, pages 189–198, 1995.Google Scholar
  14. 14.
    Axel Pinz and Renate Bartl. Information fusion in image understanding. In Proceedings of the 11.ICPR, volume I, pages 366–370. IEEE Computer Society, 1992.Google Scholar
  15. 15.
    Alexander Toet. Image fusion by a ratio of low-pass pyramid. Pattern Recognition Letters, 9:245–253, 1989.Google Scholar
  16. 16.
    R.H. Webb, G.W. Hughes, and F.C. Delori. Confocal scanning laser ophthalmoscope. Appl Opt, 26:1492–1499, 1987.Google Scholar
  17. 17.
    R. Zabih and J. Woodfill. Non-parametric local transforms for computing visual correspondence.In J.-O. Eklundh, editor, Computer Vision — ECCV'94, volume 801 of LNCS, pages 151–158. Springer, 1994.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1995

Authors and Affiliations

  • Axel Pinz
    • 1
  • Manfred Prantl
    • 1
  • Harald Ganster
    • 1
  1. 1.Institute for Computer GraphicsTechnical University GrazGrazAustria

Personalised recommendations