Abstract
Many variants of MI exist in the literature. These vary primarily in how the joint histogram is populated. This paper places the four main variants of MI: Standard sampling, Partial Volume Estimation (PVE), In-Parzen Windowing and Post-Parzen Windowing into a single mathematical framework. Jacobians and Hessians are derived in each case. A particular contribution is that the non-linearities implicit to standard sampling and post-Parzen windowing are explicitly dealt with. These non-linearities are a barrier to their use in optimisation. Side-by-side comparison of the MI variants is made using eight diverse data-sets, considering computational expense and convergence. In the experiments, PVE was generally the best performer, although standard sampling often performed nearly as well (if a higher sample rate was used). The widely used sum of squared differences metric performed as well as MI unless large occlusions and non-linear intensity relationships occurred. The binaries and scripts used for testing are available online.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Thevenaz, P., Unser, M.: Optimization of mutual information for multi-resolution image registration. IEEE Trans. On Image Processing 9, 2083–2099 (2000)
Pluim, J., Maintz, J., Viergever, M.: Interpolation artefacts in mutual information-based image registration. Computer Vision And Image Understanding 77, 211–232 (2000)
Tsao, J.: Interpolation artifacts in multimodality image registration based on maximisation of mutual information. IEEE. Trans. Medical Imaging 22, 854–864 (2003)
Maes, F.: Segmentation and registration of multimodal medical images: From theory, implementation and validation to a useful tool in clinical practice. PhD thesis, Dept. Elect. Eng. (ESAT/PSI), KU Leuven, Leuven, Belgium (1998)
Viola, P., Wells, W.: Alignment by maximization of mutual information. In: Proc. Int’l Conf. on Computer Vision, Boston, MA, USA, pp. 16–23 (1995)
Studholme, C., Hill, D., Hawkes, D.: Automated 3d registration of truncated mr and ct images of the head. In: Proc. British Machine Vision Conference, pp. 27–36 (1995)
Collignon, A., Maes, F., Delaere, D., Vandermeulen, D., Suetens, P., Marchal, G.: Automated Multi-modality image registration based on information theory. In: Information Processing in Medical Imaging, pp. 263–374. Kluwer Academic, Dordrecht (1995)
Shannon, C.: A mathematical theory of communication. The Bell System Technical Journal 27, 379–423, 623–656 (1948)
Meyer, C., Boes, J., Kim, B., Bland, R., Wahl, P., Zasadny, K., Kison, P., Koral, K., Frey, K.: Demonstration of accuracy and clinical versatility of mutual information for automatic multimodality image fusion using affine and thin plate spline warped geometric deformations. Medical Image Analysis 1, 195–206 (1997)
Maes, F., Collignon, A., Vandermeulen, D., Marchal, G., Suetens, P.: Multimodality image registration by maximisation of mutual information. IEEE. Trans. On Medical Imaging 16, 187–198 (1997)
Wells, W.I., Viola, P., Atsumi, H., Nakajima, S., Kikinis, R.: Multi-modal volume registration by maximization of mutual information. Medical Image Analysis 1, 35–51 (1996)
Studholme, C., Hill, D., Hawkes, D.: Automated 3-d registration of mr and ct images of the head. Medical Image Analysis 1, 163–175 (1996)
Jenkinson, M., Smith, S.: A global optimisation method for robust affine registration of brain images. Medical Image Analysis 5, 143–156 (2001)
Pluim, J., Maintz, J., Viergever, M.: Mutual-information-based registration of medical images: A survey. IEEE Trans. Medical Imaging 22, 986–1003 (2003)
Maes, F., Vandermeulen, D., Seutens, P.: Comparative evaluation of multiresolution optimization strategies for multimodalitiy image registration by maximization of mutual information. Medical Image Analysis 3, 272–286 (1999)
Press, W., Teukolsky, S., Vetterling, W., Flannery, B.: Numerical Recipes in C, 2nd edn. Cambridge University Press, Cambridge (1992)
Marquardt, D.: An algorithm for least-squares estimation of nonlinear parameters. Journal of the Society for Industrial and Applied Mathematics 11, 431–441 (1963)
Viola, P., Wells, W.: Alignment by maximization of mutual information. Int’l Journal of Computer Vision 24, 137–154 (1997)
West, J., Fitzpatrick, J.M., Wang, M.Y., et al.: Comparison and evaluation of retrospective intermodality brain image registration techniques. J. Comput. Assisted Tomography 21, 554–566 (1997)
Parzen, E.: On estimation of a probability density function and mode. The Annals of Mathematical Statistics 33, 1065–1076 (1962)
Chen, H., Varshney, P.: Mutual information-based CT-MR brain image registration using generalised partial volume joint histogram estimation. IEEE Trans. Medical Imaging 22, 1111–1119 (2003)
Amidror, I.: Scattered data interpolation methods for electronic systems: A survey. Journal of Electronic Imaging 11, 157–176 (2002)
Unser, M., Aldroubi, A., Eden, M.: B-spline signal processing: Part i–theory. IEEE. Trans. Signal Processing 41, 821–833 (1993)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dowson, N., Bowden, R. (2006). A Unifying Framework for Mutual Information Methods for Use in Non-linear Optimisation. In: Leonardis, A., Bischof, H., Pinz, A. (eds) Computer Vision – ECCV 2006. ECCV 2006. Lecture Notes in Computer Science, vol 3951. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11744023_29
Download citation
DOI: https://doi.org/10.1007/11744023_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33832-1
Online ISBN: 978-3-540-33833-8
eBook Packages: Computer ScienceComputer Science (R0)