Multimodal Medical Image Fusion in Extended Contourlet Transform Domain

  • Seiichi Serikawa
  • Huimin Lu
  • Yujie Li
  • Lifeng Zhang
  • Shiyuan Yang
  • Akira Yamawaki
  • Shota Nakashima
  • Yuhki Kitazono
Conference paper
Part of the Studies in Computational Intelligence book series (SCI, volume 443)


As a novel of multi-resolution analysis tool, the modified sharp frequency localized contourlet transforms (MSFLCT) provides flexible multiresolution, anisotropy, and directional expansion for medical images. In this paper, we proposed a new fusion rule for multimodal medical images based on MSFLCT. The multimodal medical images are decomposed by MSFLCT. For the high-pass subband, the weighted sum modified laplacian (WSML) method is used for choose the high frequency coefficients. For the lowpass subband, the maximum local energy (MLE) method is combined with “region” idea for low frequency coefficient selection. The final fusion image is obtained by applying inverse MSFLCT to fused lowpass and highpass subbands. Abundant experiments have been made on groups of multimodality datasets, both human visual and quantitative analysis show that the new strategy for attaining image fusion with satisfactory performance.


multimodal medical image fusion maximum local energy contourlet transform 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Jannin, P., Fitzpatrick, J.M., Hawkes, D.J., Pennec, X., Shahidl, R., Vannier, M.W.: Validation of medical image processing in image-guided therapy. IEEE Trans. Med. Imaging 21(12), 1445–1449 (2002)CrossRefGoogle Scholar
  2. 2.
    Li, S., Yang, B.: Hybrid multiresolution method for multisensory multimodal image fusion. IEEE Sens. J. 10(9), 1519–1526 (2010)CrossRefGoogle Scholar
  3. 3.
    Alfano, B., Ciampi, M., De Pietro, G.: A wavelet-based algorithm for multimodal medical image fusion. Proc. Sema. Digi. Med. Tech., 117–120 (2007)Google Scholar
  4. 4.
    Burt, P.J., Adelson, E.H.: The Laplacian pyramid as a compact image code. IEEE Comm. 31(4), 532–540 (1983)CrossRefGoogle Scholar
  5. 5.
    Liu, F., Liu, J., Gao, Y.: Image fusion based on wedgelet and wavelet. Proc. Intel. Sign. Proc. Commu. Sys., 682–685 (2007)Google Scholar
  6. 6.
    Lu, H., Nakashima, S., Zhang, L., Li, Y., Yang, S., Serikawa, S.: An improved method for CT/MRI image fusion based on bandelets transfrom domain. Appl. Mech. and Mate. 103, 700–704 (2012)CrossRefGoogle Scholar
  7. 7.
    Hu, X., Lu, H., Zhang, L., Serikawa, S.: A new type of multi-focus image fusion method based on curvelet transforms. Proc. Elec. Cont. Eng., 172–175 (2010)Google Scholar
  8. 8.
    Do, M.N., Vetterli, M.: The contourlet transform: an efficient directional multiresolution image representation. IEEE Image Proc. 14(12), 2091–2106 (2005)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Lu, H., Zhang, L., Serikawa, S.: Maximum local energy: an effective approach for image fusion in beyond wavelet transform domain. Computers and Mathematics with Applications (2012), doi:10.1016/j.camwa.2012.03.017Google Scholar
  10. 10.
    Lu, Y., Do, M.N.: A new contourlet transform with sharp frequency localization. In: Proc. Inter. Conf. Image Proc., pp. 1629–1632 (2006)Google Scholar
  11. 11.
    Lu, H., Hu, X., Zhang, L., Yang, S., Serikawa, S.: Local energy based image fusion in sharp frequency localized contourlet transform. Jour. of Comp. Info. Sys. 6(12), 3997–4005 (2010)Google Scholar
  12. 12.
    Petrovic, V.S., Xydeas, C.S.: Gradient-based multiresolution image fusion. IEEE Image Proc. 13(2), 228–237 (2004)CrossRefGoogle Scholar
  13. 13.
    Eskicioglu, A.M., Fisher, P.S.: Image quality measures and their performance. IEEE Commu. 43(12), 2959–2965 (1995)CrossRefGoogle Scholar
  14. 14.
    Gershman, S.J., Vul, E., Tenenbaum, J.B.: Multistability and perceptual inference. Neural Computation 24, 1–24 (2011)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Aslantas, V., Kurban, R.: A comparison of criterion functions for fusion of multi-focus noisy images. Opt. Commu. 282(16), 3231–3242 (2009)CrossRefGoogle Scholar
  16. 16.
    Nayar, S.K., Nakagawa, Y.: Shape from focus. IEEE Patt. Anal. Mach. Itel. 16(8), 824–831 (1994)CrossRefGoogle Scholar
  17. 17.
    Huang, W., Jing, Z.: Evaluation of focus measures in multi-focus image fusion. Patt. Recog. Lett. 28(4), 493–500 (2007)CrossRefGoogle Scholar
  18. 18.
    Tsai, D.Y., Li, Y., Matsuyama, E.: Information entropy measure for evaluation of image quality. J. Digit. Imaging 21(3), 338–347 (2008)CrossRefGoogle Scholar
  19. 19.
    Keelan, B.W.: Quantifying preference. In: Handbook of Image Quality, pp. 40–45. CRC Press (2002)Google Scholar
  20. 20.
    Wang, Z., Bovik, A.C.: A universal image quality index. IEEE Signal Proc. Letters 9(3), 81–84 (2002)CrossRefGoogle Scholar
  21. 21.
    Piella, G., Heijmans, H.: A new quality metric for image fusion. In: Proc. Intel. Conf. Image Proc., vol. 2, pp. 173–176 (2003)Google Scholar
  22. 22.
    Wang, Z., Li, Q.: Information content weighting for perceptual image quality assessment. IEEE Image Proc. 20(5), 1185–1198 (2011)CrossRefGoogle Scholar
  23. 23.
    Zhang, L., Li, Y., Lu, H., Yamawaki, A., Yang, S., Serikawa, S.: Maximum local energy method and sum modified Laplacian for remote image fusion based on beyond wavelet transform. App. Math. & Info. Sci. 7(1S), 149–156 (2013)Google Scholar
  24. 24.
    Lu, H., Li, Y., Zhang, L., Yang, S., Serikawa, S.: A new method for CT/MR image fusion based on bandelets transform. In: Zhang, Y. (ed.) Future Wireless Networks and Information Systems. LNEE, vol. 141, pp. 587–592. Springer, Heidelberg (2012)Google Scholar
  25. 25.
    Lu, H., Hu, X., Nakashima, S., Zhang, L., Serikawa, S.: Local energy based multifocus image fusion in beyond wavelets transform. In: Proc. 3rd Intl. Workshop on Image Anal., pp. 21–26 (2010)Google Scholar
  26. 26.
    Lu, H., Li, Y., Kitazono, Y., Zhang, L., Yang, S., Serikawa, S.: Local energy based multifocus image fusion method on curvelet transform. In: Proc. 2010 Intl. Sym. on Comm. and Info. Tech., pp. 1154–1157 (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Seiichi Serikawa
    • 1
  • Huimin Lu
    • 1
  • Yujie Li
    • 1
  • Lifeng Zhang
    • 1
  • Shiyuan Yang
    • 1
  • Akira Yamawaki
    • 1
  • Shota Nakashima
    • 2
  • Yuhki Kitazono
    • 3
  1. 1.Department of Electrical Engineering and ElectronicsKyushu Institute of TechnologyKitakyushuJapan
  2. 2.Department of Electrical EngineeringUbe National College of TechnologyUbeJapan
  3. 3.Department of Electrical EngineeringKitakyushu National College of TechnologyKitakyushuJapan

Personalised recommendations