Advertisement

An effective image fusion algorithm based on grey relation of similarity and morphology

  • Caiping Liu
  • Yahui Long
  • Jianxu Mao
  • Hui Zhang
  • Ruizhi Huang
  • Yang Dai
Original Research

Abstract

Considering the problems of the limited energy in wireless multi-media sensor networks (WMSNs) and the focused regions discontinuity of the fused image obtained using traditional multi-scale analysis tools (MST)-based methods, an effective multi-focus image fusion algorithm is proposed in this paper. In this method, the original fused image is obtained based on wavelet transform where the low-frequency coefficients are fused by average scheme, whereas the high-frequency coefficients are fused by the proposed merging rule consisting of the grey relation analysis of similarity and local area energy. Then, grey absolute relation analysis is again utilized as measurement indicator to estimate the similarities between the initial fused image and source images, during which the initial map is acquired and then corrected by the mathematical morphological opening and closing. Finally, the fused image is obtained with the guidance of the corrected map, namely the decision map. Experiment results demonstrate that the fused image using the proposed algorithm is more continuous in focused region and more similar to source images in brightness compared with state-of-art multi-focus image fusion algorithms, such as Curvelet transform, lifting stationary wavelet transform (LSWT), non-subsampled contourlet transform (NSCT) and non-subsampled shearlet transform (NSST). Meanwhile, the proposed method shows better superiority in term of the computational complexity.

Keywords

Image fusion Multi-focus image Grey relational analysis Mathematical morphology Computational complexity 

Notes

Acknowledgements

The authors thank the editors and the anonymous reviewers for their detailed review, valuable comments and constructive suggestions. This work is supported by the National Natural Science Foundation of China (No. 61733004 and 61573134), National Science and Technology Support Program of the Ministry of Science and Technology of China (No. 2015BAF13B00), Natural Science Foundation of Human Province of China (No. 2018JJ3079).

References

  1. Bhateja V, Patel H, Krishn A, Sahu A, Lay-Ekuakille A (2015) Multimodal medical image sensor fusion framework using cascade of wavelet and contourlet transform domains. IEEE Sens J 15(12):6783–6790.  https://doi.org/10.1109/jsen.2015.2465935 CrossRefGoogle Scholar
  2. Cao X, Wang RC, Huang HP (2012) Multi-path routing algorithm for video stream in wireless multimedia sensor networks. J Softw 23(01):108–121.  https://doi.org/10.3724/SP.J.1001.2012.04070 CrossRefGoogle Scholar
  3. Cao JW, Lai XP, Chen T, Fan JY (2016) Accurate and efficient scene recognition with compact BoW and ensemble ELM. In: 2016 12th World Congress on Intelligent Control and Automation, pp 2058–2062.  https://doi.org/10.1109/WCICA.2016.7578545 
  4. Chai Y, Li H, Li Z (2011) Multifocus image fusion scheme using focused region detection and multiresolution. Opt Commun 284(19):4376–4389.  https://doi.org/10.1016/j.optcom.2011.05.046 CrossRefGoogle Scholar
  5. Chen Y, Xiong J, Liu HL, Fan Q (2014) Fusion method of infrared and visible images based on neighborhood characteristic and regionalization in NSCT domain. Optik Int J Light Electron Opt 125(17):4980–4984.  https://doi.org/10.1016/j.ijleo.2014.04.006 CrossRefGoogle Scholar
  6. Deng J (1982) Control problems of grey systems. Syst Control Lett 01(05):9–18Google Scholar
  7. Ellmauthaler A, Pagliari CL, Silva EABD (2013) Multiscale image fusion using the undecimated wavelet transform with spectral factorization and nonorthogonal filter banks. IEEE Trans Images Process 22(03):1005–1017MathSciNetCrossRefMATHGoogle Scholar
  8. Fan JY, Chen T, Cao JW (2015) Image tampering detection using noise histogram features. In: 2015 IEEE International Conference on digital signal processing, pp 1044–1048.  https://doi.org/10.1109/ICDSP.2015.7252037
  9. Gao GR, Xu LP, Feng DZ (2013) Multi-focus image fusion based on non-subsampled shearlet transform. IET Image Process 7(06):633–639.  https://doi.org/10.1049/iet-ipr.2012.0558 CrossRefGoogle Scholar
  10. Goyal S, Grover S (2012) Applying fuzzy grey relational analysis for ranking the advanced manufacturing systems. Grey Syst Theory Appl 2(02):284–298.  https://doi.org/10.1108/20439371211260243 CrossRefGoogle Scholar
  11. Guo M, Fu Z, Xi XL (2012) Novel fusion algorithm for infrared and visible images based on local energy in NSCT domain. Infrared Laser Eng 41(08):2229–2235Google Scholar
  12. He GQ, Hao CY, Wang Y (2007) New and better image fusion method based on grey relational analysis and IHS transform. Appl Res Comput 24(07):312–314Google Scholar
  13. Heshmati A, Gholami M, Rashno A (2016) Scheme for unsupervised colourCtexture image segmentation using neutrosophic set and non-subsampled contourlet transform. IET Image Process 10(06):464–473.  https://doi.org/10.1049/iet-ipr.2015.0738 CrossRefGoogle Scholar
  14. Iovane G, Giordano P, Borysenko SD (2011) Image watermarking via wavelet approach and face biometrics. J Ambient Intell Hum Comput 2(02):91–101.  https://doi.org/10.1007/s12652-010-0031-1 CrossRefGoogle Scholar
  15. Jiang D (2010) Image fusion algorithm and appliction research based on multi-scale transform. Huan University Library, Changsha, pp 25–26Google Scholar
  16. Kakerda RK, Kumar M, Mathur G (2015) Fuzzy type image fusion using hybrid DCTFFT based laplacian pyramid transform. In: International Conference on Communications and Signal Processing, pp 1049–1052.  https://doi.org/10.1109/ICCSP.2015.7322661
  17. Kong W, Lei Y, Zhao R (2015) Fusion technique for multi-focus images based on NSCT-CISCM. Optik Int J Light Electron Opt 126(21):3185–3192.  https://doi.org/10.1016/j.ijleo.2015.07.142 CrossRefGoogle Scholar
  18. Li H, Wei S, Chai Y (2012) Multifocus image fusion scheme based on feature contrast in the lifting stationary wavelet domain. EURASIP J Adv Signal Process 01:1–16Google Scholar
  19. Li S, Yang B (2010) Hybrid multiresolution method for multisensor multimodal image fusion. IEEE Sens J 10(09):1519–1526.  https://doi.org/10.1109/jsen.2010.2041924 CrossRefGoogle Scholar
  20. Liu WF, He X (2011) A novel grey relational model. Stat Decis (14):160–161.  https://doi.org/10.13546/j.cnki.tjyjc.2011.14.019 Google Scholar
  21. Liu SF, Dang YG, Fang ZG (2010) Grey system theory and application, vol 5. Science Press, Beijing, pp 95–101Google Scholar
  22. Liu CP, Long YH, Mao JX (2016) Energy-efficient multi-focus image fusion based on neighbor distance and morphology. Optik Int J Light Electron Opt 127(23):11354–11363.  https://doi.org/10.1016/j.ijleo.2016.09.038 CrossRefGoogle Scholar
  23. Lu X, Lei C, Zeng H (2018) A multi-scale contrast-based image quality assessment model for multi-exposure image fusion. Signal Process 145:233–240.  https://doi.org/10.1016/j.sigpro.2017.12.013 CrossRefGoogle Scholar
  24. Ma M, Wan RY, Yin YL (2012) Multi-focus image fusion based on grey relation of similarity in Curvelet domain. Acta Electronica Sinica 40(10):1984–1988Google Scholar
  25. Mitianoudis N, Stathaki T (2008) Optimal Contrast correction for ICA-based fusion of multimodal images. IEEE Sens J 8(12):2016–2026.  https://doi.org/10.1109/jsen.2008.2007678 CrossRefGoogle Scholar
  26. Nirmala DE, Vignesh RK, Vaidehi V (2013) Multimodal image fusion in visual sensor networks. In: 2013 IEEE International Conference on electronics, computing and communication technologies.  https://doi.org/10.1109/CONECCT.2013.6469319
  27. Qu XB, Yan JW, Xiao HZ (2008) Image fusion algorithm base on spatial frequency-motivated pulse coupled neural networks in non-subsampled contourlet transform domain. Acta Autom Sin 34(12):1508–1514CrossRefMATHGoogle Scholar
  28. Qu GH, Zhang DL (2002) Information measure for performance of image fusion. Electron Lett 38(07):313–315CrossRefGoogle Scholar
  29. Shreyamsha BK, Swamy MNS, Ahmad MO (2013) Multiresolution DCT decomposition for multi focus image fusion. In: 2013 26th Annual IEEE Canadian Conference on Electrical and Computer Engineering.  https://doi.org/10.1109/CCECE.2013.6567721
  30. Stathaki T (2008) Image fusion: algorithm and applications, vol 3. Academic Press, New York, pp 367–392Google Scholar
  31. Wang J, Li Q, Jia Z, Kasabov N, Yang J (2015) A novel multi-focus image fusion method using PCNN in nonsubsampled contourlet transform domain. Optik Int J Light Electron Opt 126(20):2508–2511.  https://doi.org/10.1016/j.ijleo.2015.06.019 CrossRefGoogle Scholar
  32. Wang YN, Xiao L, Ling ZG, Yang YM (2015) A method to calibrate vechicle-mounted cameras under urban traffic scenes. IEEE Trans Intell Trans Syst 16(6):3270–3279CrossRefGoogle Scholar
  33. Xie X, Liu Q, Hu FP (2015) A study on fast SIFT image mosaic algorithm based on compressed sensing and wavelet transform. J Ambient Intell Hum Comput 6(6):835–843.  https://doi.org/10.1007/s12652-015-0319-2 CrossRefGoogle Scholar
  34. Xydeas CS, Petrovic V (2000) Objective image fusion performance measure. Electron Lett 36(04):308–309CrossRefGoogle Scholar
  35. Yang Y, Tong S, Huang S, Lin P (2014) Log-Gabor energy based multimodal medical image fusion in NSCT domain. Comput Math Methods Med 02:835481.  https://doi.org/10.1155/2014/835481 MATHGoogle Scholar
  36. Yang Y, Tong S, Huang S, Lin P (2014) Multi-focus image fusion based on NSCT and focused area detection. IEEE Sens J 15(05):1–1.  https://doi.org/10.1109/jsen.2014.2380153 CrossRefGoogle Scholar
  37. Yang YM, Jonathan QM, Wang W (2016) Autoencoder with invertible functions for dimension reduction and image reconstruction. IEEE Trans Syst Man Cybern Syst.  https://doi.org/10.1109/TSMC.2016.2637279 Google Scholar
  38. Ye CQ, Miao QG, Wang BS (2008) An image fusion algorithm using region segmentation and contourlet transform. Acta Optica Sinica 28(03):447–453CrossRefGoogle Scholar
  39. Yin M, Liu W, Zhao X, Yin Y, Guo Y (2014) A novel image fusion algorithm based on nonsubsampled shearlet transform. Optik Int J Light Electron Opt 125(10):2274–2282.  https://doi.org/10.1016/j.ijleo.2013.10.064 CrossRefGoogle Scholar
  40. Yu ZH, Zhang ZM, Chen R (2015) A method for fusion of infrared and visible images based on contourlet transform. Radio Eng 45(08):30–34Google Scholar
  41. Zhao H, Zhao XM, Zhang TQ, Liu Y (2017) A new contourlet transform with adaptive directional partitioning. IEEE Signal Process Lett 24(06):843–847.  https://doi.org/10.1109/lsp.2017.2696886 CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.College of Computer Science and Electronic EngineeringHunan UniversityChangshaChina
  2. 2.College of Electrical and Information EngineeringHunan UniversityChangshaChina
  3. 3.College of Electrical and Information EngineeringChangsha University of Science and TechnologyChangshaChina

Personalised recommendations