Advertisement

Neural Processing Letters

, Volume 45, Issue 1, pp 75–94 | Cite as

Multi-focus Image Fusion Based on the Improved PCNN and Guided Filter

  • Zhaobin WangEmail author
  • Shuai Wang
  • Ying Zhu
Article

Abstract

This paper proposes a novel multi-focus image fusion method based on pulse coupled neural networks (PCNN) and guided filter. PCNN matches human visual perception very well. And guided filter is an edge-preserving filter which is proposed in recent years. In our method, the fusion process consists of the following steps: firstly, the source images are preliminarily fused with the guided filter. Then the intermediate fused image is employed to motivate the improved PCNN to generate a fusion map. Finally, the source images are fused according to the fusion map. Six contrast methods are employed to evaluate the performance of the proposed approach in six groups of experiments. The experimental results show that the proposed method outperforms the most existing methods in both subjective visual effect and objective evaluation criteria.

Keywords

Image fusion Multi-focus image PCNN Guided filter Selection rule 

Notes

Acknowledgments

We thank the associate editor and the reviewers for their helpful and constructive suggestions. The authors also would like to express the profound thanks to Zheng Liu for his generous help. This work was jointly supported by China Postdoctoral Science Foundation (Grant No. 2013M532097), Fundamental Research Funds for the Central Universities (lzujbky-2014-52), National Science Foundation of China (Grant Nos. 61201421 & 61175012), and Science Foundation of Gansu Province of China (Grant No. 1208RJYA058).

References

  1. 1.
    Li S, Yang B (2008) Multifocus image fusion by combining curvelet and wavelet transform. Pattern Recognit Lett 29(9):1295–1301CrossRefGoogle Scholar
  2. 2.
    Huang W, Jing Z (2007) Multi-focus image fusion using pulse coupled neural network. Pattern Recognit Lett 28(9):1123–1132CrossRefGoogle Scholar
  3. 3.
    Cao L, Jin L, Tao H, Li G, Zhuang Z, Zhang Y (2015) Multi-focus image fusion based on spatial frequency in discrete cosine transform domain. IEEE Signal Process Lett 22(2):220–224CrossRefGoogle Scholar
  4. 4.
    Guo D, Yan J, Qu X (2015) High quality multi-focus image fusion using self-similarity and depth information. Opt Commun 338:138–144CrossRefGoogle Scholar
  5. 5.
    Li S, Kang X, Hu J, Yang B (2013) Image matting for fusion of multi-focus images in dynamic scenes. Inf Fusion 14(2):147–162CrossRefGoogle Scholar
  6. 6.
    Pertuz S, Puig D, Garcia MA, Fusiello A (2013) Generation of all-in-focus images by noise-robust selective fusion of limited depth-of-field images. IEEE Trans Image Process 22(3):1242–1251MathSciNetCrossRefGoogle Scholar
  7. 7.
    Yang Y, Tong S, Huang S, Lin P (2015) Multifocus image fusion based on NSCT and focused area detection. IEEE Sensors J 15(5):2824–2838Google Scholar
  8. 8.
    Liu Y, Liu S, Wang Z (2015) A general framework for image fusion based on multi-scale transform and sparse representation. Inf Fusion 24:147–164CrossRefGoogle Scholar
  9. 9.
    Liu Y, Liu S, Wang Z (2015) Multi-focus image fusion with dense SIFT. Inf Fusion 23:139–155CrossRefGoogle Scholar
  10. 10.
    Hua K-L, Wang H-C, Rusdi AH, Jiang S-Y (2014) A novel multi-focus image fusion algorithm based on random walks. J Vis Commun Image Represent 25(5):951–962CrossRefGoogle Scholar
  11. 11.
    Zhao C, Shao G, Ma L, Zhang X (2014) Image fusion algorithm based on redundant-lifting NSWMDA and adaptive PCNN. Opt Int J Light Electron Opt 125(20):6247–6255CrossRefGoogle Scholar
  12. 12.
    Eckhorn R, Reitboeck HJ, Arndt M, Dicke PW (1990) Feature-linking via synchronization among distributed assemblies: simulation of results from cat cortex. Neural Comput 2(3):293–307CrossRefGoogle Scholar
  13. 13.
    Broussard RP, Rogers SK, Oxley ME, Tarr GL (1999) Physiologically motivated image fusion for object detection using a pulse coupled neural network. IEEE Trans Neural Netw 10(3):554–563CrossRefGoogle Scholar
  14. 14.
    Ranganath HS, Kuntimad G, Johnson JL (1995) Pulse coupled neural networks for image processing. In: Proceedings of IEEE Southeastcon ’95. Visualize the future, pp 37–43Google Scholar
  15. 15.
    Johnson JL, Ritter D (1993) Observation of periodic waves in a pulse-coupled neural network. Opt Lett 18(15):1253–1255CrossRefGoogle Scholar
  16. 16.
    Johnson JL, Padgett ML (1999) PCNN models and applications. IEEE Trans Neural Netw 10(3):480–498CrossRefGoogle Scholar
  17. 17.
    Chai Y, Li HF, Guo MY (2011) Multifocus image fusion scheme based on features of multiscale products and PCNN in lifting stationary wavelet domain. Opt Commun 284(5):1146–1158CrossRefGoogle Scholar
  18. 18.
    Qu X, Hu C, Yan J (2008) Image fusion algorithm based on orientation information motivated pulse coupled neural networks. In: Proceedings of 5th world congress on intelligent control and automation, pp 2437–2441Google Scholar
  19. 19.
    Wang Z, Ma Y, Cheng F, Yang L (2010) Review of pulse-coupled neural networks. Image Vis Comput 28(1):5–13CrossRefGoogle Scholar
  20. 20.
    Liu Z, Yin H, Chai Y, Yang SX (2014) A novel approach for multimodal medical image fusion. Expert Syst Appl 41(16):7425–7435CrossRefGoogle Scholar
  21. 21.
    Geng P, Wang Z, Zhang Z, Xiao Z (2012) Image fusion by pulse couple neural network with shearlet. Opt Eng 51(6):067005CrossRefGoogle Scholar
  22. 22.
    Kavitha CT, Chellamuthu C, Rajesh R (2012) Medical image fusion using combined discrete wavelet and ripplet transforms. Procedia Eng 38:813–820CrossRefGoogle Scholar
  23. 23.
    Wang N, Ma Y, Wang W, Zhou S (2014) An image fusion method based on NSCT and dual-channel PCNN model. J Netw 9(2):501–506Google Scholar
  24. 24.
    Lang J, Hao Z (2014) Novel image fusion method based on adaptive pulse coupled neural network and discrete multi-parameter fractional random transform. Opt Lasers Eng 52:91–98CrossRefGoogle Scholar
  25. 25.
    Zhao Y, Zhao Q, Hao A (2014) Multimodal medical image fusion using improved multi-channel PCNN. Biomed Mater Eng 24(1):221–228Google Scholar
  26. 26.
    Liu F, Liao Y, Liang X (2011) Image fusion based on nonsubsampled contourlet transform and pulse coupled neural networks. In: 2011 fourth international conference on intelligent computation technology and automation, vol 2, pp 572–575Google Scholar
  27. 27.
    Wang Z, Ma Y (2008) Medical image fusion using m-PCNN. Inf Fusion 9(2):176–185CrossRefGoogle Scholar
  28. 28.
    Wang Z, Ma Y, Gu J (2010) Multi-focus image fusion using PCNN. Pattern Recognit 43(6):2003–2016CrossRefzbMATHGoogle Scholar
  29. 29.
    Zhang S, Yuan Y, Su L, Hu L, Liu H (2013) Polarization image fusion algorithm based on improved PCNN. In: Proceedings of international conference on optical instruments and technology: optoelectronic imaging and processing technology, vol 9045, no. 37, p 90450BGoogle Scholar
  30. 30.
    Yan J, Kang B, Zhu W-P (2013) Fusion framework for multi-focus images based on compressed sensing. IET Image Process 7(4):290–299MathSciNetCrossRefGoogle Scholar
  31. 31.
    Agrawal D, Singhai J (2010) Multifocus image fusion using modified pulse coupled neural network for improved image quality. IET Image Process 4(6):443CrossRefGoogle Scholar
  32. 32.
    He K, Sun J, Tang X (2013) Guided image filtering. IEEE Trans Pattern Anal Mach Intell 35(6):1397–1409CrossRefGoogle Scholar
  33. 33.
    Li S, Kang X, Hu J (2013) Image fusion with guided filtering. IEEE Trans Image Process 22(7):2864–2875CrossRefGoogle Scholar
  34. 34.
    Pham CC, Jeon JW (2015) Efficient image sharpening and denoising using adaptive guided image filtering. IET Image Process 9(1):71–79CrossRefGoogle Scholar
  35. 35.
    Kang X, Li S, Benediktsson JA (2014) Spectral-spatial hyperspectral image classification with edge-preserving filtering. IEEE Trans Geosci Remote Sensors 52(5):2666–2677CrossRefGoogle Scholar
  36. 36.
    Wang Z, Wang S, Zhu Y, Ma Y (2015) Review of image fusion based on pulse-coupled neural network. Arch Comput Methods Eng. doi: 10.1007/s11831-015-9154-z
  37. 37.
    Zhang J, Lu T (2003) Enhancement of image by PCNN. Comput Eng Appl 39(19):93–95Google Scholar
  38. 38.
    Draper N, Smith H (1981) Applied regression analysis. Wiley, New YorkzbMATHGoogle Scholar
  39. 39.
    Qu X-B, Yan J-W, Xiao H-Z, Zhu Z-Q (2008) Image fusion algorithm based on spatial frequency-motivated pulse coupled neural networks in nonsubsampled contourlet transform domain. Acta Autom Sin 34(12):1508–1514CrossRefzbMATHGoogle Scholar
  40. 40.
    Rockinger O. Image fusion toolbox for Matlab. Technical report (Online). http://www.metapix.de/toolbox.htm
  41. 41.
    Kang X. The code for GFF (Online). http://xudongkang.weebly.com/
  42. 42.
    Qu X. The code of NSCT-SF-PCNN (Online). https://sites.google.com/site/xiaoboxmu/publication. Accessed 1 Jan 2015
  43. 43.
    Hossny M, Nahavandi S, Creighton D (2008) Comments on “Information measure for performance of image fusion”. Electron Lett 44(18):1066CrossRefGoogle Scholar
  44. 44.
    Liu Z, Blasch E, Xue Z, Zhao J, Laganière R, Wu W (2011) Objective assessment of multiresolution image fusion algorithms for context enhancement in night vision: a comparative study. IEEE Trans Pattern Anal Mach Intell 34(1):94–109CrossRefGoogle Scholar
  45. 45.
    Wang Q, Shen Y, Jin J (2008) Performance evaluation of image fusion techniques. In: Stathaki T (ed) Image fusion algorithms and applications. Academic Press, Oxford, pp 469–492CrossRefGoogle Scholar
  46. 46.
    Zheng Y, Essock EA, Hansen BC, Haun AM (2007) A new metric based on extended spatial frequency and its application to DWT based fusion algorithms. Inf Fusion (Spec Issue) 8(2):177–192Google Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  1. 1.School of Information Science and EngineeringLanzhou UniversityLanzhouChina
  2. 2.Institute of BiologyGansu Academy of SciencesLanzhouChina

Personalised recommendations