An adaptive fusion of infrared and visible image based on learning of sparse fuzzy cognitive maps on compressive sensing

  • S. NirmalrajEmail author
  • G. Nagarajan
Original Research


In the recent trends of image processing, simultaneous image compression and fusion has become the major subject of interest. The advantage of image compression is that, it reduces the storage space and also reduces the bandwidth required for transmission. To get a high detailed compressed image, the fusion of visible and infrared images of the same scene is required. Infrared images provide hidden targets of the scene whereas visible images provide texture details of the scene. Hence if these two images are fused then it is possible to obtain a highly detailed image with all the hidden targets of the scene. This paper presents a novel method of visible and infrared image fusion based on compressed sensing and fuzzy logic. The visible and infrared images are converted with the Daubechies wavelet to decompose into lower and higher sub bands. The lower sub band is fused using maximum fusion rule, whereas the higher sub-bands are fused using effective type 2 fuzzy logic-based fusion rule. OOMP is used for retrieval of fused measured values into recovered sub-bands. The recovered higher and lower sub bands are reconstructed employing inverse discrete wavelet transform. The recommended technique is evaluated with several parameters such as Peak Signal Noise Ratio, Mean Square Error, Entropy, Mutual information, Standard deviation, Time and Compression Ratio. The results are compared to the existing techniques which show that the proposed method has a low computational complexity which produces a high detailed fused image with well-preserved edges.


Sparsity Image fusion Compressive sensing Fuzzy cognitive maps Optimised orthogonal matching pursuit (OOMP) 



  1. Baraniuk RG (2007) Compressive sensing. IEEE Signal Proc Mag 24(4):118–120CrossRefGoogle Scholar
  2. Candès EJ, Wakin MB (2008) An introduction to compressive sampling [a sensing/sampling paradigm that goes against the common knowledge in data acquisition]. IEEE Signal Process Mag 25(2):21–30CrossRefGoogle Scholar
  3. Divekar A, Ersoy O (2009) Image fusion by compressive sensing. In: 2009 17th international conference on geoinformatics, pp 1–6. IEEEGoogle Scholar
  4. Donoho DL (2006) Compressed sensing. IEEE Trans Inf Theory 52(4):1289–1306MathSciNetzbMATHCrossRefGoogle Scholar
  5. Duarte MF, Davenport MA, Takhar D, Laska JN, Sun T, Kelly KF, Baraniuk RG (2008) Single-pixel imaging via compressive sampling. IEEE Signal Process Mag 25(2):83–91CrossRefGoogle Scholar
  6. Firooz S (2005) Comparative image fusion analysis. In: IEEE proceedings of the conference on computer vision and pattern recognition, pp 1–8Google Scholar
  7. Hizem W, Allano L, Mellakh A, Dorizzi B (2009) Face recognition from synchronised visible and near-infrared images. IET Signal Proc 3(4):282–288CrossRefGoogle Scholar
  8. Hu D, Shi H (2017) Fusion of infrared and visible images based on nonsubsampled shearlet transform and block compressive sensing sampling. Ukr J Phys Opt 18(3):156–167CrossRefGoogle Scholar
  9. Huang SG (2010) Wavelet for image fusion. Graduate Institute of Communication Engineering and Department of Electrical Engineering, National Taiwan University, TaipeiGoogle Scholar
  10. Li J, Song M, Peng Y (2018a) Infrared and visible image fusion based on robust principal component analysis and compressed sensing. Infrared Phys Technol 89:129–139CrossRefGoogle Scholar
  11. Li H, Zeng Y, Yang N (2018b) Image reconstruction for compressed sensing based on joint sparse bases and adaptive sampling. Mach Vis Appl 29(1):145–157CrossRefGoogle Scholar
  12. Li J, Yuan G, Fan H (2019) Multifocus image fusion using wavelet-domain-based deep CNN. Comput Intell Neurosci 2019:4179397. CrossRefGoogle Scholar
  13. Liu C, Long Y, Mao J, Zhang H, Huang R, Dai Y (2018) An effective image fusion algorithm based on grey relation of similarity and morphology. J Ambient Intell Human Comput. CrossRefGoogle Scholar
  14. Ma J, Ma Y, Li C (2019) Infrared and visible image fusion methods and applications: a survey. Inf Fusion 45:153–178CrossRefGoogle Scholar
  15. Mahmoud MI, Dessouky MI, Deyab S, Elfouly FH (2007) Comparison between haar and daubechies wavelet transformions on FPGA technology. World Acad Sci Eng Technol 26:68–72Google Scholar
  16. Mangia M, Pareschi F, Rovatti R, Setti G (2017) Adaptive matrix design for boosting compressed sensing. IEEE Trans Circuits Syst I Regul Pap 65(3):1016–1027MathSciNetCrossRefGoogle Scholar
  17. Masini A, Corsini G, Diani M, Cavallini M (2009) Analysis of multiresolution-based fusion strategies for a dual infrared system. IEEE Trans Intell Transp Syst 10(4):688–694CrossRefGoogle Scholar
  18. Meher B, Agrawal S, Panda R, Abraham A (2019) A survey on region based image fusion methods. Inf Fusion 48:119–132CrossRefGoogle Scholar
  19. Monika R, Dhanalakshmi S, Sreejith S (2018) Coefficient random permutation based compressed sensing for medical image compression. In: Kalam A, Das S, Sharma K (eds) Advances in electronics, communication and computing. Springer, Singapore, pp 529–536CrossRefGoogle Scholar
  20. Naidu RR, Murthy CR (2016) Construction of binary sensing matrices using extremal set theory. IEEE Signal Process Lett 24(2):211–215CrossRefGoogle Scholar
  21. Nicholls E, Strens M (2006) Robust background tracking for infrared image sequences. In: IEE seminar on target tracking: algorithms and applications, Birmingham, UK, pp 129–134CrossRefGoogle Scholar
  22. Pajares G, De La Cruz JM (2004) A wavelet-based image fusion tutorial. Pattern Recognit 37(9):1855–1872CrossRefGoogle Scholar
  23. Pandit S, Shukla PK, Tiwari A (2018) A proficient video compression method based on DWT & HV partition fractal transform function. Int J Sci Eng Technol 7(2):20–24Google Scholar
  24. Qi R, Yang D, Zhang Y, Li H (2018) On recovery of block sparse signals via block generalized orthogonal matching pursuit. Signal Process 153:34–46CrossRefGoogle Scholar
  25. Romberg J (2008) Imaging via compressive sampling. IEEE Signal Process Mag 25(2):14–20CrossRefGoogle Scholar
  26. Shinoda K, Hasegawa M, Yamaguchi M, Ortega A (2018) Mosaicked multispectral image compression based on inter-and intra-band correlation. arXiv preprint arXiv:1801.03577
  27. Tan L, Yu X (2019) Medical image fusion based on fast finite shearlet transform and sparse representation. Comput Math Methods Med 2019:3503267. MathSciNetCrossRefGoogle Scholar
  28. Tirupal T, Chandra Mohan B, Srinivas Kumar S (2019) Multimodal medical image fusion based on yager’s intuitionistic fuzzy sets. Iran J Fuzzy Syst 16(1):33–48Google Scholar
  29. Tropp JA, Gilbert AC (2007) Signal recovery from random measurements via orthogonal matching pursuit. IEEE Trans Inf Theory 53(12):4655–4666MathSciNetzbMATHCrossRefGoogle Scholar
  30. Tsagaris V, Anastassopoulos V (2005) Fusion of visible and infrared imagery for night color vision. Displays 26(4–5):191–196CrossRefGoogle Scholar
  31. Wakin MB, Laska JN, Duarte MF, Baron D, Sarvotham S, Takhar D, Baraniuk RG (2006) An architecture for compressive imaging. In: 2006 international conference on image processing, pp 1273–1276. IEEEGoogle Scholar
  32. Wan T, Canagarajah N, Achim A (2008) Compressive image fusion. In: 2008 15th IEEE international conference on image processing, pp 1308–1311. IEEEGoogle Scholar
  33. Wang H, Peng J, Wu W (2002) Fusion algorithm for multisensor images based on discrete multiwavelet transform. IEE Proc Vis Image Signal Process 149(5):283–289CrossRefGoogle Scholar
  34. Wang X, Meng J, Liu F (2016a) Fusion of infrared and visible image based on compressed sensing and nonsubsam-pled shearlet transform. Int J Signal Process Image Process Pattern Recognit 9(4):37–46Google Scholar
  35. Wang LJ, Han J, Zhang Y, Bai LF (2016b) Image fusion via feature residual and statistical matching. IET Comput Vis 10(6):551–558CrossRefGoogle Scholar
  36. Yang J, Zhong W, Miao Z (2016) On the image enhancement histogram processing. In: 2016 3rd international conference on informative and cybernetics for computational social systems (ICCSS). IEEE, pp 252–255Google Scholar
  37. Yao S, Zheng Z, Wang T, Guan Q (2018) An efficient joint compression and sparsity estimation matching pursuit algorithm for artificial intelligence application. Future Gener Comput Syst 86:603–613CrossRefGoogle Scholar
  38. Zhang X, Chen Q, Men T (2009) Comparison of fusion methods for the infrared and color visible images. In: 2009 2nd IEEE international conference on computer science and information technology, pp 421–424. IEEEGoogle Scholar
  39. Zhang X, Wang Y, Wang D, Li Y (2018) Adaptive image compression based on compressive sensing for video sensor nodes. Multimed Tools Appl 77(11):13679–13699CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of EEESathyabama Institute of Science and Technology, Sathyabama Institute of Science and TechnologyChennaiIndia
  2. 2.Department of CSESathyabama Institute of Science and Technology, Sathyabama Institute of Science and TechnologyChennaiIndia

Personalised recommendations