Skip to main content
SpringerLink
Log in

Multi-scale fusion algorithm of intensity and polarization-difference images based on edge information enhancement

  • Published:
Optical and Quantum Electronics Aims and scope Submit manuscript

Abstract

To better integrate complementary and redundant information from different source images, improve the edge information, and facilitate the target detection. A multi-scale fusion algorithm of intensity and polarization-difference (PD) images based on edge information enhancement is proposed. Firstly, intensity images are obtained by the polarization information analysis method. PD images are obtained by the adaptive polarization-difference imaging approach based on the principle of minimum mutual information. Secondly, guided filter, affine transformations and Block-Matching and 3D filtering are embedded in visibility enhancement to improve the intensity and PD images. Thirdly, the two images are decomposed into high-frequency and low-frequency images by the dual-tree complex wavelet transform (DT-CWT). The high-frequency and low-frequency images are fused by the fusion rules based on edge detection and the regional variance matching degree respectively. Finally, the fusion image is obtained by the inverse DT-CWT. Experimental results demonstrate that fusion images of the proposed algorithm are significantly improved in information entropy, average gradient, and spatial frequency. Compared with the existing methods, it can achieve a better edge enhancement for images in a turbid medium.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  • Bao, W., Wang, W., Zhu, Y.: Pleiades satellite remote sensing image fusion algorithm based on shearlet transform. J. Indian Soc. Remote Sens. 46(1), 11–29 (2018)

    Article  Google Scholar 

  • Basaeed, E., Loza, A., Al-Mualla, M.: Integrated remote sensing image fusion framework for target detection. In: IEEE International Conference on Electronics, Circuits, and Systems (2013)

  • Bhavana, V., Krishnappa, H.K.: Fusion of MRI and PET images using DWT and adaptive histogram equalization. In: International Conference on Communication and Signal Processing (2016)

  • Burt, P.J., Adelson, E.H.: The Laplacian image as a compact image code. IEEE Trans. Commun. 31(4), 671–679 (1983)

    Article  Google Scholar 

  • Chipman, L.J., Orr, T.M., Graham, L.N.: Wavelets and image fusion vol. 3, pp. 248–251 (1995)

  • Du, A., et al.: Image enhancement algorithm based on polarization character. Comput. Meas. Control 15(1), 106–108 (2007)

    Google Scholar 

  • Fan, W., Ainouz, S., Meriaudeau, F., Bensrhair, A.: Polarization-based car detection. In: IEEE ICIP, p. 5 (2018)

  • Feng, M., et al.: Image quality assessment based on local gaussian weighted fusion. Comput. Eng. 42(8), 237–242 (2016)

    Google Scholar 

  • Ganasala, P., Prasad A.D.: Medical image fusion based on Frei-Chen masks in NSST domain. In: International Conference on Signal Processing and Integrated Networks, p. 5 (2018)

  • Ghaneizad, M., Kavehvash, Z., Aghajan, H.: Human detection in occluded scenes through optically inspired multi-camera image fusion. J. Opt. Soc. Am. A Opt. Image Sci. Vis. 34(6), 856–869 (2017)

    Article  ADS  Google Scholar 

  • Gong, M., Zhou, Z., Ma, J.: Change detection in synthetic aperture radar images based on image fusion and fuzzy clustering. IEEE Trans. Image Process. 21(4), 2141–2151 (2012)

    Article  ADS  MathSciNet  MATH  Google Scholar 

  • Guan, J., Cheng, Y., Chang, G.: Time-domain polarization difference imaging of objects in turbid water. Opt. Commun. 391, 82–87 (2017)

    Article  ADS  Google Scholar 

  • Han, Y., et al.: Adaptive polarization difference imaging approach based on minimum mutual information. Infrared Laser Eng. 40(3), 487–491 (2011)

    Google Scholar 

  • Han, H., Zhang, X., Guan, F.: Computational polarization difference underwater imaging based on image fusion. Proc. Spie 244, 102440U (2017)

    Google Scholar 

  • He, K., Sun, J., Tang, X.: Guided image filtering. IEEE Trans. Pattern Anal. Mach. Intell. 35(6), 1397–1409 (2013)

    Article  Google Scholar 

  • Kim, M., Han, D.K., Ko, H.: Joint Patch Clustering-Based Dictionary Learning for Multimodal Image Fusion, pp. 198–214. Elsevier Science Publishers B. V, Amsterdam (2016)

    Google Scholar 

  • Li, S., Yang, B.: Multifocus image fusion by combining curvelet and wavelet transform. Pattern Recognit. Lett. 29(9), 1295–1301 (2008)

    Article  Google Scholar 

  • Li, Y.J., Zhang, J., Wang, M.: Improved BM3D denoising method. Iet Image Process. 11(12), 1197–1204 (2017)

    Article  Google Scholar 

  • Li, X., et al.: Polarimetric image recovery method combining histogram stretching for underwater imaging. Sci. Rep. 8, 12430 (2018)

    Article  ADS  Google Scholar 

  • Lian, C., Ruan, S., Denoeux, T.: Joint tumor segmentation in PET-CT images using co-clustering and fusion based on belief functions. IEEE Trans. Image Process. 28(2), 755–766 (2019)

    Article  ADS  MathSciNet  MATH  Google Scholar 

  • Liang, J., Ren, L., Qu, E., et al.: Method for enhancing visibility of hazy images based on polarimetric imaging. Photonics Res. 2(1), 38–44 (2014)

    Article  Google Scholar 

  • Lilai Su, L.W.: Image fusion of polarization difference imaging based on wavelet transform. In: The Proceedings of the 19th China Congress on Remote Sensing, p. 5 (2014)

  • Malik, S.S., Kumar, S.P.P.: DT-CWT: Feature Level Image Fusion Based on Dual-Tree Complex Wavelet Transform. S.A. Engineering College, Chennai (2014)

    Google Scholar 

  • Metwalli, M.R., et al.: Satellite image fusion based on principal component analysis and high-pass filtering. J. Opt. Soc. Am. A Opt. Image Sci. Vis. 27(6), 1385–1394 (2010)

    Article  ADS  Google Scholar 

  • Morgan, S.P., Khong, M.P., Somekh, M.G.: Effects of polarization state and scatterer concentration on optical imaging through scattering media. Appl. Opt. 36(7), 1560–1565 (1997)

    Article  ADS  Google Scholar 

  • Naidu, V.P.S.: Hybrid DDCT-PCA based multisensor image fusion. J. Opt. 43(1), 48–61 (2014)

    Article  MathSciNet  Google Scholar 

  • Qu, G., Zhang, D., Yan, P.: Information measure for performance of image fusion. Electron. Lett. 38(7), 313–315 (2002)

    Article  Google Scholar 

  • Rowe, M.P., et al.: Polarization-difference imaging: a biologically inspired technique for observation through scattering media. Opt. Lett. 20(6), 608–610 (1995)

    Article  ADS  Google Scholar 

  • Shen, J., Wang, H., Chen, Z., et al.: Polarization calculation and underwater target detection inspired by biological visual imaging. Sens. Transducers 169(4), 33–41 (2014)

    Google Scholar 

  • Shiwei, L.I., et al.: Polarization image fusion based on BEMD and adaptive PCNN. Laser J. 39(3), 94–98 (2018)

    Google Scholar 

  • Solomon, J.E.: Polarization imaging. Appl. Opt. 20(9), 1537–1544 (1981)

    Article  ADS  Google Scholar 

  • Song, Y., Yang, C., Yang, J.: Visual and infrared image fusion algorithm based on adaptive PCNN. In: Optical Sensing and Imaging Technology and Applications (2017)

  • Tyo, J.S., et al.: Target detection in optically scattering media by polarization-difference imaging. Appl. Opt. 35(11), 1855–1870 (1996)

    Article  ADS  Google Scholar 

  • Wei, C., Zhou, B., Guo, W.: Multi-focus image fusion based on nonsubsampled compactly supported shearlet transform. Multimed. Tools Appl. 77, 8327–8358 (2018)

    Article  Google Scholar 

  • Wu, C., Zhan, J., Jin, J.: Nighttime images fusion based on Laplacian pyramid. In: MIPPR 2017: Multispectral Image Acquisition, Processing, and Analysis (2018)

  • Xia, X.: Object Polarization Information Extraction and Application Under the Aerosol Scattering. Hefei University of Technology, Hefei (2014)

    Google Scholar 

  • Xing, X.: Physical entropy, information entropy, and their evolution equations. Sci. China 44(10), 1331–1339 (2001)

    Article  MATH  Google Scholar 

  • Zhang, X., et al.: Infrared and visible image fusion via saliency analysis and local edge-preserving multi-scale decomposition. J. Opt. Soc. Am. A Opt. Image Sci. Vis. 34(8), 1400–1410 (2017a)

    Article  ADS  Google Scholar 

  • Zhang, W., et al.: Study of visibility enhancement of hazy images based on dark channel prior in polarimetric imaging. Optik Int. J. Light Electron Opt. 130, 123–130 (2017b)

    Article  Google Scholar 

  • Zhang, L., Yang, F.B., Ji, L.: Infrared polarization and intensity image fusion algorithm based on the feature transfer. Autom. Control Comput. Sci. 52(2), 135–145 (2018a)

    Article  Google Scholar 

  • Zhang, J.-H., Zhang, Y., Shi, Z.-G.: Enhancement of dim targets in a sea background based on long-wave infrared polarisation features. IET Image Process. 12(11), 2042–2050 (2018b)

    Article  Google Scholar 

  • Zhang, J.-H., Zhang, Y., Shi, Z.-G.: Long-wave infrared polarization feature extraction and image fusion based on the orthogonality difference method. J. Electron. Imaging 27(2), 023021 (2018c)

    Article  ADS  Google Scholar 

  • Zhang, J.H., Zhang, Y., Shi, Z.G.: Long-wave infrared polarization feature extraction and image fusion based on the orthogonality difference method. J. Electron. Imaging 27(02), 1 (2018d)

    Google Scholar 

  • Zhou, Z., et al.: Fusion of infrared and visible images for night-vision context enhancement. Appl. Opt. 55(23), 6480–6490 (2016)

    Article  ADS  Google Scholar 

Download references

Acknowledgements

This work is sponsored by Qing Lan Project of Jiangsu Province-China (Grant No. 2017-AD41779), the Fundamental Research Funds for the Central Universities-China (Grant No. 30916011206) and the Six Talent Peaks Project in Jiangsu Province-China (Grant No. 2015-XCL-008).

Author information

Authors and Affiliations

  1. School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing, 210094, Jiangsu, China

    Ruxue Zhao, Lei Liu, Xiangyu Kong, Shan Jiang & Xu Chen

Authors
  1. Ruxue Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lei Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiangyu Kong
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shan Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xu Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lei Liu.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhao, R., Liu, L., Kong, X. et al. Multi-scale fusion algorithm of intensity and polarization-difference images based on edge information enhancement. Opt Quant Electron 51, 178 (2019). https://doi.org/10.1007/s11082-019-1899-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11082-019-1899-4

Keywords

Search

Navigation