Skip to main content

Non Subsampled Shearlet Transform Based Fusion of Multiple Exposure Images

SN Computer Science volume 1, Article number: 326 (2020) Cite this article

Abstract

Fusion of multiple exposure images has attracted attention over the past decade and several algorithms have been developed, so as to capture the entire dynamic range of the scene in a single image. Capturing images with changes in exposure settings leads to a set of multiple exposure images with different areas of the scene highlighted in different image. Weak edges and fine textures of the image are lost during an under or over exposure. Also for objective evaluation we need to measure and both the structural and textural information in the images simultaneously. To address this issue an algorithm based on the Non-subsampled shearlet transform (NSST) for fusing multiple exposure images is proposed so as to depict clearly the dimly lit, brightly lit and well lit regions in a single fused image. In the proposed algorithm NSST decomposition is first performed on the images to obtain the multi-scale and multi-direction representations. The high frequency bands are fused by retaining the pixels with the highest value coefficients at each sub band at each level. Whereas the low frequency bands are fused by averaging operation. Proposed method leads to better results in visual quality.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

References

  1. Mertens T, Kautz J, Van Reeth F. Exposure fusion: a simple and practical alternative to high dynamic range photography. Comput Gr Forum. 2009;28(1):161–71.

    Article  Google Scholar 

  2. Shanmuganathan Raman, Subhasis Chaudhuri. Low dynamic range solutions to the high dynamic range imaging problem. J Meas Sci Instrum. 2010;1(1):32–6.

    Google Scholar 

  3. Bouridane AAA, Milligan P. Walsh-Hadamard transforms for signal processing. IEEE Trans Circuits Syst. 2001;II(148):377–83.

    Google Scholar 

  4. Chiorean L, Vaida MF. Medical image fusion based on discrete wavelet transform using Java technology. In: Proceedings of the ITI 2009 31st International Conference on Information Technology Interfaces. IEEE; 2009, p. 55–60.

  5. Amia F, Kuala S, Aceh B. Multi-focus image fusion using discrete wavelet transform. In: IEEE Transactions Circuits System II, Analog Digital Signal Process. IEEE; 2009. p. 718–726.

  6. Zhang Q. Multifocus image fusion using the nonsubsampled contourlet transform. Signal Process. 2009;89(7):1334–46 Elsevier.

    Article  Google Scholar 

  7. Quan S, Qian W, Guo J, Zhao H. Visible and infrared image fusion based on curvelet transform. In: The 2014 2nd International Conference on Systems and Informatics (ICSAI 2014). IEEE; 2014. p. 828–832.

  8. Yang Y, Tong S, Huang S, Lin P. Multifocus image fusion based on NSCT and focused area detection. IEEE Sens J. 2014;15(5):2824–38 IEEE.

    Google Scholar 

  9. Zhang N, Wang P, Zong X. A novel peripheral enhancement framework for CT and MRI image fusion in NSST domain. J Med Imaging Health Informat. 2018;8(5):891–9 American Scientific Publishers.

    Article  Google Scholar 

  10. Liu Xingbin, Mei Wenbo, Du Huiqian, Bei Jiadi. A novel image fusion algorithm based on nonsubsampled shearlet transform and morphological component analysis. Signal Image Video Process. 2016;10(5):959–66.

    Article  Google Scholar 

  11. Yang J, Wu Y, Wang Y, Xiong Y. A novel fusion technique for CT and MRI medical image based on NSST. In: 2016 Chinese Control and Decision Conference (CCDC). IEEE; 2016. p. 4367–4372.

  12. Raman S, Chaudhuri S. Bilateral filter based compositing for variable exposure photography. In: Eurographics (short papers); 2009. p. 1–4.

  13. Mantiuk R, Kim KJ, Rempel AG, Heidrich W. HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions. ACM TOG. 2011;30(4):1–14.

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank Tom Mertens, Jan Kautz and Frank Van Reeth for providing us with code of Exposure Fusion algorithm and also with the set of multiple exposure house images in Fig. 1. We would like to thank the CAVE Computer Vision Laboratory, Columbia University for making available the multiple exposure images from their database shown in Figures, Figs. 5 and 8.

Author information

Authors and Affiliations

  1. Department of Electronics Engineering, Datta Meghe College of Engineering, Sector-3, Airoli, Navi Mumbai, 400708, India

    Vivek Ramakrishnan & D. J. Pete

Authors
  1. Vivek Ramakrishnan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. D. J. Pete
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vivek Ramakrishnan.

Ethics declarations

Funding

No funding sources

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Ramakrishnan, V., Pete, D.J. Non Subsampled Shearlet Transform Based Fusion of Multiple Exposure Images. SN COMPUT. SCI. 1, 326 (2020). https://doi.org/10.1007/s42979-020-00343-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-020-00343-4

Keywords

  • Exposure
  • Sub-sampling
  • Shearlet
  • Fusion
  • Multi-scale
  • Multi-direction
  • Averaging
  • Visual