Abstract
The fusion of visible (RGB) and near-infrared (NIR) images has been proved effective in improving contrast and enhancing details of visible images. In this paper, we propose a novel image fusion method based on gradient-map and non-saliency to fuse RGB and NIR images to enhance the image. In this work, we use a bilateral filter to decompose the image into a base layer and a detail layer. The fusion weights of two layers are constructed by gradient-map and non-saliency respectively. Our results indicate that, compared with other methods, our proposed method has better visual effects and image detail extraction capabilities, showing that the proposed method is feasible and effective.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wu, C., Samadani, R., Gunawardane, P.: Same frame rate IR to enhance visible video conference lighting. In: IEEE International Conference on Image Processing, Brussels, Belgium, pp. 1521–1524 (2011)
Huang, Q., Yang, J., Wang, C., Chen, J., Meng, Y.: Improved registration method for infrared and visible remote sensing image using NSCT and SIFT. In: IEEE International Geoscience and Remote Sensing Symposium, Munich, Germany, pp. 2360–2363 (2012)
Liu, C., Ye, G., Wang, H.: Study of segmentation method based on infrared images and visible-light images. In: Proceedings of International Forum on Strategic Technology, Harbin, China, pp. 1049–1052 (2011)
Chen, Y., Xu, T., Zhao, B., Li, T., Wang, D.: X-ray and infrared image fusion in security field. In: IEEE International Conference of Intelligent Applied Systems on Engineering (ICIASE), Fuzhou, China, pp. 16–19 (2019)
Kurihara, K., Sugimura, D., Hamamoto, T.: Adaptive fusion of RGB/NIR signals based on face/background cross-spectral analysis for heart rate estimation. In: IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan, pp. 4534–4538 (2019)
Jung, C., Zhou, K., Feng, J.: Fusionnet: multispectral fusion of RGB and NIR images using two stage convolutional neural networks. IEEE Access 8, 23912–23919 (2020)
Zhang, X., Sim, T., Miao, X.: Enhancing photographs with near infra-red images. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA, pp. 1–8 (2008)
Sharma, V., Hardeberg, J.Y., George, S.: RGB–NIR image enhancement by fusing bilateral and weighted least squares filters. In: Color and Imaging Conference, September 2017, vol. 2017, no. 25, pp. 330–338 (2017)
Awad, M., Elliethy, A., Aly, H.A.: Adaptive near-infrared and visible fusion for fast image enhancement. IEEE Trans. Comput. Imaging 6, 408–418 (2020). https://doi.org/10.1109/TCI.2019.2956873
Tang, K., Neuvo, Y.: Detail-preserving edge enhancing filters. In: Proceedings 1992 IEEE International Conference on Systems Engineering, Kobe, Japan, pp. 580–583 (1992). https://doi.org/10.1109/ICSYSE.1992.236960
Chen, B.-H., Tseng, Y.-S., Yin, J.-L.: Gaussian-adaptive bilateral filter. IEEE Signal Process. Lett. 27, 1670–1674 (2020)
Durand, F., Dorsey, J.: Fast bilateral filtering for the display of high-dynamaic-range images. ACM Trans. Graph. 21(3), 257–266 (2002)
Fredembach, C., Süsstrunk, S.: Colouring the near-infrared. In: Color Imaging Conference, pp. 176–182 (2008)
Farbman, Z., Fattal, R., Lischinski, D., Szeliski, R.: Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans. Graph. 27(3), 67 (2008)
Brown, M.A., Süsstrunk, S.: Multi-spectral sift for scene recognition. In: CVPR, pp. 177–184 (2011)
Mirabadi, A.K., Rini, S.: The information mutual information ratio for counting image features and their matches, pp. 1–6. IWCIT2020
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Xu, Z., Hu, Y. (2022). Image Enhancement Based on the Fusion of Visible and Near-Infrared Images. In: Li, X. (eds) Advances in Intelligent Automation and Soft Computing. IASC 2021. Lecture Notes on Data Engineering and Communications Technologies, vol 80. Springer, Cham. https://doi.org/10.1007/978-3-030-81007-8_93
Download citation
DOI: https://doi.org/10.1007/978-3-030-81007-8_93
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-81006-1
Online ISBN: 978-3-030-81007-8
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)