Translate SAR Data into Optical Image Using IHS and Wavelet Transform Integrated Fusion
- 48 Downloads
Although synthetic aperture radar (SAR) sensors function well at all times and under all weather conditions, the images they produce are not intuitively straightforward. A novel idea based on data fusion is introduced to translate SAR data into optical image in this paper. The proposed SAR-optical image translation is implemented using an intensity–hue–saturation (IHS) and wavelet transform integrated fusion (IHSW), so as to preserve as much as spatial details from SAR data, and minimize the spectral distortion of translated output. COSMO-SkyMed and ENVISAT-ASAR images are translated into optical images with the fusion of Landsat TM images, and the fusion results are compared with some conventional fusion methods, as well as the texture synthesis approach. Quality assessment of different fused outputs is carried out by using six quality indices. Visual and statistical comparisons of the final results indicate that the proposed approach achieves an effective translation from SAR to optical image and is superior to texture synthesis-based algorithm in terms of preserving spatial and spectral information. The proposed translation technique presents an alternative to improve the interpretability of SAR images.
KeywordsImage translation Image fusion Synthetic aperture radar (SAR) Wavelet transform
This work was funded by National Key Technologies R&D Program of China (2012BAH83F00).
Compliance with Ethical Standards
Conflict of interest
The authors declare that they have no conflict of interest.
- Carper, W. J. (1990). The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data. Photogrammetric Engineering and Remote Sensing, 56(4), 457–467.Google Scholar
- Chavez, P. S., Jr., & Yaw Kwarteng, A. (1989). Extracting spectral contrast in Landsat Thematic Mapper image data using selective principal component analysis. Photogrammetric Engineering and Remote Sensing, 55(3), 339–348.Google Scholar
- Chen, T., Cheng, M.-M., Tan, P., Shamir, A., & Hu, S.-M. (2009). Sketch2Photo: Internet image montage. ACM Transactions on Graphics (TOG), 28(5), 1–10.Google Scholar
- Ehlers, M., & Klonus, S. (2008). Quality assessment for multitemporal and multisensor image fusion. In SPIE remote sensing (Vol. 7110, pp. 71100T-71100T-9).Google Scholar
- Fu, Z., & Zhang, W. (2012). Research on image translation between SAR and optical imagery. In ISPRS annals of photogrammetry, remote sensing and spatial information sciences (Vol. I-7, pp. 273–278).Google Scholar
- Garzelli, A. (2002). Possibilities and limitations of the use of wavelets in image fusion. In Procedings of the international geoscience and remote sensing symposium, 2002 (pp. 66–68).Google Scholar
- Gatys, L. A., Ecker, A. S., & Bethge, M. (2016). Image style transfer using convolutional neural networks. In The IEEE conference on computer vision and pattern recognition (pp. 2414–2423).Google Scholar
- Laben, C., & Brower, B. (2000). Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening. United States Patent 6.Google Scholar
- Longbotham, N., Pacifici, F., Glenn, T., Zare, A., Volpi, M., Tuia, D., et al. (2012). Multi-modal change detection, application to the detection of flooded areas: Outcome of the 2009–2010 data fusion contest. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 5(1), 331–342.CrossRefGoogle Scholar
- Prashanth, H. S., Shashidhara, H. L., & Murthy, K. N. B. (2009). Image scaling comparison using universal image quality index. In 2009 international conference on advances in computing control and telecommunication technologies (pp. 859–863).Google Scholar
- Vrabel, J. (1996). Multispectral imagery band sharpening study. Photogrammetric Engineering and Remote Sensing, 62(9), 1075–1083.Google Scholar
- Wald, L. (2000). Quality of high resolution synthesized images: Is there a simple criterion? In Proceedings of the fusion of earth data: Merging point measurements, raster maps and remotely sensed images (Vol. 1, pp. 99–105).Google Scholar
- Yuhas, R., Goetz, A. F. H., & Boardman, J. W. (1992). Descrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm. In Summaries of the third annual JPL airborne geoscience workshop (pp. 147–149).Google Scholar
- Zhou, Z., Meng, Y., Yang, P., Hu, B., & Chen, C. (2016). Extended GIHS fusion for pan-sharpening based on image model. In Geoscience and remote sensing symposium (IGARSS 2016) (Vol. 1, pp. 2598–2601).Google Scholar