SIFT-FANN: An efficient framework for spatio-spectral fusion of satellite images
- 181 Downloads
Image fusion techniques are widely used for remote sensing data. A special application is for using low resolution multi-spectral image with high resolution panchromatic image to obtain an image having both spectral and spatial information. Alignment of images to be fused is a step prior to image fusion. This is achieved by registering the images. This paper proposes the methods involving Fast Approximate Nearest Neighbor (FANN) for automatic registration of satellite image (reference image) prior to fusion of low spatial resolution multi-spectral QuickBird satellite image (sensed image) with high spatial resolution panchromatic QuickBird satellite image. In the registration steps, Scale Invariant Feature Transform (SIFT) is used to extract key points from both images. The keypoints are then matched using the automatic tuning algorithm, namely, FANN. This algorithm automatically selects the most appropriate indexing algorithm for the dataset. The indexed features are then matched using approximate nearest neighbor. Further, Random Sample Consensus (RanSAC) is used for further filtering to obtain only the inliers and co-register the images. The images are then fused using Intensity Hue Saturation (IHS) transform based technique to obtain a high spatial resolution multi-spectral image. The results show that the quality of fused images obtained using this algorithm is computationally efficient.
KeywordsImage fusion Scale invariant feature transform Fast approximate nearest Neighbor
The authors would like to thank Dr. H. Honne Gowda from KSTA, Bangalore and P.G. Diwakar from ISRO, Bangalore, India for providing the satellite images.
The authors would like to thank the anonymous reviewers for their comments.
- Al-Wassai, F. A., Kalyankar, N. V., & Al-Zuky, A. A. (2011). The IHS Transformations Based Image Fusion. Global Research in Computer Science, 2(5), 70–77.Google Scholar
- Deza, Elena; Deza, Michel Marie (2009). Encyclopedia of distances. Springer. p. 94.Google Scholar
- Fischer M. A., Bolles R.C. (1981). Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM. Google Scholar
- Heather, J. P., & Smith, M. I. (2005). Multimodel image registration with applications to image fusion. In 8th international conference on information fusion. Philadelphia: USA.Google Scholar
- Kour, G., & Singh, S. P. (2013). Image Fusion Parameter estimation and comparison between SVD and DWT technique. International Journal of Advanced Research in Electrical, Electronics and Instrumentation Engineering, 2(11).Google Scholar
- Muja M., Lowe D. G. (2009). Fast approximate nearest neighbors with automatic algorithm configuration. Proceedings of the International Conference on Computer Vision Theory and Applications. Google Scholar
- Padwick C., Deskevich M., Pacifici F., Smallwood S. (2010). Worldview-2 pan-sharpening. Proc ASPRS.Google Scholar
- Senthilnath, J., & Prasad, R. (2014). A new sift matching criteria in a genetic algorithm framework for registering multisensory satellite imagery. In Proceedings of the 2014 Indian Conference on Computer Vision Graphics and Image Processing ACM (21).Google Scholar
- Senthilnath, J., Yang, X. S., & Benediktsson, J. A. (2014b). Automatic registration of multi-temporal remote sensing images based on nature-inspired techniques. International Journal of Image and Data Fusion, 5(4), 263–284.Google Scholar
- Silpa-Anan C. and Hartley R. (2008). Optimized KD-trees for fast image descriptor matching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Google Scholar
- Thomas J., Bowyer K. W., Kareem A. (2011). Towards a robust automated hurricane damage assessment from high resolution images. 13th International Conference on Wind Engineering. Google Scholar
- Zitova, B., & Flusser, J. (2003). Image registration methods: a survey.Image and vision computing, 21(11), 977–1000.Google Scholar