Improving matching ability of descriptors on multi-sensor images with complementary information

Original Paper
First Online:
Received:
Accepted:
  • 99 Downloads

Abstract

This paper proposes an approach to reliably matching keypoints on multi-sensor images. Keypoint matching techniques have been successfully applied to a wide range of fields, but in most cases their success is limited to single-mode images that are acquired by the same type of sensor, e.g., both images are Landsat TIRS. The common information between multi-sensor images is typically much less than that between single-sensor images, which compromises the matching ability of descriptors and thus causes keypoint mismatchings. Observing this, we propose utilizing the edge information outside of the window for computing descriptors to improve the matching performance of descriptors. The edge information is obtained over entire images and hence encodes a global descriptor that is complementary to the local descriptor. Experimental results show that the correct rate of keypoint matchings increase on multi-sensor images.

Keywords

Descriptor Matching ability Complementary information 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgments

The authors would thank reviewers for their revision comments which helped improve this paper. This work was supported by the National Natural Science Foundation of China (Grants No., NSFC-61402046, NSFC-61471067), Fund for Beijing University of Posts and Telecommunications (Grants No., 2013XD-04, 2015XD-02), Fund for National Great Science Specific Project (Grants No. 2014ZX03002002-004), Fund for Beijing Key Laboratory of Work Safety and Intelligent Monitoring.

References

  1. Aguilera C, Barrera F, Lumbreras F, Sappa AD, Toledo R (2012) Multispectral image feature points. Sensors 12:12661–12672CrossRefGoogle Scholar
  2. Alahi A, Ortiz R, Vandergheynst P (2012) Freak: fast retina keypoint. In: Proceedings of the 2012 IEEE computer society conference on computer vision and pattern recognition, Providence, RIGoogle Scholar
  3. Ambai M, Yoshida Y (2011) CARD: compact and real-time descriptors. In: 2011 international conference on computer vision, Barcelona, SpainGoogle Scholar
  4. Bay H, Ess A, Tuytelaars T, Van Gool L (2008) Speeded-up robust features (SURF). Comput vis Image Underst 110:346–359CrossRefGoogle Scholar
  5. Brown LG (1992) A survey of image registration techniques. ACM Comput Surv (CSUR) 24:325–376CrossRefGoogle Scholar
  6. Canny J (1986) A computational approach to edge detection. IEEE Trans Pattern Anal Mach Intell PAMI 8 (6):679–698CrossRefGoogle Scholar
  7. Chen J, Tian J, Lee N, Zheng J, Smith RT, Laine AF (2010) A partial intensity invariant feature descriptor for multimodal retinal image registration. IEEE Trans Bio-Med Eng 57:1707–1718CrossRefGoogle Scholar
  8. Dellinger F, Delon J, Gousseau Y, Michel J, Tupin F (2015) Sar-sift: a sift-like algorithm for sar images. IEEE Trans Geosci Remote Sens 53:453–466CrossRefGoogle Scholar
  9. Gauglitz S, Turk M, Höllerer T (2011) Improving keypoint orientation assignment. In: Proceedings of the 2011 British machine vision conference, Dundee, ScotlandGoogle Scholar
  10. Ghassabi Z, Shanbehzadeh J, Sedaghat A, Fatemizadeh E (2013) An efficient approach for robust multimodal retinal image registration based on UR-SIFT features and PIIFD descriptors. EURASIP J Image Video Process 2013:1–16CrossRefGoogle Scholar
  11. Gong M, Zhao S, Jiao L, Tian D, Wang S (2014) A novel coarse-to-fine scheme for automatic image registration based on SIFT and mutual information. IEEE Trans Geosci Remote Sens 52:4328–4338CrossRefGoogle Scholar
  12. Ke Y, Sukthankar R (2004) PCA-SIFT: A more distinctive representation for local image descriptors. In: Proceedings of the 2004 IEEE computer society conference on computer vision and pattern recognition, Washington DC, USAGoogle Scholar
  13. Keller Y, Averbuch A (2006) Multisensor image registration via implicit similarity. IEEE Trans Pattern Anal Mach Intell 28:794–801CrossRefGoogle Scholar
  14. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60:91–110CrossRefGoogle Scholar
  15. Manjunath BS, Ohm J-R, Vasudevan VV, Yamada A (2001) Color and texture descriptors. IEEE Trans Circ Syst Video Technol 11:703–715CrossRefGoogle Scholar
  16. Mikolajczyk K, Schmid C (2005) A performance evaluation of local descriptors. IEEE Trans Pattern Anal Machine Intell 27:1615–1630CrossRefGoogle Scholar
  17. Mikolajczyk K, Tuytelaars T, Schmid C, et al (2005) A comparison of affine region detectors. Int J Comput Vis 65:43–72CrossRefGoogle Scholar
  18. Rublee E, Rabaud V, Konolige K, Bradski G (2011) ORB: An efficient alternative to SIFT or SURF. In: 2011 international conference on computer vision, Barcelona, SpainGoogle Scholar
  19. Saleem S, Sablatnig R (2014) A robust sift descriptor for multispectral images. IEEE Signal Process Lett 4:400–403CrossRefGoogle Scholar
  20. Sedaghat A, Mokhtarzade M, Ebadi H (2011) Uniform robust scale-invariant feature matching for optical remote sensing images. IEEE Trans Geosc Remote Sens 49:4516–4527CrossRefGoogle Scholar
  21. Simonson KM, Drescher SM, Tanner FR (2007) A statistics-based approach to binary image registration with uncertainty analysis. IEEE Trans Pattern Anal Mach Intell 29:112–125CrossRefGoogle Scholar
  22. Viola P, Wells III WM (1997) Alignment by maximization of mutual information. Int J Comput Vis 24:137–154CrossRefGoogle Scholar
  23. Wu Y, Ma W, Gong M, Su L, Jiao L (2015) A novel point-matching algorithm based on fast sample consensus for image registration. IEEE Geosci Remote Sens Lett 12:43–47CrossRefGoogle Scholar

Copyright information

© Saudi Society for Geosciences 2016

Authors and Affiliations

  1. 1.School of Electronic Engineering, Beijing Key Laboratory of Work Safety and Intelligent MonitoringBeijing University of Posts and TelecommunicationsBeijingChina
  2. 2.Beijing Anzhen HospitalCapital University of Medical Sciences and Beijing Institute of Heart Lung and Blood Vessel DiseaseBeijingChina

Personalised recommendations