Skip to main content
SpringerLink
Log in

Multimodal remote sensing image registration based on adaptive multi-scale PIIFD

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In recent years, due to the wide application of multi-sensor vision systems, multimodal image acquisition technology has continued to develop. Monomodal images cannot meet the needs of image analysis, which requires image fusion and stitching to process images for better image analysis. Image registration is an important prerequisite of image fusion and stitching. Most of the existing multimodal image registration methods are only suitable for two modalities, and cannot uniformly register multimodal image data. Therefore, this paper proposes a multimodal remote sensing image registration method based on adaptive multi-scale PIIFD (AM-PIIFD). This method extracts KAZE features in the scale space constructed by nonlinear diffusion filtering. It can effectively preserve the edge feature information while filtering out the noise. Then, the proposed AM-PIIFD feature descriptor is used to describe the multi-scale features. Finally, according to the consistency of the feature main orientation, most of the mismatches are removed, and the image alignment transformation is realized. The qualitative and quantitative comparisons with the other three advanced methods show that our method can achieve good performance in multimodal remote sensing image registration.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Data Availability

The data that support the findings of this study are available from [12, 21,22,23] but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of [12, 21,22,23].

References

  1. Zitova B, Flusser J (2003) Image registration methods: a survey. Image Vis Comput 21(11):977–1000

    Article  Google Scholar 

  2. Tondewad MPS, Dale MMP (2020) Remote sensing image registration methodology: review and discussion. Procedia Comput Sci 171:2390–2399

    Article  Google Scholar 

  3. Wells WM III, Viola P, Atsumi H, Nakajima S, Kikinis R (1996) Multi-modal volume registration by maximization of mutual information. Med Image Anal 1(1):35–51

    Article  PubMed  Google Scholar 

  4. Viola P, Wells WM III (1997) Alignment by maximization of mutual information. Int J Comput Vis 24(2):137–154

    Article  Google Scholar 

  5. Goshtasby A, Stockman GC, Page CV (1986) A region-based approach to digital image registration with subpixel accuracy. IEEE Trans Geosci Remote Sens 3:390–399

    Article  ADS  Google Scholar 

  6. Lowe G (2004) Sift-the scale invariant feature transform. Int J 2(91–110):2

    Google Scholar 

  7. Sedaghat A, Mokhtarzade M, Ebadi H (2011) Uniform robust scale-invariant feature matching for optical remote sensing images. IEEE Trans Geosci Remote Sens 49(11):4516–4527

    Article  ADS  Google Scholar 

  8. Alcantarilla PF, Bartoli A, Davison AJ (2012) Kaze features. In: European conference on computer vision. Springer, pp 214–227

  9. Pourfard M, Hosseinian T, Saeidi R, Motamedi SA, Abdollahifard MJ, Mansoori R, Safabakhsh R (2021) KAZE-SAR: SAR image registration using KAZE detector and modified SURF descriptor for tackling speckle noise. IEEE Trans Geosci Remote Sens 60:1–12

    Article  Google Scholar 

  10. Ma W, Wen Z, Wu Y, Jiao L, Gong M, Zheng Y, Liu L (2016) Remote sensing image registration with modified sift and enhanced feature matching. IEEE Geosci Remote Sens Lett 14(1):3–7

    Article  ADS  Google Scholar 

  11. Chen J, Tian J, Lee N, Zheng J, Smith RT, Laine AF (2010) A partial intensity invariant feature descriptor for multimodal retinal image registration. IEEE Trans Biomed Eng 57(7):1707–1718

    Article  PubMed  PubMed Central  Google Scholar 

  12. Li J, Hu Q, Ai M (2019) RIFT: multi-modal image matching based on radiation-variation insensitive feature transform. IEEE Trans Image Process 29:3296–3310

    Article  ADS  Google Scholar 

  13. Du Q, Fan A, Ma Y, Fan F, Huang J, Mei X (2018) Infrared and visible image registration based on scale-invariant PIIFD feature and locality preserving matching. IEEE Access 6:64107–64121

    Article  Google Scholar 

  14. Gao C, Li W (2021) Multi-scale PIIFD for registration of multi-source remote sensing images. arXiv:2104.12572

  15. Wang Q, Gao X, Wang F, Ji Z, Hu X (2020) Feature point matching method based on consistent edge structures for infrared and visible images. Appl Sci 10(7):2302

    Article  CAS  Google Scholar 

  16. Perona P, Malik J (1990) Scale-space and edge detection using anisotropic diffusion. IEEE Trans Pattern Anal Mach Intell 12(7):629–639

    Article  Google Scholar 

  17. Weickert J (2001) Efficient image segmentation using partial differential equations and morphology. Pattern Recognit 34(9):1813–1824

    Article  ADS  Google Scholar 

  18. Beis JS, Lowe DG (1997) Shape indexing using approximate nearest-neighbour search in high-dimensional spaces. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition. IEEE, pp 1000–1006

  19. Fischler MA, Bolles RC (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24(6):381–395

    Article  MathSciNet  Google Scholar 

  20. Wang G, Wang Z, Chen Y, Zhao W (2015) Robust point matching method for multimodal retinal image registration. Biomed Sig Process Control 19:68–76

    Article  Google Scholar 

  21. Jiang X, Ma J, Xiao G, Shao Z, Guo X (2021) A review of multimodal image matching: methods and applications. Inf Fusion 73:22–71

    Article  Google Scholar 

  22. Yao Y, Zhang Y, Wan Y, Liu X, Yan X, Li J (2022) Multi-modal remote sensing image matching considering co-occurrence filter. IEEE Trans Image Process 31:2584–2597

    Article  ADS  PubMed  Google Scholar 

  23. Jiang Q, Liu Y, Yan Y, Deng J, Fang J, Li Z, Jiang X (2020) A contour angle orientation for power equipment infrared and visible image registration. IEEE Trans Power Deliv 36(4):2559–2569

    Article  Google Scholar 

Download references

Author information

Author notes

  1. Ning Li and Yuxuan Li contributed equally to this work.

Authors and Affiliations

  1. School of Electronic Engineering, Beijing University of Posts and Telecommunications, Beijing, People’s Republic of China

    Ning Li, Yuxuan Li & Jichao Jiao

  2. ZJU-UIUC Institute, Zhejiang University, Haining, Zhejiang, 314400, China

    Yuxuan Li

  3. College of Civil Engineering and Architecture, Zhejiang University, Hangzhou, Zhejiang, 310058, China

    Yuxuan Li

Authors
  1. Ning Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuxuan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jichao Jiao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yuxuan Li.

Ethics declarations

Conflicts of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, N., Li, Y. & Jiao, J. Multimodal remote sensing image registration based on adaptive multi-scale PIIFD. Multimed Tools Appl (2024). https://doi.org/10.1007/s11042-024-18756-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11042-024-18756-1

Keywords

Search

Navigation