Skip to main content
SpringerLink
Log in

Satellite Image Matching and Registration: A Comparative Study Using Invariant Local Features

  • Chapter
  • First Online:
Image Feature Detectors and Descriptors

Part of the book series: Studies in Computational Intelligence ((SCI,volume 630))

Abstract

The rapid increasing of remote sensing (RS) data in many applications ignites a spark of interest in the process of satellite image matching and registration. These data are collected through remote sensors then processed and interpreted by means of image processing algorithms. They are taken from different sensors, viewpoints, or times for many industrial and governmental applications covering agriculture, forestry, urban and regional planning, geology, water resources, and others. In this chapter, a feature-based registration of optical and radar images from same and different sensors using invariant local features is presented. The registration process starts with the feature extraction and matching stages which are considered as key issues when processing remote sensing data from single or multi-sensors. Then, the geometric transformation models are applied followed by the interpolation method in order to get a final registered version. As a pre-processing step, speckle noise removal is performed on radar images in order to reduce the number of false detections. In a similar fashion, optical images are also processed by sharpening and enhancing edges in order to get more accurate detections. Different blob, corner and scale based feature detectors are tested on both optical and radar images. The list of tested detectors includes: SIFT, SURF, FAST, MSER, Harris, GFTT, ORB, BRISK and Star. In this work, five of these detectors compute their own descriptors (SIFT, SURF, ORB, BRISK, and BRIEF), while others use the steps involved in SIFT descriptor to compute the feature vectors describing the detected keypoints. A filtering process is proposed in order to control the number of extracted keypoints from high resolution satellite images for a real time processing. In this step, the keypoints or the ground control points (GCPs) are sorted according to the response strength measured based on their cornerness. A threshold value is chosen to control the extracted keypoints and finalize the extraction phase. Then, the pairwise matches between the input images are calculated by matching the corresponding feature vectors. Once the list of tie points is calculated, a full registration process is followed by applying different geometric transformations to perform the warping phase. Finally and once the transformation model estimation is done, it is followed by blending and compositing the registered version. The results included in this chapter showed a good performance for invariant local feature detectors. For example, SIFT, SURF, Harris, FAST and GFTT achieve better performance on optical images while SIFT gives also better results on radar images which suffer from speckle noise. Furthermore, through measuring the inliers ratios, repeatability, and robustness against noise, variety of comparisons have been done using different local feature detectors and descriptors in addition to evaluating the whole registration process. The tested optical and radar images are from RapidEye, Pléiades, TET-1, ASTER, IKONOS-2, and TerraSAR-X satellite sensors in different spatial resolutions, covering some areas in Australia, Egypt, and Germany.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Tuytelaars, T., Mikolajczyk, K.: Local invariant feature detectors: a survey, foundations and trends. Comput. Graph. Vis. 3(3), 177–280 (2007)

    Article  Google Scholar 

  2. Juan, L., Gwon, O.: A comparison of sift, PCA-SIFT and SURF. Int. J. Image Process. 3(4), 143–152 (2009)

    Google Scholar 

  3. Hong, T.D., Schowengerdt, R.A.: A Robust technique for precise registration of radar and optical satellite images. Photogram. Eng. Remote Sens. 71(5), 585–594 (2005)

    Article  Google Scholar 

  4. Khan, N.Y., McCane, B., Wyvill, G.: SIFT and SURF performance evaluation against various image deformations on benchmark dataset. In: Proceedings of the 2011 International Conference on Digital Image Computing: Techniques and Applications (DICTA ’11), pp. 501–506 (2011)

    Google Scholar 

  5. Tahoun, M., Shabayek, A., Hassanien, A., Reulke, R.: An Evaluation of Local Features on Satellite Images. In: Proceedings of the 37th International Conference on Telecommunications and Signal Processing (TSP), pp. 695–700. Berlin, Germany (2014)

    Google Scholar 

  6. Bouchiha, R., Besbes, K.: Automatic remote sensing image registration using SURF. Int. J. Comput. Theory Eng. 5(1), 88–92 (2013)

    Article  Google Scholar 

  7. Brown, M., Lowe, D.: Automatic panoramic image stitching using invariant features. Int. J. Comput. Vis. 74(1), 59–73 (2007)

    Article  Google Scholar 

  8. Shum, H.Y., Szeliski, R.: Construction of panoramic image mosaics with global and local alignment. Panoramic Vision, pp. 227–268. Springer, New York (2001)

    Chapter  Google Scholar 

  9. McLauchlan, P., Jaenicke, A.: Image Mosaicing using sequential bundle adjustment. Image Vis. Comput. 20, 751–759 (2002)

    Article  Google Scholar 

  10. Bradski, G.: OpenCV Library. Dr. Dobb’s journal of software tools (2000). http://opencv.org/

  11. Zhang, Y., Wu, L.: Rigid image registration based on normalized cross correlation and chaotic firey algorithm. Int. J. Digital Content Technol. Appl. 6(22), 129–138 (2012)

    Article  Google Scholar 

  12. Pohl, C., Van Genderen, J.L.: Multisensor image fusion in remote sensing: concepts, methods and applications. Int. J. Remote Sens. 19(5), 823–854 (1998)

    Article  Google Scholar 

  13. Schmidt, A., Kraft, M., Kasinski, A.J.: An evaluation of image feature detectors and descriptors for robot navigation. In: ICCVG (2)’10, pp. 251–259 (2010)

    Google Scholar 

  14. Murthy, V.V.S., Mounica, Y., Vakula, K., Krishna, K.V., Ravichandra, S.: Review of performance estimation for image registration using optimization technique. Int. J. Syst. Technol. 7(1), 7–12 (2014)

    Google Scholar 

  15. Deshmukh, M., Bhosle, U.: A survey of image registration. Int. J. Image Process. 5, 245–269 (2011)

    Google Scholar 

  16. Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., Kadir, T., Gool, L.: A comparison of affine region detectors. Int. J. Comput. Vis. 65(1–2), 43–72 (2005)

    Article  Google Scholar 

  17. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)

    Article  Google Scholar 

  18. Bay, H., Tuytelaars, T., Gool, L.V.: Surf: speeded-up robust features. Computer Vision—ECCV 2006. Lecture Notes in Computer Science, vol. 3951, pp. 404–417 (2006)

    Google Scholar 

  19. Harris, C., Stephens, M.: A combined corner and edge detector. In: Proceedings of the 4th Alvey Vision Conference (AVC), pp. 147–151 (1988)

    Google Scholar 

  20. Moravec, H.: Obstacle avoidance and navigation in the real world by a seeing robot rover. Technical Report CMU-RI-TR-3 Carnegie-Mellon University, Robotics Institute (1980)

    Google Scholar 

  21. Agrawal, M., Konolige, K., Blas, M.R.: Censure: center surround extremas for realtime feature detection and matching. In: European Conference on Computer Vision (ECCV), pp. 102–115. Springer, Berlin (2008)

    Google Scholar 

  22. Rosten, E., Drummond, T.: Machine learning for high speed corner detection. In: The 9th European Conference on Computer Vision, vol. 1, pp. 430–443 (2006)

    Google Scholar 

  23. Leutenegger, S., Chli, M., Siegwart, R.: BRISK: binary robust invariant scalable keypoints. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 2548–2555 (2011)

    Google Scholar 

  24. Calonder, M., Lepetit, V., Strecha, C., Fua, P.: Brief: binary robust independent elementary features. In: 11th European Conference on Computer Vision (ECCV). Computer Vision—ECCV 2010, Lecture Notes in Computer Science, vol. 6314, pp. 778–792 (2010)

    Google Scholar 

  25. Rublee, E., Rabaud, V., Kurt, K., Bradski, G.: An efficient alternative to SIFT or SURF. In: Proceedings of the 2011 International Conference on Computer Vision (ICCV ’11), pp. 2564–2571. IEEE Computer Society, Washington, DC, USA (2011)

    Google Scholar 

  26. Shi, J., Tomasi, C.: Good features to track. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 593–600 (1994)

    Google Scholar 

  27. Matas, J., Chum, O., Urban, O., Pajdla, T.: Robust wide baseline stereo from maximally stable extremal regions. In: Proceedings of British Machine Vision Conference, pp. 384–396 (2002)

    Google Scholar 

  28. Machowski, L.A., Marwala, T.: Evolutionary optimization methods for template based Image Registration, School of Electrical and Information Engineering (2004). arXiv:0705.1674

  29. Zhang, X., Zhang, C.: Satellite cloud image registration by combining curvature shape representation with particle swarm optimization. J. Softw. 6(3), 483–489 (2011)

    Google Scholar 

  30. Kher, H.R.: Implementation of image registration for satellite images using mutual information and particle swarm optimization techniques. Int. J. Comput. Appl. 97(1), 7–14 (2014)

    Google Scholar 

  31. Maddaiah, P.N., Pournami, P.N., Govindan, V.K.: Optimization of image registration for medical image analysis. Int. J. Comput. Sci. Inf. Technol. 5(3), 3394–3398 (2014)

    Google Scholar 

  32. Ayatollahi, F., Shokouhi, S.B., Ayatollahi, A.: A new hybrid particle swarm optimization for mutlimodal brain image registration. J. Biomed. Sci. Eng. 5, 153–161 (2012)

    Article  Google Scholar 

  33. Zhang, X., Shen, Y., Li, S., Ji, Y.: Medical image registration using a real coded genetic algorithm. J. Comput. Inf. Syst. 8(12), 5119–5128 (2012)

    Google Scholar 

  34. Woods, R.P., Cherry, S.R., Mazziotta, J.C.: Rapid automated algorithm for aligning and reslicing PET images. J. Comput. Assist. Tomogr. 16, 620–633 (1994)

    Article  Google Scholar 

  35. Muja, M., Lowe, D.G.: Fast approximate nearest neighbors with automatic algorithm configuration. In: Proceedings of the International Conference on Computer Vision Theory and Application (VISSAPP), pp. 331–340 (2009)

    Google Scholar 

  36. Canada Center for Remote Sensing—CCRS (2007). Fundamentals of remote sensing. http://www.ccrs.nrcan.gc.ca

  37. Lim, D.: Achieving accurate image registration as the basis for super resolution. PhD Thesis. School of Computer Science and Software Engineering, University of Western Australia (2003)

    Google Scholar 

  38. Tahoun, M., Hassanien, A., Reulke, R.: Registration of Optical and Radar Satellite Images Using Local Features and Non-rigid Geometric Transformations. Lecture Notes in Geoinformation and Cartography Series, pp. 249–261. Springer (2015)

    Google Scholar 

  39. Zaragoza, J., Chin, T., Brown, M., Suter, D.: As-projective-as-possible image stitching with moving DLT. In: Proceedings of Computer Vision and Pattern Recognition (CVPR), vol. 36, pp. 2339–2344 (2013)

    Google Scholar 

  40. GeoImage: GeoImage satellite overview (2013). http://www.geoimage.com.au/satellites/satellite-overview

  41. Small satellite TET-1, Astrofein (2010). http://www.astrofein.com/2728/dwnld/admin/AstroFein_TET_EN.pdf

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, Faculty of Computers and Informatics, Suez Canal University, Ismailia, Egypt

    Mohamed Tahoun, Abd El Rahman Shabayek & Hamed Nassar

  2. Institut Für Optische Sensorsysteme, DLR-Berlin, Berlin, Germany

    Marcello M. Giovenco & Ralf Reulke

  3. Computer Science Department, Humboldt University in Berlin, Berlin, Germany

    Ralf Reulke

  4. Information Technology Department, Faculty of Computers and Information, Cairo University, Giza, Egypt

    Eid Emary & Aboul Ella Hassanien

  5. (SRGE Group (www.egyptscience.net)), Cairo, Egypt

    Mohamed Tahoun, Eid Emary & Aboul Ella Hassanien

Authors
  1. Mohamed Tahoun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abd El Rahman Shabayek
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hamed Nassar
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marcello M. Giovenco
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ralf Reulke
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Eid Emary
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Aboul Ella Hassanien
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohamed Tahoun .

Editor information

Editors and Affiliations

  1. Department of Computer Science, Luleå University of Technology, Luleå, Sweden

    Ali Ismail Awad

  2. Image and Video Processing Lab, Faculty, South Valley University, Qena, Egypt

    Mahmoud Hassaballah

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Tahoun, M. et al. (2016). Satellite Image Matching and Registration: A Comparative Study Using Invariant Local Features. In: Awad, A., Hassaballah, M. (eds) Image Feature Detectors and Descriptors . Studies in Computational Intelligence, vol 630. Springer, Cham. https://doi.org/10.1007/978-3-319-28854-3_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-28854-3_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-28852-9

  • Online ISBN: 978-3-319-28854-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation