Skip to main content
SpringerLink
Log in

Image stitching using double features-based global similarity constraint and improved seam-cutting

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Due to the parallax of input image sequence, it is difficult to achieve accurate alignment, which results in artifacts in image stitching. Besides, since most spatial variation warps extrapolate warps to non-overlapping regions through homography regularization, the stitching results are single-perspective, which causes distortion. To solve these problems, in this paper, we propose a new stitching method. Firstly, feature points and feature lines are employed to improve the accuracy of registration and the naturalness of image warps. And mesh grids are used to guide the warps of the target image. Then, to overcome the distortion problem, we introduce a global similarity constraint. And two weight factors are used to combine the similarity transformation obtained by double features with the projective transformation on the target image, so as to achieve a smooth transition. Finally, after creating a label between pixels in overlapping regions, we design a logical function to optimize the problem of minimizing the label energy function, and search for a stitching seam with a seam-cutting method. Experimental results show that the proposed method can not only effectively suppress the projection distortion in the non-overlapping regions of the target image, but also well remove artifacts in the overlapping regions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Algorithm 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Data availability

The data used to support the findings of this study are available from the corresponding author upon request.

References

  1. Bay H, Tuytelaars T, Gool LV (2006) Speeded up robust features. European Conference on Computer Vision. Springer, Berlin, Heidelberg. pp. 404–417

  2. Boykov Y, Kolmogorov V (2004) An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans Pattern Anal Mach Intell 26(9):1124–1137

    Article  Google Scholar 

  3. Chang CH, Sato Y, Chuang YY (2014) Shape-preserving half-projective warps for image stitching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 3254–3261

  4. Chen YS, Chuang YY (2016) Natural image stitching with the global similarity prior. European Conference on Computer Vision. pp. 186–201

  5. Eden A, Uyttendaele M, Szeliski R (2006) Seamless image stitching of scenes with large motions and exposure differences. IEEE Comput Soc Conf Comput Vis Pattern Recognit 2:2498–2505

    Google Scholar 

  6. Fischler MA, Bolles RC (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24(6):381–395

    Article  MathSciNet  Google Scholar 

  7. Gao J, Kim SJ, Brown MS (2011) Constructing image panoramas using dual-homography warping. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 49–56

  8. Gao J, Li Y, Chin TJ et al (2013) Seam-driven image stitching. Eurographics (Short Papers):45–48

  9. Gracias N, Mahoor M, Negahdaripour S et al (2009) Fast image blending using watersheds and graph cuts. Image Vis Comput 27(5):597–607

    Article  Google Scholar 

  10. Jia Q, Gao X, Fan X et al (2016) Novel coplanar line-points invariants for robust line matching across views. European Conference on Computer Vision. Springer, Cham. pp. 599–611

  11. Jia Q, Li ZJ, Fan X et al (2021) Leveraging line-point consistence to preserve structures for wide parallax image stitching. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 12186–12195

  12. Li X, Hui N, Shen H et al (2015) A robust mosaicking procedure for high spatial resolution remote sensing images. J Photogramm Remote Sens 109:108–125

    Article  Google Scholar 

  13. Li N, Xu Y, Wang C (2017) Quasi-homography warps in image stitching. IEEE Trans Multimed 20(6):1365–1375

    Article  Google Scholar 

  14. Li N, Liao T, Wang C (2018) Perception-based seam cutting for image stitching. SIViP 12(5):967–974

    Article  Google Scholar 

  15. Liao T, Li N (2019) Single-perspective warps in natural image stitching. IEEE Trans Image Process 29:724–735

    Article  MathSciNet  Google Scholar 

  16. Liao T, Chen J, Xu Y (2019) Quality evaluation-based iterative seam estimation for image stitching. SIViP 13(6):1199–1206

    Article  Google Scholar 

  17. Lin WY, Liu S, Matsushita Y et al (2011) Smoothly varying affine stitching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 345–352

  18. Lin CC, Pankanti SU, Natesan Ramamurthy K et al (2015) Adaptive as-natural-as-possible image stitching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 1155–1163

  19. Lin K, Jiang N, Cheong LF et al (2016) Seagull: Seam-guided local alignment for parallax-tolerant image stitching. European conference on computer vision. Springer, Cham. pp. 370–385

  20. Liu F, Gleicher M, Jin H et al (2009) Content-preserving warps for 3D video stabilization. ACM Trans Graph (ToG) 28(3):1–9

    Google Scholar 

  21. Luo X, Li Y, Yan J et al (2020) Image stitching with positional relationship constraints of feature points and lines. Pattern Recogn Lett 135:431–440

    Article  Google Scholar 

  22. Mills A, Dudek G (2009) Image stitching with dynamic elements. Image Vis Comput 27(10):1593–1602

    Article  Google Scholar 

  23. Szeliski R (2007) Image alignment and stitching. Found Trends Comput Graph Vis 2(1):1–104

    Article  Google Scholar 

  24. Von Gioi RG, Jakubowicz J, Morel JM et al (2008) A fast line segment detector with a false detection control. IEEE Trans Pattern Anal Mach Intell 32(4):722–732

    Article  Google Scholar 

  25. Wang Z, Bovik AC, Sheikh HR et al (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  26. Xiang T, Xia GS, Zhang L et al (2016) Locally warping-based image stitching by imposing line constraints. International Conference on Pattern Recognition. pp. 4178–4183

  27. Xiang TZ, Xia GS, Bai X et al (2018) Image stitching by line-guided local warping with global similarity constraint. Pattern Recogn 83:481–497

    Article  Google Scholar 

  28. Xiong Y, Pulli K (2009) Sequential image stitching for mobile panoramas. International Conference on Information, Communications and Signal. pp. 1–5

  29. Xue W, Xie W, Zhang Y et al (2021) Stable Linear Structures and Seam Measurements for Parallax Image Stitching. IEEE Trans Circuits Syst Video Technol 32(1):253–261

    Article  Google Scholar 

  30. Zaragoza J, Chin TJ, Brown MS et al (2013) As-projective-as-possible image stitching with moving DLT. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 2339–2346

  31. Zhang G, He Y, Chen W et al (2016) Multi-viewpoint panorama construction with wide-baseline images. IEEE Trans Image Process 25(7):3099–3111

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgments

This work was supported in part by the Natural Science Foundation of Jiangxi Province (20192BAB211005), and in part by Jiangxi Postgraduate Innovation Special Fund Project (YC2021-S821, YC2022-S987).

Author information

Authors and Affiliations

  1. Jiangxi Province Key Laboratory of Water Information Cooperative Sensing and Intelligent Processing, Nanchang Institute of Technology, Nanchang, 330099, Jiangxi, China

    Jinliang Wang & Jun Zhang

  2. College of Science, Nanchang Institute of Technology, Nanchang, 330099, Jiangxi, China

    Mingxi Ma, Su Yan & Jun Zhang

Authors
  1. Jinliang Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mingxi Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Su Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jun Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jun Zhang.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, J., Ma, M., Yan, S. et al. Image stitching using double features-based global similarity constraint and improved seam-cutting. Multimed Tools Appl 83, 7363–7378 (2024). https://doi.org/10.1007/s11042-023-15976-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-15976-9

Keywords

Search

Navigation