Skip to main content
SpringerLink
Log in

Fast image reconstruction network in image stitching

  • Published:
Optoelectronics Letters Aims and scope Submit manuscript

Abstract

Compared with the traditional feature-based image stitching algorithm, the free-view image stitching algorithm based on deep learning has the advantages of fast stitching speed and good effect. However, these algorithms still cannot achieve real-time splicing speed. For the image reconstruction stage, we redesign a new fast image reconstruction network. This network is designed based on ShuffleNet, and the new network structure and loss function will reduce the time required for image reconstruction. In addition, this network can also reduce the performance loss after the network is lightweight. It is proved by experiments that the fast image reconstruction network can realize real-time high-resolution free-view image reconstruction.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. ANDERSON R, GALLUP D, BARRON J T, et al. Jump: virtual reality video[J]. ACM transactions on graphics (TOG), 2016, 35(6): 1–13.

    Article  Google Scholar 

  2. LI J, ZHAO Y, YE W, et al. Attentive deep stitching and quality assessment for 360° omnidirectional images[J]. IEEE journal of selected topics in signal processing, 2019, 14(1): 209–221.

    Article  ADS  Google Scholar 

  3. WANG L, YU W, LI B. Multi-scenes image stitching based on autonomous driving[C]//2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), June 12–14, 2020, Chongqing, China. New York: IEEE, 2020, 1: 694–698.

    Google Scholar 

  4. LI D, HE Q, LIU C, et al. Medical image stitching using parallel sift detection and transformation fitting by particle swarm optimization[J]. Journal of medical imaging and health informatics, 2017, 7(6): 1139–1148.

    Article  Google Scholar 

  5. GADDAM V R, RIEGLER M, EG R, et al. Tiling in interactive panoramic video: approaches and evaluation[J]. IEEE transactions on multimedia, 2016, 18(9): 1819–1831.

    Article  Google Scholar 

  6. HE K, CHEN X, XIE S, et al. Masked autoencoders are scalable vision learners[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 19–20, 2022, New Orleans, USA. New York: IEEE, 2022: 16000–16009.

    Google Scholar 

  7. FENG F, GAN J A, NONG J, et al. Data transmission with up to 100 orbital angular momentum modes via commercial multi-mode fiber and parallel neural networks[J]. Optics express, 2022, 30(13): 23149–23162.

    Article  ADS  Google Scholar 

  8. FENG F, GAN J, CHEN P F, et al. AI-assisted spectrometer based on multi-mode optical fiber speckle patterns[J]. Optics communications, 2022, 522: 128675.

    Article  Google Scholar 

  9. ZHANG F, LIU F. Casual stereoscopic panorama stitching[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, June 7–12, 2015, Boston, USA. New York: IEEE, 2015: 2002–2010.

    Google Scholar 

  10. ZHANG X, ZHOU X, LIN M, et al. Shufflenet: an extremely efficient convolutional neural network for mobile devices[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, June 18–22, 2018, Salt Lake City, USA. New York: IEEE, 2018: 6848–6856.

    Google Scholar 

  11. HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, June 26-July 1, 2016, Las Vegas, USA. New York: IEEE, 2016: 770–778.

    Google Scholar 

  12. HOANG V D, TRAN D P, NHU N G, et al. Deep feature extraction for panoramic image stitching[C]//Intelligent Information and Database Systems: 12th Asian Conference, ACIIDS 2020, March 23–26, 2020, Phuket, Thailand. Berlin, Heidelberg: Springer International Publishing, 2020: 141–151.

    Google Scholar 

  13. SHEN C, JI X, MIAO C. Real-time image stitching with convolutional neural networks[C]//2019 IEEE International Conference on Real-time Computing and Robotics (RCAR), August 6–11, 2019, Irkutsk, Russia. New York: IEEE, 2019: 192–197.

    Google Scholar 

  14. GAO J, KIM S J, BROWN M S. Constructing image panoramas using dual-homography warping[C]//IEEE Conference on Computer Vision and Pattern Recognition, June 20–25, 2011, Colorado Springs, CO, USA. New York: IEEE, 2011: 49–56.

    Google Scholar 

  15. ZARAGOZA J, CHIN T J, BROWN M S, et al. As-projective-as-possible image stitching with moving DLT[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, June 23–28, 2013, Portland, Oregon, USA. New York: IEEE, 2013: 2339–2346.

    Google Scholar 

  16. LI J, WANG Z, LAI S, et al. Parallax-tolerant image stitching based on robust elastic warping[J]. IEEE transactions on multimedia, 2017, 20(7): 1672–1687.

    Article  Google Scholar 

  17. NIE L, LIN C, LIAO K, et al. A view-free image stitching network based on global homography[J]. Journal of visual communication and image representation, 2020, 73: 102950.

    Article  Google Scholar 

  18. NIE L, LIN C, LIAO K, et al. Unsupervised deep image stitching: reconstructing stitched features to images[J]. IEEE transactions on image processing, 2021, 30: 6184–6197.

    Article  ADS  MathSciNet  Google Scholar 

  19. JUSTIN J, ALEXANDRE A, LI F F. Perceptual losses for real-time style transfer and super-resolution[C]// 14th European Conference on Computer Vision (ECCV), October 11–14, 2016, Amsterdam, The Netherlands. Heidelberg: Springer International Publishing, 2016: 694–711.

    Google Scholar 

  20. SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[EB/OL]. (2014-09-04) [2022-12-25]. https://arxiv.org/abs/1409.1556.

  21. ZHANG J, WANG C, LIU S, et al. Content-aware unsupervised deep homography estimation[C]//16th European Conference on Computer Vision (ECCV), August 23–28, 2020, Glasgow, UK. Heidelberg: Springer International Publishing, 2020: 653–669.

    Google Scholar 

  22. NIE L, LIN C, LIAO K, et al. Learning edge-preserved image stitching from large-baseline deep homography[EB/OL]. (2020-12-11) [2022-12-25]. https://arxiv.org/abs/2012.06194.

Download references

Author information

Authors and Affiliations

  1. Southeast University, Suzhou, 215123, China

    Menrui Xie

  2. Quanzhou Institute of Equipment Manufacturing, Haixi Institutes, Chinese Academy of Sciences, Quanzhou, 350108, China

    Bo Sun

Authors
  1. Menrui Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bo Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Menrui Xie.

Ethics declarations

Conflicts of interest

The authors declare no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xie, M., Sun, B. Fast image reconstruction network in image stitching. Optoelectron. Lett. 19, 635–640 (2023). https://doi.org/10.1007/s11801-023-3042-9

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11801-023-3042-9

Document code

Search

Navigation