Skip to main content
SpringerLink
Log in

Boosting vision transformer for low-resolution borehole image stitching through algebraic multigrid

  • Original article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

In geotechnical engineering, borehole image stitching technology is needed to detect cracks in borehole walls and quicksand, etc., which helps prevent natural disasters. However, traditional manual stitching of low-resolution borehole images requires a lot of manual work by experts, which leads to very expensive costs. In this paper, We propose Vision Transformer for low-resolution borehole image mosaic framework integrating algebraic multigrid (AMG), which saves a lot of manual costs and gradually moves towards automation. Then, we design AMG enhanced Vision Transformer stitching model for borehole image, which overcomes the problems of stitching seam and black image blocks caused by image distortion and blur. Finally, we collect a large number of real data sets from different engineering sites, such as natural gas tunnel, oil exploration and mining ore detection, so that our proposed method can better adapt to different geotechnical environments. Experiments show that our method has better monotonicity, and the result of the stitching image is more complete than the existing results based on SIFT, APAP and COTR.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Dong, Q., Huang, X.M.: The stitching algorithm of image fragments based on opencv. Science Technology and Engineering (2010)

  2. Chen, K., Wang, M.: Image stitching algorithm research based on opencv. In: Proceedings of the 33rd Chinese Control Conference, pp. 7292–7297. IEEE (2014)

  3. Singh, S.K., Saravanan, C.: Analysis of moving dlt, image and seam selections algorithms with ms ice, autostitch, and opencv stitcher for image stitching applications. In: 2017 International Conference on Electrical, Electronics, Communication, Computer, and Optimization Techniques (ICEECCOT), pp. 399–404. IEEE (2017)

  4. Gao, J., Kim, S.J., Brown, M.S.: Constructing image panoramas using dual-homography warping. In: CVPR 2011, pp. 49–56. IEEE (2011)

  5. Chang, C.H., Sato, Y., Chuang, Y.Y.: Shape-preserving half-projective warps for image stitching. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3254–3261 (2014)

  6. Jiang, W., Trulls, E., Hosang, J., Tagliasacchi, A., Yi, K.M.: Cotr: Correspondence transformer for matching across images. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 6207–6217 (2021)

  7. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al.: An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)

  8. Bay, H., Tuytelaars, T., Gool, L.V.: Surf: Speeded up robust features. In: European Conference on Computer Vision, pp. 404–417. Springer (2006)

  9. DeTone, D., Malisiewicz, T., Rabinovich, A.: Superpoint: Self-supervised interest point detection and description. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 224–236 (2018)

  10. He, K., Hu, Y.: An improved method of hough transform for circle recognition based on optimized gradient. In: 2017 5th International Conference on Frontiers of Manufacturing Science and Measuring Technology (FMSMT 2017), pp. 617–622. Atlantis Press (2017)

  11. Zhu, F.K., Liu, Y., Meng, F.J., Cong, M.: Hough circles detection based on depth information set of image. Modular Machine Tool and Automatic Manufacturing Technique (2018)

  12. Li, H., Manjunath, B., Mitra, S.K.: A contour-based approach to multisensor image registration. IEEE Trans. Image Process. 4(3), 320–334 (1995)

    Article  Google Scholar 

  13. Jung, S.Y., Choi, Y.H., Choi, T.S.: Contour-based image mosaicking in the presence of moving objects. In: Computational Imaging III, vol. 5674, pp. 444–454. SPIE (2005)

  14. Xing, J., Miao, Z.: An improved algorithm on image stitching based on sift features. In: Second International Conference on Innovative Computing, Informatio and Control (ICICIC 2007), pp. 453–453. IEEE (2007)

  15. Ahmad, R.M., Yao, X., Nawaz, S.A., Bhatti, U.A., Mehmood, A., Bhatti, M.A., Shaukat, M.U.: Robust image watermarking method in wavelet domain based on sift features. In: Proceedings of the 2020 3rd International Conference on Artificial Intelligence and Pattern Recognition, pp. 180–185 (2020)

  16. Lei, F., Wang, W.: A fast method for image mosaic based on surf. In: 2014 9th IEEE Conference on Industrial Electronics and Applications, pp. 79–82. IEEE (2014)

  17. Malik, N.U.R., Airij, A.G., Memon, S.A., Panhwar, Y.N., Abu-Bakar, S.A., El-Khoreby, M.A.: Performance comparison between surf and sift for content-based image retrieval. In: 2019 IEEE International Conference on Signal and Image Processing Applications (ICSIPA), pp. 214–218. IEEE (2019)

  18. Adel, E., Elmogy, M., Elbakry, H.: Image stitching system based on orb feature based technique and compensation blending. Int. J. Adv. Comput. Sci. Appl. 6(9) (2015)

  19. Zaragoza, J., Chin, T.J., Brown, M.S., Suter, D.: As-projective-as-possible image stitching with moving dlt. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2339–2346 (2013)

  20. Liao, T., Li, N.: Single-perspective warps in natural image stitching. IEEE Trans. Image Process. 29, 724–735 (2019)

    Article  MathSciNet  Google Scholar 

  21. Moyou, M., Rangarajan, A., Corring, J., Peter, A.M.: A grassmannian graph approach to affine invariant feature matching. IEEE Trans. Image Process. 29, 3374–3387 (2019)

    Article  MathSciNet  Google Scholar 

  22. Yang, Z., Dan, T., Yang, Y.: Multi-temporal remote sensing image registration using deep convolutional features. IEEE Access 6, 38544–38555 (2018)

    Article  Google Scholar 

  23. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., Polosukhin, I.: Attention is all you need. arXiv (2017)

  24. Ruge, J.W., Stüben, K.: Algebraic multigrid. In: Multigrid methods, pp. 73–130. SIAM (1987)

  25. Kimmel, R., Yavneh, I.: An algebraic multigrid approach for image analysis. SIAM J. Sci. Comput. 24(4), 1218–1231 (2003)

    Article  MathSciNet  Google Scholar 

  26. Song, H., Wang, Y.: A spectral-spatial classification of hyperspectral images based on the algebraic multigrid method and hierarchical segmentation algorithm. Remote Sens. 8(4), 296 (2016)

    Article  Google Scholar 

  27. Huang, Y., Mao, G., Liu, M., Ou, Y.: Multi-focus image fusion combined with cnn and algebraic multi-grid method. In: International Conference of Pioneering Computer Scientists, Engineers and Educators, pp. 120–129. Springer (2019)

  28. Zhang, X., Lin, W.: Research on improved algorithm of hoff circle detection. In: 2016 2nd Workshop on Advanced Research and Technology in Industry Applications (WARTIA-16), pp. 460–463. Atlantis Press (2016)

  29. Zhong, L., Meng, K., Wang, Y., Dai, Z., Li, S.: Iris location algorithm based on the canny operator and gradient hough transform. In: IOP Conference Series: Materials Science and Engineering, vol. 281, p. 012061. IOP Publishing (2017)

  30. Stüben, K.: An introduction to algebraic multigrid. Multigrid pp. 413–532 (2001)

  31. Xu, Q.B.: Numericals for total variation-based reconstruction of motion blurred images. Appl. Math. A J Chin. Univ. 25(3), 367–373 (2010)

    Article  MathSciNet  Google Scholar 

  32. Xu, Y., Chen, H., Zheng, K.: A combination algorithm for image denoising and deblurring. In: 2010 6th International Conference on Wireless Communications Networking and Mobile Computing (WiCOM), pp. 1–4. IEEE (2010)

  33. Sarwinda, D., Paradisa, R.H., Bustamam, A., Anggia, P.: Deep learning in image classification using residual network (resnet) variants for detection of colorectal cancer. Proc. Comput. Sci. 179, 423–431 (2021)

    Article  Google Scholar 

  34. Zhang, D., Liu, Z., Shi, X.: Transfer learning on efficientnet for remote sensing image classification. In: 2020 5th International Conference on Mechanical, Control and Computer Engineering (ICMCCE), pp. 2255–2258. IEEE (2020)

  35. Tan, M., Pang, R., Le, Q.V.: Efficientdet: Scalable and efficient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10781–10790 (2020)

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Artificial Intelligence, Wuhan Textile University, Wuhan, 430200, China

    Jia Chen, Zhenpeng Fu, Jin Huang, Xinrong Hu & Tao Peng

Authors
  1. Jia Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhenpeng Fu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jin Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xinrong Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Tao Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jin Huang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, J., Fu, Z., Huang, J. et al. Boosting vision transformer for low-resolution borehole image stitching through algebraic multigrid. Vis Comput 38, 3191–3203 (2022). https://doi.org/10.1007/s00371-022-02564-5

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-022-02564-5

Keywords

Search

Navigation