Skip to main content
SpringerLink
Log in

Improving Deep Learning-Based Digital Image Correlation with Domain Decomposition Method

  • Research paper
  • Published:
Experimental Mechanics Aims and scope Submit manuscript

Abstract

Background

Deep learning-based digital image correlation (DL-based DIC) has gained increasing attention in the last two years. However, existing DL-based DIC algorithms are impractical because their application scenarios are mostly limited to small deformations.

Objective

To enable the use of DL-based DIC in real-world general experimental mechanics scenarios that would involve large deformations and rotations, we propose to improve DL-based DIC with the domain decomposition method (DDM).

Methods

In the improved method, the region of interest is divided into subimages, and subimages are pre-aligned using the preregistered control points to effectively eliminate the large deformation components. The residual deformations in each subimage are small and limited, which can be well extracted using existing DL-based DIC methods.

Results

Through synthesized and real-world experiments, the improved DL-based DIC method can achieve high-accuracy pixelwise matching in practical applications with strong robustness and high computational efficiency.

Conclusions

The improved DL-based DIC combines the advantages of traditional and DL-based DIC methods but overcomes the limitations, greatly improving the robustness and applicability of existing DL-based methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Data Availability

The data that support the findings of this study are available from the corresponding author upon reasonable request.

Reference

  1. Pan B, Qian K, Xie H, Asundi A (2009) Two-dimensional digital image correlation for in-plane displacement and strain measurement: a review. Measure Sci Technol 20:062001. https://doi.org/10.1088/0957-0233/20/6/062001

    Article  Google Scholar 

  2. Pan B (2018) Digital image correlation for surface deformation measurement: historical developments, recent advances and future goals. Meas Sci Technol 29:082001. https://doi.org/10.1088/1361-6501/aac55b

    Article  Google Scholar 

  3. Schreier H, Orteu J-J, Sutton MA (2009) Image Correlation for Shape, Motion and Deformation Measurements: Basic Concepts,Theory and Applications. Springer US, Boston, MA

  4. Bruck HA, McNeill SR, Sutton MA, Peters WH (1989) Digital image correlation using Newton-Raphson method of partial differential correction. Exp Mechan 29:261–267. https://doi.org/10.1007/BF02321405

    Article  Google Scholar 

  5. Lu H, Cary PD (2000) Deformation measurements by digital image correlation: Implementation of a second-order displacement gradient. Exp Mechan 40:393–400. https://doi.org/10.1007/BF02326485

    Article  Google Scholar 

  6. Sun Y, Pang JH, Wong CK, Su F (2005) Finite element formulation for a digital image correlation method. Applied Optics 44:7357–7363. https://doi.org/10.1364/AO.44.007357

    Article  Google Scholar 

  7. Besnard G, Hild F, Roux S (2006) “Finite-Element” Displacement Fields Analysis from Digital Images: Application to Portevin–Le Châtelier Bands. Exp Mech 46:789–803. https://doi.org/10.1007/s11340-006-9824-8

    Article  Google Scholar 

  8. Ma S, Zhao Z, Wang X (2012) Mesh-based digital image correlation method using higher order isoparametric elements. J Strain Analys Eng Des 47:163–175. https://doi.org/10.1177/0309324712437488

    Article  Google Scholar 

  9. Wittevrongel L, Lava P, Lomov SV, Debruyne D (2015) A Self Adaptive Global Digital Image Correlation Algorithm. Exp Mech 55:361–378. https://doi.org/10.1007/s11340-014-9946-3

    Article  Google Scholar 

  10. Hornik K (1991) Approximation capabilities of multilayer feedforward networks. Neural Netw 4:251–257. https://doi.org/10.1016/0893-6080(91)90009-T

    Article  Google Scholar 

  11. Boukhtache S, Abdelouahab K, Berry F et al (2021) When Deep Learning Meets Digital Image Correlation. Optics Lasers Eng 136:106308. https://doi.org/10.1016/j.optlaseng.2020.106308

    Article  Google Scholar 

  12. Boukhtache S, Abdelouahab K, Bahou A et al (2023) A lightweight convolutional neural network as an alternative to DIC to measure in-plane displacement fields. Optics Lasers Eng 161:107367. https://doi.org/10.1016/j.optlaseng.2022.107367

    Article  Google Scholar 

  13. Ronneberger O, Fischer P, Brox T (2015) U-Net: Convolutional Networks for Biomedical Image Segmentation. In: Navab N, Hornegger J, Wells WM, Frangi AF (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. Springer International Publishing, Cham, pp 234–241

    Google Scholar 

  14. Dosovitskiy A, Fischer P, Ilg E et al (2015) FlowNet: Learning Optical Flow with Convolutional Networks. In: 2015 IEEE International Conference on Computer Vision (ICCV). 2758–2766

  15. Sun D, Yang X, Liu M-Y, Kautz J (2018) PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 8934–8943

  16. Yang R, Li Y, Zeng D, Guo P (2022) Deep DIC: Deep learning-based digital image correlation for end-to-end displacement and strain measurement. J Mater Proc Technol 302:117474. https://doi.org/10.1016/j.jmatprotec.2021.117474

    Article  Google Scholar 

  17. Wang Y, Zhao J (2023) DIC-Net: Upgrade the performance of traditional DIC with Hermite dataset and convolution neural network. Optics Lasers in Engineering 160:107278. https://doi.org/10.1016/j.optlaseng.2022.107278

    Article  Google Scholar 

  18. Xiao H, Li C, Feng M (2023) Large Deformation Measurement Method of Speckle Images Based on Deep Learning. Acta Optica Sinica 43:1–13. https://doi.org/10.3788/AOS222084

    Article  Google Scholar 

  19. Ma C, Ren Q, Zhao J (2021) Optical-numerical method based on a convolutional neural network for full-field subpixel displacement measurements. Opt Express 29:9137. https://doi.org/10.1364/OE.417413

    Article  Google Scholar 

  20. Duan X, Huang J (2022) Deep learning-based digital volume correlation. Extreme Mechan Lett 53:101710. https://doi.org/10.1016/j.eml.2022.101710

    Article  Google Scholar 

  21. Duan X, Huang J (2022) Deep-learning-based 3D cellular force reconstruction directly from volumetric images. Biophys J 121:2180–2192. https://doi.org/10.1016/j.bpj.2022.04.028

    Article  Google Scholar 

  22. Duan X, Xu H, Dong R et al (2023) Digital image correlation based on convolutional neural networks. Optics Lasers Eng 160:107234. https://doi.org/10.1016/j.optlaseng.2022.107234

    Article  Google Scholar 

  23. Yang J, Qian K, Wang L (2024) R3-DICnet: an end-to-end recursive residual refinement DIC network for larger deformation measurement. Opt Express 32:907. https://doi.org/10.1364/OE.505655

    Article  Google Scholar 

  24. Hui T-W, Tang X, Loy CC (2018) LiteFlowNet: A Lightweight Convolutional Neural Network for Optical Flow Estimation. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 8981–8989

  25. Teed Z, Deng J (2020) RAFT: Recurrent All-Pairs Field Transforms for Optical Flow. In: Vedaldi A, Bischof H, Brox T, Frahm J-M (eds) Computer Vision – ECCV 2020. Springer International Publishing, Cham, pp 402–419

    Chapter  Google Scholar 

  26. Wang G, Zhang L, Yao X (2022) StrainNet-3D: Real-time and robust 3-dimensional speckle image correlation using deep learning. Optics Lasers Eng 158:107184. https://doi.org/10.1016/j.optlaseng.2022.107184

    Article  Google Scholar 

  27. Toselli A, Widlund OB (2005) Domain decomposition methods–algorithms and theory. Springer, Berlin

    Book  Google Scholar 

  28. Dolean V, Jolivet P, Nataf F (2015) An Introduction to Domain Decomposition Methods: Algorithms, Theory, and Parallel Implementation. Society for Industrial and Applied Mathematics, Philadelphia, PA

    Book  Google Scholar 

  29. Passieux J-C, Périé J-N, Salaün M (2015) A dual domain decomposition method for finite element digital image correlation. Int J Numeric Meth Eng 102:1670–1682. https://doi.org/10.1002/nme.4868

    Article  MathSciNet  Google Scholar 

  30. Chi Y, Pan B (2022) Accelerating parallel digital image correlation computation with feature mesh interpolation. Measurement 199:111554. https://doi.org/10.1016/j.measurement.2022.111554

    Article  Google Scholar 

  31. Schreier HW, Sutton MA (2002) Systematic errors in digital image correlation due to undermatched subset shape functions. Exp Mechan 42:303–310. https://doi.org/10.1007/BF02410987

    Article  Google Scholar 

  32. Pan B, Xie H, Wang Z et al (2008) Study on subset size selection in digital image correlation for speckle patterns. Optics Exp 16:7037–7048

    Article  Google Scholar 

  33. Rupil J, Roux S, Hild F, Vincent L (2011) Fatigue microcrack detection with digital image correlation. J Strain Analys Eng Design 46:492–509. https://doi.org/10.1177/0309324711402764

    Article  Google Scholar 

  34. Hild F, Bouterf A, Roux S (2015) Damage measurements via DIC. Int J Fract 191:77–105. https://doi.org/10.1007/s10704-015-0004-7

    Article  Google Scholar 

  35. Chi Y, Zhao W, Pan B (2023) Gray level residual field: an effective metric for pixelwise matching quality evaluation in local digital image correlation. Measure Sci Technol 34. https://doi.org/10.1088/1361-6501/accbdf

Download references

Acknowledgments

This work is supported by the National Natural Science Foundation of China (Grant nos. 11925202). National Science and Technology Major Project (J2019-V-0006-0099).

Author information

Authors and Affiliations

  1. National Key Laboratory of Strength and Structural Integrity, School of Aeronautic Science and Engineering, Beihang University, Beijing, 100191, China

    Y. Chi, Y. Liu & B. Pan

Authors
  1. Y. Chi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Y. Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. B. Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to B. Pan.

Ethics declarations

Conflict of interest

The authors have no competing interests to declare that are relevant to the content of this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chi, Y., Liu, Y. & Pan, B. Improving Deep Learning-Based Digital Image Correlation with Domain Decomposition Method. Exp Mech 64, 575–586 (2024). https://doi.org/10.1007/s11340-024-01040-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11340-024-01040-6

Keywords

Search

Navigation