Skip to main content
Log in

Phase unwrapping based on channel transformer U-Net for single-shot fringe projection profilometry

  • Research Article
  • Published:
Journal of Optics Aims and scope Submit manuscript

Abstract

Single-shot fringe projection profilometry (FPP) has become a more prevalently adopted technique for retrieving the absolute phase values of the objects in intelligent manufacturing, defect detection, and some other important applications. In FPP, phase unwrapping plays a decisive role as the quality of final three-dimensional reconstructions relies on how accurately the phase values have been calculated. However, noise, shadow, discontinuity, and aliasing often exist in the original wrapped phase patterns which increase the complexity and difficulty of phase unwrapping, even lead to the unwrapping failure. To deal with phase unwrapping problems, we propose a phase unwrapping method based on deep learning, called channel transformer U-net, for directly extracting absolute phase value from the wrapping phase patterns. In the proposed method, the advanced channel-wise cross-fusion transformer module is integrated into the design of deep U-Net architecture. And a new loss function by combining the Smooth L1 loss and multi-scale structural similarity function is proposed. The effectiveness of the proposed method has been verified by real dynamic FPP measurements. The experimental results demonstrate that the proposed channel transformer U-Net can obtain accurate, complete, and smooth absolute phase values in real FPP measurement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. J. Qian, S. Feng, T. Tao, Y. Hu, K. Liu, S. Wu, Q. Chen, C. Zuo, High-resolution real-time 360° 3D model reconstruction of a handheld object with fringe projection profilometry. Opt. Lett. 44, 5751–5754 (2019)

    Article  ADS  Google Scholar 

  2. G. Rao, X. Yang, H. Yu, K. Chen, J. Xu, Fringe-projection-based normal direction measurement and adjustment for robotic drilling. IEEE Trans. Ind. Electron. 67, 9560–9570 (2020)

    Article  Google Scholar 

  3. G. Sansoni, M. Trebeschi, F. Docchio, State-of-the-art and applications of 3D imaging sensors in industry, cultural heritage, medicine, and criminal investigation. Sensors 9, 568–601 (2009)

    Article  ADS  Google Scholar 

  4. C. Zuo, S. Feng, L. Huang, T. Tao, W. Yin, Q. Chen, Phase shifting algorithms for fringe projection profilometry: a review. Opt. Lasers Eng. 109, 23–59 (2018)

    Article  Google Scholar 

  5. S. Zhang, Absolute phase retrieval methods for digital fringe projection profilometry: a review. Opt. Lasers Eng. 107, 28–37 (2018)

    Article  Google Scholar 

  6. H. Yu, Y. Lan, Robust two-dimensional phase unwrapping for multibaseline SAR interferograms: a two-stage programming approach. IEEE Trans. Geosci. Remote Sens. 54, 5217–5225 (2016)

    Article  ADS  Google Scholar 

  7. Y. Lee, Y. Ito, T. Tahara, J. Inoue, P. Xia, Y. Awatsuji, K. Nishio, S. Ura, O. Matoba, Single-shot dual-wavelength phase unwrapping in parallel phase-shifting digital holography. Opt. Lett. 39, 2374–2377 (2014)

    Article  ADS  Google Scholar 

  8. C. Zuo, L. Huang, M. Zhang, Q. Chen, A. Asundi, Temporal phase unwrapping algorithms for fringe projection profilometry: a comparative review. Opt. Lasers Eng. 85, 84–103 (2016)

    Article  Google Scholar 

  9. S. Wu, L. Zhu, S. Pan, L. Yang, Spatiotemporal three-dimensional phase unwrapping in digital speckle pattern interferometry. Opt. Lett. 41, 1050–1053 (2016)

    Article  ADS  Google Scholar 

  10. D. Ghiglia, M.D. Pritt, Two-Dimensional Phase Unwrapping: Theory, Algorithms, and Software (Wiley, 1998), pp.122–135

    MATH  Google Scholar 

  11. Z. Ming, K. Qian, Quality-guided phase unwrapping implementation: an improved indexed interwoven linked list. Appl. Opt. 53, 3492–3500 (2014)

    Article  Google Scholar 

  12. M.A. Herraez, F.R. Villatoro, M.A. Gdeisat, A robust and simple measure for quality guided 2D phase unwrapping algorithm. IEEE Trans. Image Process. 25, 2601–2609 (2016)

    Article  ADS  MathSciNet  MATH  Google Scholar 

  13. X. He, K. Qian, A comparative study on temporal phase unwrapping methods in high-speed fringe projection profilometry. Opt. Lasers Eng. 142, 106613 (2021)

    Article  Google Scholar 

  14. H. Nguyen, K. Ly, T. Tran, Y.Z. Wang, Z.Y. Wang, hNet: Single-shot 3D shape reconstruction using structured light and h-shaped global guidance network. Results Opt. 4, 100104 (2021)

    Article  Google Scholar 

  15. V. Ravi, R.K. Gorthi, LiteF2DNet: a lightweight learning framework for 3D reconstruction using fringe projection profilometry. Appl. Opt. 62, 3215–3224 (2023)

    Article  ADS  Google Scholar 

  16. V. Ravi, R.K. Gorthi, CF3DNet: a learning-based approach for single-shot 3D reconstruction from circular fringes. Opt. Lasers 167, 107597 (2023)

    Article  Google Scholar 

  17. R.C. Machineni, G.E. Spoorthi, K.S. Vengala, S. Gorthi, R.K.S.S. Gorthi, End-to-end deep learning-based fringe projection framework for 3D profiling of objects. Comput. Vision Image Underst. 199, 103023 (2020)

    Article  Google Scholar 

  18. Y. Li, J.M. Qian, S.J. Feng, Q. Chen, C. Zuo, Composite fringe projection deep learning profilometry for single-shot absolute 3D shape measurement. Opt. Express 30, 3424–3442 (2022)

    Article  ADS  Google Scholar 

  19. H. Nguyen, Z.Y. Wang, Accurate 3D shape reconstruction from single structured-light image via fringe-to-fringe network. Photonics 8, 459 (2021)

    Article  Google Scholar 

  20. Y.X. Li, J.M. Qian, S.J. Feng, Q. Chen, C. Zuo, Deep-learning-enabled dual-frequency composite fringe projection profilometry for single-shot absolute 3D shape measurement. Opto-Electron 5, 210021 (2022)

    Article  Google Scholar 

  21. A.H. Nguyen, O. Rees, Z.Y. Wang, Learning-based 3D imaging from single structured-light image. Graph. Models 126, 101171 (2023)

    Article  Google Scholar 

  22. H.T. Yu, X.Y. Chen, R.B. Huang, L.F. Bai, D.L. Zheng, J. Han, Untrained deep learning-based phase retrieval for fringe projection profilometry. Opt. Lasers 164, 107483 (2023)

    Article  Google Scholar 

  23. H. Nguyen, E. Novak, Z.Y. Wang, Accurate 3D reconstruction via fringe-to-phase network. Measurement 190, 110663 (2022)

    Article  Google Scholar 

  24. H.N. Wang, P. Cao, J.Q. Wang, O.R. Zaiane, UCTransNet: rethinking the skip connections in u-net from a channel-wise perspective with transformer. AAAI Conf. Artif. Intell. 36, 2441–2449 (2022)

    Google Scholar 

  25. Z. Wang, E. P. Simoncelli, A. C. Bovik, Multiscale structural similarity for image quality assessment, in The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, vol 2 (2003), pp. 1398–1402

  26. J.M. Qian, S.J. Feng, T.Y. Tao, Y. Hu, Y.X. Li, Q. Chen, C. Zuo, Deep-learning-enabled geometric constraints and phase unwrapping for single-shot absolute 3D shape measurement. APL. Photonics. 5, 046105 (2020)

    Article  ADS  Google Scholar 

  27. B.Y. Li, C. Tang, Q.L. Zhou, Z.K. Lei, Weighted least-squares phase-unwrapping algorithm based on the orientation coherence for discontinuous optical phase patterns. Appl. Opt. 58, 219–226 (2019)

    Article  ADS  Google Scholar 

  28. K.Q. Wang, K.M. Qian, J.L. Di, J.L. Zhao, Deep learning spatial phase unwrapping: a comparative review. Adv. Photon. Nexus. 1, 014001 (2022)

    Article  Google Scholar 

  29. M. Xu, C. Tang, Y.X. Shen, N. Hong, Z.K. Lei, PU-M-Net for phase unwrapping with speckle reduction and structure protection in ESPI. Opt. Lasers 151, 106824 (2021)

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the editor and reviewers for their valuable comments on the paper.

Funding

This work is supported by Natural Science Research Project of Tianjin Education Commission (grant 2020KJ124).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Biyuan Li.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sun, G., Li, B., Li, Z. et al. Phase unwrapping based on channel transformer U-Net for single-shot fringe projection profilometry. J Opt (2023). https://doi.org/10.1007/s12596-023-01515-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s12596-023-01515-0

Keywords

Navigation