Abstract
Single-shot fringe projection profilometry (FPP) has become a more prevalently adopted technique for retrieving the absolute phase values of the objects in intelligent manufacturing, defect detection, and some other important applications. In FPP, phase unwrapping plays a decisive role as the quality of final three-dimensional reconstructions relies on how accurately the phase values have been calculated. However, noise, shadow, discontinuity, and aliasing often exist in the original wrapped phase patterns which increase the complexity and difficulty of phase unwrapping, even lead to the unwrapping failure. To deal with phase unwrapping problems, we propose a phase unwrapping method based on deep learning, called channel transformer U-net, for directly extracting absolute phase value from the wrapping phase patterns. In the proposed method, the advanced channel-wise cross-fusion transformer module is integrated into the design of deep U-Net architecture. And a new loss function by combining the Smooth L1 loss and multi-scale structural similarity function is proposed. The effectiveness of the proposed method has been verified by real dynamic FPP measurements. The experimental results demonstrate that the proposed channel transformer U-Net can obtain accurate, complete, and smooth absolute phase values in real FPP measurement.
Similar content being viewed by others
References
J. Qian, S. Feng, T. Tao, Y. Hu, K. Liu, S. Wu, Q. Chen, C. Zuo, High-resolution real-time 360° 3D model reconstruction of a handheld object with fringe projection profilometry. Opt. Lett. 44, 5751–5754 (2019)
G. Rao, X. Yang, H. Yu, K. Chen, J. Xu, Fringe-projection-based normal direction measurement and adjustment for robotic drilling. IEEE Trans. Ind. Electron. 67, 9560–9570 (2020)
G. Sansoni, M. Trebeschi, F. Docchio, State-of-the-art and applications of 3D imaging sensors in industry, cultural heritage, medicine, and criminal investigation. Sensors 9, 568–601 (2009)
C. Zuo, S. Feng, L. Huang, T. Tao, W. Yin, Q. Chen, Phase shifting algorithms for fringe projection profilometry: a review. Opt. Lasers Eng. 109, 23–59 (2018)
S. Zhang, Absolute phase retrieval methods for digital fringe projection profilometry: a review. Opt. Lasers Eng. 107, 28–37 (2018)
H. Yu, Y. Lan, Robust two-dimensional phase unwrapping for multibaseline SAR interferograms: a two-stage programming approach. IEEE Trans. Geosci. Remote Sens. 54, 5217–5225 (2016)
Y. Lee, Y. Ito, T. Tahara, J. Inoue, P. Xia, Y. Awatsuji, K. Nishio, S. Ura, O. Matoba, Single-shot dual-wavelength phase unwrapping in parallel phase-shifting digital holography. Opt. Lett. 39, 2374–2377 (2014)
C. Zuo, L. Huang, M. Zhang, Q. Chen, A. Asundi, Temporal phase unwrapping algorithms for fringe projection profilometry: a comparative review. Opt. Lasers Eng. 85, 84–103 (2016)
S. Wu, L. Zhu, S. Pan, L. Yang, Spatiotemporal three-dimensional phase unwrapping in digital speckle pattern interferometry. Opt. Lett. 41, 1050–1053 (2016)
D. Ghiglia, M.D. Pritt, Two-Dimensional Phase Unwrapping: Theory, Algorithms, and Software (Wiley, 1998), pp.122–135
Z. Ming, K. Qian, Quality-guided phase unwrapping implementation: an improved indexed interwoven linked list. Appl. Opt. 53, 3492–3500 (2014)
M.A. Herraez, F.R. Villatoro, M.A. Gdeisat, A robust and simple measure for quality guided 2D phase unwrapping algorithm. IEEE Trans. Image Process. 25, 2601–2609 (2016)
X. He, K. Qian, A comparative study on temporal phase unwrapping methods in high-speed fringe projection profilometry. Opt. Lasers Eng. 142, 106613 (2021)
H. Nguyen, K. Ly, T. Tran, Y.Z. Wang, Z.Y. Wang, hNet: Single-shot 3D shape reconstruction using structured light and h-shaped global guidance network. Results Opt. 4, 100104 (2021)
V. Ravi, R.K. Gorthi, LiteF2DNet: a lightweight learning framework for 3D reconstruction using fringe projection profilometry. Appl. Opt. 62, 3215–3224 (2023)
V. Ravi, R.K. Gorthi, CF3DNet: a learning-based approach for single-shot 3D reconstruction from circular fringes. Opt. Lasers 167, 107597 (2023)
R.C. Machineni, G.E. Spoorthi, K.S. Vengala, S. Gorthi, R.K.S.S. Gorthi, End-to-end deep learning-based fringe projection framework for 3D profiling of objects. Comput. Vision Image Underst. 199, 103023 (2020)
Y. Li, J.M. Qian, S.J. Feng, Q. Chen, C. Zuo, Composite fringe projection deep learning profilometry for single-shot absolute 3D shape measurement. Opt. Express 30, 3424–3442 (2022)
H. Nguyen, Z.Y. Wang, Accurate 3D shape reconstruction from single structured-light image via fringe-to-fringe network. Photonics 8, 459 (2021)
Y.X. Li, J.M. Qian, S.J. Feng, Q. Chen, C. Zuo, Deep-learning-enabled dual-frequency composite fringe projection profilometry for single-shot absolute 3D shape measurement. Opto-Electron 5, 210021 (2022)
A.H. Nguyen, O. Rees, Z.Y. Wang, Learning-based 3D imaging from single structured-light image. Graph. Models 126, 101171 (2023)
H.T. Yu, X.Y. Chen, R.B. Huang, L.F. Bai, D.L. Zheng, J. Han, Untrained deep learning-based phase retrieval for fringe projection profilometry. Opt. Lasers 164, 107483 (2023)
H. Nguyen, E. Novak, Z.Y. Wang, Accurate 3D reconstruction via fringe-to-phase network. Measurement 190, 110663 (2022)
H.N. Wang, P. Cao, J.Q. Wang, O.R. Zaiane, UCTransNet: rethinking the skip connections in u-net from a channel-wise perspective with transformer. AAAI Conf. Artif. Intell. 36, 2441–2449 (2022)
Z. Wang, E. P. Simoncelli, A. C. Bovik, Multiscale structural similarity for image quality assessment, in The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, vol 2 (2003), pp. 1398–1402
J.M. Qian, S.J. Feng, T.Y. Tao, Y. Hu, Y.X. Li, Q. Chen, C. Zuo, Deep-learning-enabled geometric constraints and phase unwrapping for single-shot absolute 3D shape measurement. APL. Photonics. 5, 046105 (2020)
B.Y. Li, C. Tang, Q.L. Zhou, Z.K. Lei, Weighted least-squares phase-unwrapping algorithm based on the orientation coherence for discontinuous optical phase patterns. Appl. Opt. 58, 219–226 (2019)
K.Q. Wang, K.M. Qian, J.L. Di, J.L. Zhao, Deep learning spatial phase unwrapping: a comparative review. Adv. Photon. Nexus. 1, 014001 (2022)
M. Xu, C. Tang, Y.X. Shen, N. Hong, Z.K. Lei, PU-M-Net for phase unwrapping with speckle reduction and structure protection in ESPI. Opt. Lasers 151, 106824 (2021)
Acknowledgements
The authors would like to thank the editor and reviewers for their valuable comments on the paper.
Funding
This work is supported by Natural Science Research Project of Tianjin Education Commission (grant 2020KJ124).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Sun, G., Li, B., Li, Z. et al. Phase unwrapping based on channel transformer U-Net for single-shot fringe projection profilometry. J Opt (2023). https://doi.org/10.1007/s12596-023-01515-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s12596-023-01515-0