Skip to main content
SpringerLink
Log in

3D reconstruction method based on N-step phase unwrapping

  • Original article
  • Published:
The Visual Computer Aims and scope Submit manuscript

A Correction to this article was published on 08 December 2023

This article has been updated

Abstract

Reducing the number of images in fringe projection profilometry has emerged as a significant research focus. Traditional temporal phase unwrapping algorithms typically require an additional set of coding fringe or phase shift fringe images to determine the fringe order and facilitate phase unwrapping, in addition to the essential sinusoidal phase shift fringe for calculating the wrapped phase. In order to reduce the required number of fringe images and increase reconstruction speed, this paper proposes a three-dimensional (3D) reconstruction method inspired by spatial phase unwrapping. The proposed method is based on the N-step temporal phase unwrapping algorithm and can solve the wrapped phase and fringe order using only a set of sinusoidal phase shift fringe images. Our method achieves a further reduction in the required number of images without compromising reconstruction accuracy. In the calculation of the absolute phase, our proposed method only requires an N-step standard phase shift sinusoidal fringe image, eliminating the need for additional fringe images to determine the fringe order. Firstly, we employ the standard N-step phase shift algorithm to compute the wrapped phase and apply a mask for background removal. Next, we directly calculate the fringe order using the wrapped phase and mask and solve for the absolute phase based on the connected region labeling theorem. Our method achieves 3D reconstruction using a minimum of three fringe images, while maintaining reconstruction precision comparable to that of the traditional temporal phase unwrapping technique. As no additional fringe image is required to solve the fringe order, our method has the potential to achieve significantly faster reconstruction speed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

Data availability

Data will be made available on reasonable request.

Change history

References

  1. Marrugo, A.G., Gao, F., Zhang, S.: State-of-the-art active optical techniques for three-dimensional surface metrology: a review. J. Opt. Soc. Am. A 37, B60 (2020)

    Google Scholar 

  2. Gorthi, S.S., Rastogi, P.: Fringe projection techniques: Whither we are? Opt. Lasers Eng. 48, 133–140 (2010)

    Google Scholar 

  3. Wang, Z., Nguyen, D.A., Barnes, J.C.: Some practical considerations in fringe projection profilometry. Opt. Lasers Eng. 48, 218–225 (2010)

    Google Scholar 

  4. Zhang, S.: Absolute phase retrieval methods for digital fringe projection profilometry: a review. Opt. Lasers Eng. 107, 28–37 (2018)

    Google Scholar 

  5. Brown, G.M.: Overview of three-dimensional shape measurement using optical methods. Opt. Eng. 39, 10 (2000)

    Google Scholar 

  6. Ford, K., Myer, G., Hewett, T.: Reliability of landing 3D motion analysis. Med. Sci. Sports Exerc. 39, 2021–2028 (2007)

    Google Scholar 

  7. Zuo, C., Qian, J., Feng, S., Yin, W., Li, Y., Fan, P., Han, J., Qian, K., Chen, Q.: Deep learning in optical metrology: a review. Light: Sci. Appl. 11, 39 (2022)

    Google Scholar 

  8. Tu, Z., Huang, Z., Chen, Y., Kang, D., Bao, L., Yang, B., Yuan, J.: Consistent, 3D hand reconstruction in video via self-supervised learning. IEEE Trans. Pattern Anal. Mach. Intell. 45, 9469–9485 (2023)

    Google Scholar 

  9. Wu, Z., Guo, W., Li, Y., Liu, Y., Zhang, Q.: High-speed and high-efficiency three-dimensional shape measurement based on Gray-coded light. Photon. Res. 8, 819 (2020)

    Google Scholar 

  10. Zhang, S., Van Der Weide, D., Oliver, J.: Superfast phase-shifting method for 3-D shape measurement. Opt. Express 18, 9684–9689 (2010)

    Google Scholar 

  11. Zuo, C., Huang, L., Zhang, M., Chen, Q., Asundi, A.: Temporal phase unwrapping algorithms for fringe projection profilometry: a comparative review. Opt. Lasers Eng. 85, 84–103 (2016)

    Google Scholar 

  12. Ghiglia, D., Pritt, M.: Two-dimensional phase unwrapping: theory, algorithms, and software, Wiley (1998)

  13. Ghiglia, D.C., Romero, L.A.: Robust two-dimensional weighted and unweighted phase unwrapping that uses fast transforms and iterative methods. J. Opt. Soc. Am. A 11, 107 (1994)

    Google Scholar 

  14. Huntley, J.M.: Noise-immune phase unwrapping algorithm. Appl. Opt. 28, 3268 (1989)

    Google Scholar 

  15. Su, X., Chen, W.: Reliability-guided phase unwrapping algorithm: a review. Opt. Lasers Eng. 42, 245–261 (2004)

    Google Scholar 

  16. Salvi, J., Fernandez, S., Pribanic, T., Llado, X.: A state of the art in structured light patterns for surface profilometry. Pattern Recogn. 43, 2666–2680 (2010)

    Google Scholar 

  17. Zhang, Q., Su, X., Xiang, L., Sun, X.: 3-D shape measurement based on complementary Gray-code light. Opt. Lasers Eng. 50, 574–579 (2012)

    Google Scholar 

  18. Creath, K.: Step height measurement using two-wavelength phase-shifting interferometry. Appl. Opt. 26, 2810 (1987)

    Google Scholar 

  19. Cheng, Y., Wyant, J.C.: Two-wavelength phase shifting interferometry. Appl. Opt. 23, 4539 (1984)

    Google Scholar 

  20. Wang, Y., Zhang, S.: Novel phase-coding method for absolute phase retrieval. Opt. Lett. 37, 2067 (2012)

    Google Scholar 

  21. Zheng, D., Da, F.: Phase coding method for absolute phase retrieval with a large number of codewords. Opt. Express 20, 24139 (2012)

    Google Scholar 

  22. Zhou, C., Liu, T., Si, S., Xu, J., Liu, Y., Lei, Z.: An improved stair phase encoding method for absolute phase retrieval. Opt. Lasers Eng. 66, 269–278 (2015)

    Google Scholar 

  23. Xing, Y., Quan, C., Tay, C.J.: A modified phase-coding method for absolute phase retrieval. Opt. Lasers Eng. 87, 97–102 (2016)

    Google Scholar 

  24. Wang, L., Chen, Y., Han, X., Fu, Y., Zhong, K., Jiang, G.: A 3D shape measurement method based on novel segmented quantization phase coding. Opt. Lasers Eng. 113, 62–70 (2019)

    Google Scholar 

  25. Huang, P.S., Zhang, S.: Fast three-step phase-shifting algorithm. Appl. Opt. 45, 5086 (2006)

    Google Scholar 

  26. Huang, P.S.: Trapezoidal phase-shifting method for three-dimensional shape measurement. Opt. Eng. 44, 123601 (2005)

    Google Scholar 

  27. Jia, P., Kofman, J., English, C., Deslauriers, A.: Two-step triangular phase- shifting method for 3-D object-shape measurement, (2005)

  28. Jia, P., Kofman, J., English, C.: Intensity-ratio error compensation for triangular-pattern phase-shifting profilometry. J. Opt. Soc. Am. A, Opt. Image Sci. Vis. 24, 3150–3158 (2007)

    Google Scholar 

  29. Jia, P., Kofman, J., English, C.: Error compensation in two-step triangular-pattern phase-shifting profilometry. Opt. Lasers Eng. 46, 311–320 (2008)

    Google Scholar 

  30. Zuo, C., Chen, Q., Gu, G., Feng, S., Feng, F.: High-speed three-dimensional profilometry for multiple objects with complex shapes. Opt. Express 20, 19493 (2012)

    Google Scholar 

  31. Xu, J., Liu, S., Wan, A., Gao, B., Yi, Q., Zhao, D., Luo, R., Chen, K.: An absolute phase technique for 3D profile measurement using four-step structured light pattern. Opt. Lasers Eng. 50, 1274–1280 (2012)

    Google Scholar 

  32. Wang, F., Zeng, Z., Wang, L., Fu, Y., Jiang, G., Zhang, H.: A fast 3D shape measurement method based on sinusoidal and triangular fringe projection. J. Mod. Opt. 65, 136–144 (2018)

    MathSciNet  Google Scholar 

  33. Zheng, D., Kemao, Q., Da, F., Seah, H.S.: Ternary Gray code-based phase unwrapping for 3D measurement using binary patterns with projector defocusing. Appl. Opt. 56, 3660 (2017)

    Google Scholar 

  34. Porras-Aguilar, R., Falaggis, K., Ramos-Garcia, R.: Optimum projection pattern generation for grey-level coded structured light illumination systems. Opt. Lasers Eng. 91, 242–256 (2017)

    Google Scholar 

  35. Cheng, N., Su, W.: Phase-shifting projected fringe profilometry using binary-encoded patterns. Photonics 8, 362 (2021)

    Google Scholar 

  36. Tabata, S., Maruyama, M., Watanabe, Y., Ishikawa, M.: Pixelwise phase unwrapping based on ordered periods phase shift. Sensors 19, 377 (2019)

    Google Scholar 

  37. He, X., Zheng, D., Kemao, Q., Christopoulos, G.: Quaternary gray-code phase unwrapping for binary fringe projection profilometry. Opt. Lasers Eng. 121, 358–368 (2019)

    Google Scholar 

  38. Wang, Y., Liu, L., Wu, J., Chen, X., Wang, Y.: Spatial binary coding method for stripe-wise phase unwrapping. Appl. Opt. 59, 4279 (2020)

    Google Scholar 

  39. Wang, L., Wang, W., Wang, X., Wang, X.: Three-dimensional measurement method based on a three-step phase-shifting fringe and a binary fringe. Appl. Opt. 61, 5320 (2022)

    Google Scholar 

  40. Sun, J., Chen, X., Wang, Q., Li, Z., Averbuch-Elor, H., Zhou, X., Snavely, N.: Neural 3d reconstruction in the wild. In: ACM SIGGRAPH 2022 Conference Proceedings, pp. 1–9 (2022)

  41. Sayed, M., Gibson, J., Watson, J., Prisacariu, V., Firman, M., SimpleRecon, G. C.: 3D reconstruction without 3D convolutions. In: Avidan, S., Brostow, G., Cissé, M., Farinella, G. M., Hassner, T. (eds.) Cham: Springer Nature Switzerland; pp. 1–19 (2022)

  42. Wen, Y., Li, S., Cheng, H., Su, X., Zhang, Q.: Universal calculation formula and calibration method in Fourier transform profilometry. Appl. Opt. 49, 6563 (2010)

    Google Scholar 

  43. Rajshekhar, G., Rastogi, P.: Fringe analysis: premise and perspectives. Opt. Lasers Eng. 50, iii–x (2012)

    Google Scholar 

  44. Reid, G.T.: Automatic fringe pattern analysis: a review. Opt. Lasers Eng. 7, 37–68 (1986)

    Google Scholar 

  45. Lin, C., Zheng, D., Kemao, Q., Han, J., Bai, L.: Spatial pattern-shifting method for complete two-wavelength fringe projection profilometry. Opt Lett 45, 3115–3118 (2020)

    Google Scholar 

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China (NSFC) (Grant no.51575388).

Author information

Authors and Affiliations

  1. State Key Laboratory Precision Measuring Technology and Instruments, Tianjin University, Tianjin, China

    Lin Wang, Lina Yi, Yuetong Zhang, Wei Wang & Xiangjun Wang

  2. Key Laboratory of MOEMS of the Ministry of Education, Tianjin University, Tianjin, China

    Lin Wang, Lina Yi, Yuetong Zhang, Wei Wang & Xiangjun Wang

  3. School of Precision Instrument and Opto-Electronics Engineering, Tianjin University, Tianjin, China

    Lin Wang, Lina Yi, Yuetong Zhang, Wei Wang & Xiangjun Wang

  4. Unit 32382 of PLA, Wuhan, China

    Xiaofang Wang

  5. North University of China, Taiyuan, China

    Xuan Wang

Authors
  1. Lin Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lina Yi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuetong Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiaofang Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Wei Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Xiangjun Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Xuan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Lin Wang: Conceptualization, Methodology, Software, Writing – original draft. Lina Yi: Methodology, Writing – review & editing. Yuetong Zhang: Visualization, Formal analysis. Xiaofang Wang: Investigation, Writing – review & editing. Wei Wang: Experimental setup, Experiment, review & editing. Xiangjun Wang: Resources, Project administration, Funding acquisition. Xuan Wang: Resources, Data curation, Formal analysis.

Corresponding author

Correspondence to Lin Wang.

Ethics declarations

Conflict of interest

Lin Wang declares that he has no conflict of interest. Lina Yi declares that she has no conflict of interest. Yuetong Zhang declares that he has no conflict of interest. Xiaofang Wang declares that she has no conflict of interest. Wei Wang declares that he has no conflict of interest. Xiangjun Wang declares that he has no conflict of interest. Xuan Wang declares that he has no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The original online version of this article was revised: one author was missing

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, L., Yi, L., Zhang, Y. et al. 3D reconstruction method based on N-step phase unwrapping. Vis Comput 40, 3601–3613 (2024). https://doi.org/10.1007/s00371-023-03054-y

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-023-03054-y

Keywords

Search

Navigation