Skip to main content
SpringerLink
Log in

3-D optical microscopy with a new synthetic SFF algorithm to reconstruct surfaces with various specular and diffusive reflectance

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

An optical measuring method that leverages a new synthetic shape-from-focus (SFF) algorithm is proposed for reconstructing microstructure surfaces. This method represents a major advance in optical measurement capabilities as it can capture both specular and diffusive characteristics within a single field of view, something that cannot be achieved by other existing methods. To enhance measurement precision, a microscopic optical design has been proposed that uses digitally controlled structured patterns on hybrid reflective surfaces. The novel synthetic SFF algorithm increases measurement precision and accuracy. Industrial parts were evaluated using a pre-calibrated optical instrument, and the results showed that the measured precision of 3-D full-field surface profilometry can reach a microscale level, leading to improved microscopic object reconstruction with an improvement of up to 80% in precision and accuracy. This technique is ideal for use in automated optical inspection (AOI), a crucial requirement for many modern in-line manufacturing processes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Data availability

Not available.

Code availability

Not available.

References

  1. Chang T-J, Su G-DJ (2017) A confocal microscope with programmable aperture arrays by polymer–dispersed liquid crystal, in Novel Optical Systems Design and Optimization XX, vol. 10376: SPIE, pp. 192–198

  2. Chen L-C, Tapilouw AM (2013) Theoretical simulation and experimental confirmation of duty cycle effect on stroboscopic white light interferometry for M(O)EMS dynamic characterization. J Micromech Microeng 23:115008

    Article  Google Scholar 

  3. Yang Z, Bielke A, Häusler G (2016) Better three-dimensional inspection with structured illumination: speed. Appl Opt 55(7):1713–1719

    Article  Google Scholar 

  4. Yang Z, Kessel A, Häusler G (2015) Better 3D inspection with structured illumination: signal formation and precision. Appl Opt 54(22):6652–6660

    Article  Google Scholar 

  5. Belkner J, Liu H-W, Manske E, Chen L-C (2019) Novel chromatic confocal differential interference contrast prototype (SPIE Optical Metrology). SPIE

  6. Schlarp J, Csencsics E, Schitter G (2020) Design and evaluation of an integrated scanning laser triangulation sensor," Mechatronics, vol. 72, p. 102453, 2020/12/01/

  7. Liu T, Fu Y, Wang S, Jiang J, Sang M, Wu Z (2021) Improved laser measurement using advanced techniques: a review, Microwave and Optical Technology Letters

  8. Noguchi M, Nayar SK Microscopic shape from focus using active illumination. Proceedings of 12th International Conference on Pattern Recognition, 1994. [9] (2013, 5) Analysis of focus measure operators for shape-from-focus.

  9. Pertuz S, Puig D, Garcia MA (2013) Analysis of focus measure operators for shape-from-focus. Pattern Recogn 46(5):1415–1432

    Article  MATH  Google Scholar 

  10. Fan T, Yu H (2018) A novel shape from focus method based on 3D steerable filters for improved performance on treating textureless region. Optics Commun 410:254–261

    Article  Google Scholar 

  11. Nayar SK (1992) Shape from focus system, in CVPR, pp. 302–308

  12. Nayar SK, Nakagawa Y (1994) Shape from focus. IEEE Trans Pattern Anal Mach Intell 16(8):824–831

    Article  Google Scholar 

  13. Noguchi M, Nayar SK (1994) Microscopic shape from focus using active illumination, in Proceedings of 12th International Conference on Pattern Recognition, vol. 1: IEEE, pp. 147–152

  14. Xu X, Hagemeier S, Lehmann P (2022) Outlier elimination in rough surface profilometry with focus variation microscopy. Metrology 2(2):263–273

    Article  Google Scholar 

  15. Zuo C et al. (2022) Deep learning in optical metrology: a review, Light: Science & Applications, vol. 11, no. 1, p. 39, 2022/02/23 doi: https://doi.org/10.1038/s41377-022-00714-x.

  16. Matilla A, ariné J, Pérez J, Cadevall C, Artigas R (2016) Three-dimensional measurements with a novel technique combination of confocal and focus variation with a simultaneous scan, in Optical Micro-and Nanometrology VI, vol. 9890: SPIE, pp. 63–73

  17. Memon F, Unar MA, Memon S (2015) Image quality assessment for performance evaluation of focus measure operators. Mehran Univ Res J Eng Technol 34(4):379–386

    Google Scholar 

  18. Perraud J, Guillet J, Redon O, Hamdi M, Simoens F, Mounaix P (2019) Shape-from-focus for real-time terahertz 3D imaging. Opt Lett 44:483–486

    Article  Google Scholar 

  19. Tanaami T, Otsuki S, Tomosada N, Kosugi Y, Shimizu M, Ishida H (2002) High-speed 1-frame/ms scanning confocal microscope with a microlens and Nipkow disks. Appl Opt 41(22):4704–4708

    Article  Google Scholar 

  20. Geng J (2011) Structured-light 3D surface imaging: a tutorial. Adv Optics Photon 3(2):128–160

    Article  Google Scholar 

  21. Chen L-C, Duong D-H, Chen C-S (2019) Optical 3-D profilometry for measuring semiconductor wafer surfaces with extremely variant reflectivities. Appl Sci 9(10):2060

    Article  Google Scholar 

  22. L.-C. Chen, P.-J. Tan, G.-W. Wu, C.-J. Lin, and D. T. Nguyen, "High-speed chromatic confocal microscopy using multispectral sensors for sub-micrometer-precision microscopic surface profilometry," Measurement: Sensors, vol. 18, p. 100165, 2021/12/01/ 2021, https://doi.org/10.1016/j.measen.2021.100165.

  23. Smith PJ, Taylor CM, Shaw AJ, McCabe EM (2000) Programmable array microscopy with a ferroelectric liquid-crystal spatial light modulator. Appl Opt 39(16):2664–2669

    Article  Google Scholar 

  24. Wang YL, Grooms NWF, Civale SC, Chung SH (2021) Confocal imaging capacity on a widefield microscope using a spatial light modulator. PLoS One 16(2):e0244034. https://doi.org/10.1371/journal.pone.0244034

    Article  Google Scholar 

  25. Li S, Liang R (2020) DMD-based three-dimensional chromatic confocal microscopy, Applied Optics, vol. 59, no. 14, pp. 4349–4356, 2020/05/10, doi: https://doi.org/10.1364/AO.386863.

  26. Li S, Guo T, Yuan L, Chen J (2018) A method for surface topography measurement using a new focus function based on dual-tree complex wavelet transform, in 2017 International Conference on Optical Instruments and Technology: Optoelectronic Measurement Technology and Systems, vol. 10621: International Society for Optics and Photonics, p. 1062112

  27. S. Pertuz. "Defocus simulation," https://www.mathworks.com/matlabcentral/fileexchange/55095-defocus-simulation?s_tid=prof_contriblnk, MATLAB Central File Exchange.

  28. Osibote OA, Dendere R, Krishnan S, Douglas TS (2010) “Automated focusing in bright-field microscopy for tuberculosis detection,” (in eng). J Microsc 240(2):155–163

    Article  MathSciNet  Google Scholar 

  29. Yang G, Nelson BJ (2003) Wavelet-based autofocusing and unsupervised segmentation of microscopic images, in Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003)(Cat. No. 03CH37453), vol. 3: IEEE, pp. 2143–2148

  30. Wang J, Leach RK, Jiang X (2015) Review of the mathematical foundations of data fusion techniques in surface metrology. Surf Topogr Metrol Prop 3(2):023001

    Article  Google Scholar 

  31. Lertrusdachakul I, Fougerolle YD, Laligant O (2011) Dynamic (de) focused projection for three-dimensional reconstruction. Opt Eng 50(11):113201

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mechanical Engineering, National Taiwan University, No. 1, Section 4, Roosevelt Rd, Da’an District, Taipei City, Taiwan, 10617

    Yu-Sheng Chen & Liang-Chia Chen

Authors
  1. Yu-Sheng Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Liang-Chia Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the study’s conception and design. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Liang-Chia Chen.

Ethics declarations

Ethics approval

Not available.

Consent to participate

Not available.

Consent for publication

Not available.

Conflict of interest

The authors declare no competing interests.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, YS., Chen, LC. 3-D optical microscopy with a new synthetic SFF algorithm to reconstruct surfaces with various specular and diffusive reflectance. Int J Adv Manuf Technol 126, 2011–2023 (2023). https://doi.org/10.1007/s00170-023-11176-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-023-11176-9

Keywords

Search

Navigation