Skip to main content

Advertisement

SpringerLink
Log in

Multi-focus image fusion for microscopic depth-of-field extension of waterjet-assisted laser processing

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

The waterjet-assisted laser processing (WJALP) technology has a significant effect in reducing the damage to the workpiece caused by laser ablation. While, due to the limitation of the depth-of-field (DOF) of the microscopic magnification system, the processing quality and features of the material surface cannot be accurately identified during processing. In multi-focus image fusion (MFIF) according to different DOF images, the conventional wavelet transform in the condition of waterjet cannot accurately provide detailed features of microscopic images. In this work, in order to overcome the shortcomings of traditional wavelet transform, the method of discrete wavelet transform (DWT) based on the human vision principle (HVP) was proposed, and stretched the detail part while fully retained the source image information. Based on morphological theory and defogging algorithm, the waterjet interference was excluded by image pre-processing as much as possible. The approximate component and detailed component were obtained by DWT, and the detailed components were stretched utilizing HVP according to the brightness and darkness provided by the approximate component. Finally, the image brightness was adjusted using an adaptive gamma correction. According to the experimental results, in the case of complex flowing water films, SD, E(F), AG, and SF can reach 75.45%, 95.38%, 73.60%, and 77.45% of the ideal fusion, respectively, which indicated that the proposed method can achieve a better fusion effect in different waterjet situations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Algorithm 1
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  1. Wang J, Xu J, Lian Z, Wang J, Chen G, Li Y, Yu H (2022) Facile and green fabrication of robust microstructured stainless steel mesh for efficient oil/water separation via waterjet-assisted laser ablation. Colloids Surf A 643:128703. https://doi.org/10.1016/j.colsurfa.2022.128703

  2. Valdecasas AG, Marshall D, Becerra JM, Terrero JJ (2001) On the extended depth of focus algorithms for bright field microscopy. Micron 32(6):559–569. https://doi.org/10.1016/S0968-4328(00)00061-5

    Article  CAS  PubMed  Google Scholar 

  3. Pantazis M (2008) Depth of field extension with spherical optics. Opt Express 16(17):12995–13004. https://doi.org/10.1364/oe.16.012995

    Article  Google Scholar 

  4. Tingyu Z, Feihong Y (2012) Point spread function analysis of a cubic phase wavefront coding system with a circular pupil. Opt Express 20(3):2048–2419. https://doi.org/10.1364/OE.20.002408

    Article  Google Scholar 

  5. Giese JD, Ford TN, Mertz J (2014) Fast volumetric phase-gradient imaging in thick samples. Opt Express 22(1):1152–1162. https://doi.org/10.1364/OE.22.001152

  6. Xinhui X, Xunbo Y, Xin G, Xiangyu P, Yuedi W, Xinzhu S, Binbin Y (2022) Extended depth of field method with a designed diffraction optical element based on multi-depth fusion and end-to-end optimization. Opt Commun 517:128317. https://doi.org/10.1016/J.OPTCOM.2022.128317

  7. Tingyu Z, Thomas M, Guoqiang L (2013) Optimization of wavefront-coded infinity-corrected microscope systems with extended depth of field. Biomed Opt Express 4(8):1464–1471. https://doi.org/10.1364/BOE.4.001464

    Article  Google Scholar 

  8. Benjamin M, Roy A, Tal D, Avi C, Yosef G, Shlomo E (2020) Extended depth-of-field imaging employing integrated binary phase pupil mask and principal component analysis image fusion. Opt Express 28(16):23862–23873. https://doi.org/10.1364/OE.393037

    Article  Google Scholar 

  9. Yong Y, Sihua C, Weiguo W, Shuying H (2023) Multi-modal medical image super-resolution fusion based on detail enhancement and weighted local energy deviation. Biomed. Signal Process. Control 80(P2):104387. https://doi.org/10.1016/J.BSPC.2022.104387

    Article  Google Scholar 

  10. Pan W, Limai J, Zhen H, Jinjiang L (2023) Multi-focus image fusion: transformer and shallow feature attention matters. Displays 76:102353. https://doi.org/10.1016/J.DISPLA.2022.102353

  11. Yang B, Zhong J, Li Y, Chen Z (2017) Multi-focus image fusion and super-resolution with convolutional neural network. Int J Wavelets Multi 15(4):1750037. https://doi.org/10.1142/S0219691317500370

    Article  MathSciNet  Google Scholar 

  12. Liu Y, Chen X, Peng H, Wang Z (2017) Multi-focus image fusion with a deep convolutional neural network. Inf Fusion 36:191–207. https://doi.org/10.1016/j.inffus.2016.12.001

  13. Ma B, Zhu Y, Yin X, Ban X, Huang H, Mukeshimana M (2020) Sesf-fuse: an unsupervised deep model for multi-focus image fusion. Neural Comput Appl 33:5793–5804. https://doi.org/10.1007/s00521-020-05358-9

  14. Han X, Fan F, Hao Z, Zhuliang L, Jun H (2020) A deep model for multi-focus image fusion based on gradients and connected regions. IEEE. Access 8:26316–6372. https://doi.org/10.1109/access.2020.2971137

  15. Jin X, Hou J, Nie R, Yao S, Zhou D, Jiang Q, He K (2018) A lightweight scheme for multi-focus image fusion. Multimed Tools Appl 77:23501–23527. https://doi.org/10.1007/s11042-018-5659-4

    Article  Google Scholar 

  16. Jin X, Nie R, Zhou D, Wang Q, He K (2016) Multifocus color image fusion based on Nsst and Pcnn. J Sens p 359602. https://doi.org/10.1155/2016/8359602

  17. Ganasala P, Kumar V (2014) Ct and Mr image fusion scheme in nonsubsampled contourlet transform domain. J Digit Imaging 27:407–418. https://doi.org/10.1007/s10278-013-9664-x

    Article  PubMed  PubMed Central  Google Scholar 

  18. Liu X, Mei W, Du H (2017) Structure tensor and nonsubsampled shearlet transform based algorithm for Ct and Mri image fusion. Neurocomputing 235:131–139. https://doi.org/10.1016/j.neucom.2017.01.006

    Article  Google Scholar 

  19. Singh S, Anand RS, Gupta D (2018) Ct and Mr image information fusion scheme using a cascaded framework in ripplet and Nsst domain. IET Image Process 12(5):696–707. https://doi.org/10.1049/iet-ipr.2017.0214

  20. Kong W, Wang B, Lei Y (2015) Technique for infrared and visible image fusion based on non-subsampled shearlet transform and spiking cortical model. Infrared Phys Technol 71:87–98. https://doi.org/10.1016/j.infrared.2015.02.008

    Article  ADS  Google Scholar 

  21. Jin X, Jiang Q, Yao S, Zhou D, Nie R, Hai J, He K (2017) A survey of infrared and visual image fusion methods. Infrared Phys Technol 85:478–501. https://doi.org/10.1016/j.infrared.2017.07.010

    Article  ADS  Google Scholar 

  22. Yang Y, Yang M, Huang S, Que Y, Ding M, Sun J (2017) Multifocus image fusion based on extreme learning machine and human visual system. IEEE access 5:6989–7000. https://doi.org/10.1109/access.2017.2696119

    Article  Google Scholar 

  23. Guo P, Zeng D, Tian Y, Liu S, Liu H, Li D (2020) Multi-scale enhancement fusion for underwater sea cucumber images based on human visual system modelling. Comput Electron Agr 175:105608. https://doi.org/10.1016/j.compag.2020.105608

    Article  Google Scholar 

  24. Charee W, Tangwarodomnukun V (2018) Dynamic features of bubble induced by a nanosecond pulse laser in still and flowing water. Opt Laser Technol 100:230–243. https://doi.org/10.1016/j.optlastec.2017.10.019

    Article  ADS  CAS  Google Scholar 

  25. Wang Y, Zhao X, Ke C, Yu J, Wang R (2020) Nanosecond laser fabrication of superhydrophobic Ti6al4v surfaces assisted with different liquids. Colloid Interface Sci Commun 35:100256. https://doi.org/10.1016/j.colcom.2020.100256

    Article  CAS  Google Scholar 

  26. Ohara O, Nagakubo M, Kawahara N, Hattori T (1997) High aspect ratio etching by infrared laser induced micro bubbles. In: Ohara O, Nagakubo M, Kawahara N, Hattori TO, Oj, Nagakubo M, Kawahara N, Hattoris T (eds) Proceedings IEEE The Tenth Annual International Workshop on Micro Electro Mechanical Systems. An investigation of micro structures, sensors, actuators, machines and robots. IEEE, New York

  27. Wang J, Xu J, Chen G, Lian Z, Yu Z, Hou Y, Wang J, Li Y, Yu H (2023) Microstructural evolution, mechanical properties and surface quality of Tc11 titanium alloy subjected to waterjet-assisted laser direct inscription. J Mater Res Technol 24:4986–5006. https://doi.org/10.1016/J.JMRT.2023.04.017

    Article  CAS  Google Scholar 

  28. Beltaos S (2010) Oblique impingement of circular turbulent jets. J Hydrol Res 14(1):17–36. https://doi.org/10.1080/00221687609499685

    Article  Google Scholar 

  29. Jalil A, Rajaratnam N (2010) Oblique impingement of circular water jets on a plane boundary. J Hydrol Res 44(6):807–814. https://doi.org/10.1080/00221686.2006.9521731

    Article  Google Scholar 

  30. Mallat SG (1989) A theory for multiresolution signal decomposition: the wavelet representation. IEEE T Pattern Anal 11(7):674–93. https://doi.org/10.1515/9781400827268.494

    Article  Google Scholar 

  31. Mallat SG (1989) Multifrequency channel decompositions of images and wavelet models. IEEE Trans Acoust 37(12):2091–2110. https://doi.org/10.1109/29.45554

    Article  Google Scholar 

  32. You N, Han L, Zhu D, Song W (2023) Research on image denoising in edge detection based on wavelet transform. Appl Sci 13(3):1837. https://doi.org/10.3390/APP13031837

    Article  CAS  Google Scholar 

  33. Song Q, Wang Y, Bai K (2016) High dynamic range infrared images detail enhancement based on local edge preserving filter. Infrared Phys Technol 77:464–473. https://doi.org/10.1016/j.infrared.2016.06.023

    Article  ADS  Google Scholar 

  34. Ye G, Pan C, Huang X, Zhao Z, He J (2018) A chaotic image encryption algorithm based on information entropy. Int J Bifurcat Chaos 28(01):1850010. https://doi.org/10.1142/S0218127418500104

    Article  MathSciNet  Google Scholar 

  35. Bhat S, Koundal D (2021) Multi-focus image fusion using neutrosophic based wavelet transform. Appl Soft Comput 106:107307. https://doi.org/10.1016/j.asoc.2021.107307

  36. Mohan CR, Kiran S, Vasudeva (2023) Improved procedure for multi-focus image quality enhancement using image fusion with rules of texture energy measures in the hybrid wavelet domain. Appl Sci 13(4):2138. https://doi.org/10.3390/app13042138

  37. Jagalingam P, Hegde AV (2015) A review of quality metrics for fused image. Aquat Procelia 4:133–142. https://doi.org/10.1016/j.aqpro.2015.02.019

  38. Shreyamsha Kumar B (2015) Image fusion based on pixel significance using cross bilateral filter. Signal Image Video 9:1193–1204. https://doi.org/10.1007/s11760-013-0556-9

    Article  Google Scholar 

  39. Zhang W, Dong L, Xu W (2022) Retinex-inspired color correction and detail preserved fusion for underwater image enhancement. Comput Electron Agr 192:106585. https://doi.org/10.1016/J.COMPAG.2021.106585

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Demonstration Center for Experimental Opto-Electronic Engineering Education.

Funding

Jilin Province Key R&D Project (No. 20230301005GX); the “111” Project of China (No. D17017); the National Natural Science Foundation of China (No. U19A20103); the National Defense Basic Research Projects (No. JCKY2020210B001).

Author information

Authors and Affiliations

  1. School of Opto-Electronic Engineering, Changchun University of Science and Technology, Changchun, 130022, China

    Ying Li, Xinyue Li, Zhiyong Tang & Xiaowei Sun

  2. Ministry of Education Key Laboratory for Cross-Scale Micro and Nano Manufacturing, Changchun University of Science and Technology, Changchun, 130022, China

    Ying Li, Xinyue Li, Jiaqi Wang, Guangjun Chen, Jinkai Xu, Zhiyong Tang, Zhanjiang Yu, Xiaowei Sun, Jingdong Wang & Huadong Yu

  3. School of Mechanical and Aerospace Engineering, Jilin University, Changchun, 130025, China

    Huadong Yu

Authors
  1. Ying Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xinyue Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jiaqi Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Guangjun Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jinkai Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Zhiyong Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Zhanjiang Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Xiaowei Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Jingdong Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Huadong Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the study conception and design. Material preparation, data collection, and analysis were performed by Ying Li, Jiaqi Wang, and Guangjun Chen. The first draft of the manuscript was written by Xinyue Li, and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Ying Li or Jiaqi Wang.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, Y., Li, X., Wang, J. et al. Multi-focus image fusion for microscopic depth-of-field extension of waterjet-assisted laser processing. Int J Adv Manuf Technol 131, 1717–1734 (2024). https://doi.org/10.1007/s00170-024-13118-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-024-13118-5

Keywords

Search

Navigation