Skip to main content
SpringerLink
Log in

Single-shot compressed ultrafast photography using a novel reconstruction algorithm based on plug-and-play frame

  • Research Article
  • Published:
Journal of Optics Aims and scope Submit manuscript

Abstract

The compressive ultrafast photography has achieved picosecond imaging based on the encode and decode. However, the reconstruction performance usually suffers from artifacts brought by reconstruction algorithms, which prevents its wide applications. In this paper, we propose a novel reconstruction method named PnP-FastDVDnet, based on plug-in and plug-out (PnP) and video denoise methods. Various numerical simulations have been conducted to verify the performance of this proposed method. The results show that our algorithm has a superior performance in both PSNR and SSIM compared to other methods. An experiment has been conducted to image the transient event when a femtosecond laser pass through a scattering medium. The result shows that the proposed algorithm stands out in noise rejection.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. D.J. Bradles et al., Direct linear measurement of ultrashort light pulses with a picosecond streak camera. Opt. Conunum. 2, 391–395 (1971)

    ADS  Google Scholar 

  2. C. Pei, Wu. Shengli, J. Tian, Z. Liu, Development of intelligent control system for x-ray streak camera in diagnostic instrument manipulator. Nucl. Inst. Methods Phys. Res. A 799, 124–131 (2015)

    Article  ADS  Google Scholar 

  3. C. Pei, Wu. Shengli, Xu. Junkai, W. Wen, J. Tian, M. Zhang, J. Chen, R. Liu, Traveling wave deflector design for femtosecond streak camera. Nucl. Inst. Methods Phys. Res. A 855, 148–153 (2017)

    Article  ADS  Google Scholar 

  4. L. Gao, J. Liang, C. Li, L.V. Wang, Single-shot compressed ultrafast photography at one hundred billion frames per second. Nature 516, 74–77 (2015)

    Article  ADS  Google Scholar 

  5. J. Liang, L. Zhu, L.V. Wang, Single-shot real-time femtosecond imaging of temporal focusing. Light Sci. Appl. 7(42), 1–10 (2018)

    Google Scholar 

  6. J. Liang, C. Ma, L. Zhu, Y. Chen, L. Gao, L.V. Wang, Single-shot real-time video recording of a photonic Mach cone induced by a scattered light pulse. Sci. Adv. 3, e1601814 (2017)

    Article  ADS  Google Scholar 

  7. L. Zhu, Y. Chen, J. Liang, L. Gao, C. Ma, L.V. Wang, “Improving image quality in compressed ultrafast photography with a space- and intensity constrained reconstruction algorithm,” Proc. SPIE 9720, High-Speed Biomedical Imaging and Spectroscopy: Toward Big Data Instrumentation and Management, 972008 (2016)

  8. K. Nakagawa, A. Iwasaki, Y. Oishi, R. Horisaki, A. Tsukamoto, A. Nakamura, K. Hirosawa, H. Liao, T. Ushida et al., Sequentially timed all-optical mapping photography (STAMP). Nat. Photonics 8(9), 695–700 (2014)

    Article  ADS  Google Scholar 

  9. K. Goda, K.K. Tsia, B. Jalali, Serial time-encoded amplified imaging for real-time observation of fast dynamic phenomena. Nature 458(7242), 1145–1149 (2009)

    Article  ADS  Google Scholar 

  10. P. Wang, J. Liang, L.V. Wang, Single-shot ultrafast imaging attaining 70 trillion frames per second. Nat. Commun. 11, 2091 (2020)

    Article  ADS  Google Scholar 

  11. J. Liang, P. Wang, L. Zhu, L.V. Wang, Single-shot stereo-polarimetric compressed ultrafast photography for light-speed observation of high-dimensional optical transients with picosecond resolution. Nat. Commun. 11, 5252 (2020)

    Article  ADS  Google Scholar 

  12. A. Zhang, J. Wu, J. Suo, L. Fang, H. Qiao, D.D.U. Li, S. Zhang, J. Fan, D. Qi, Q. Dai, C. Pei, Single-shot compressed ultrafast photography based on U-net network. Opt. Express 28(26), 39299–39310 (2020)

    Article  ADS  Google Scholar 

  13. C. Yang, D. Qi, F. Cao, Y. He, X. Wang, W. Wen, J. Tian, J. Tian, Z. Sun, S. Zhang, Improving the image reconstruction quality of compressed ultrafast photography via an augmented Lagrangian algorithm [J]. J. Opt. 21, 035703 (2019)

    Article  ADS  Google Scholar 

  14. H. Adelson, J. Bergen, The Plenoptic Function and the Elements of Early Vision [M] (MIT Press, USA, 1991), pp. 3–20

    Google Scholar 

  15. A. Wagadarikar, R. John, R. Willett, D.J. Brady, Single disperser design for coded aperture snapshot spectral imaging. Appl. Opt. 47, 10 (2008)

    Article  Google Scholar 

  16. Y. Liu, X. Yuan, J. Suo, D.J. Brady, Q. Dai, Rank minimization for snapshot compressive imaging. IEEE Trans. Pattern Anal. Mach. Intell. 41(12), 2990–3006 (2019)

    Article  Google Scholar 

  17. S. V. Venkatakrishnan, C. A. Bouman, and B. Wohlberg, “Plug-and play priors for model-based reconstruction,” 2013 IEEE global conference on signal and information processing, 945–948, (2013)

  18. S. Sreehari, S.V. Venkatakrishnan, B. Wohlberg, G.T. Buzzard, L.F. Drummy, J.P. Simmons, C.A. Bouman, Plug-and-play priors for bright field electron tomography and sparse interpolation. IEEE Trans. Comput. Imaging 2, 4 (2016)

    MathSciNet  Google Scholar 

  19. S.H. Chan, X. Wang, O.A. Elgendy, Plug-and-play ADMM for image restoration: fixed-point convergence and applications. IEEE Trans. Comput. Imaging 3, 84–98 (2017)

    Article  MathSciNet  Google Scholar 

  20. E. K. Ryu, J. Liu, S. Wang, X. Chen, Z. Wang, and W. Yin, “Plug-and-play methods provably converge with properly trained denoisers,” ICML, (2019)

  21. X. Yuan, Y. Liu, J. Suo, Q. Dai, Plug-and-Play algorithms for large-scale snapshot compressive imaging proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), 1447–1457, (2020)

  22. X. Yuan, Y. Liu, J. Suo, F. Durand, Q. Dai, Plug-and-play algorithms for video snapshot compressive imaging. IEEE Trans. Pattern Anal. Mach. Intell. (2021). https://doi.org/10.1109/TPAMI.2021.3099035

    Article  Google Scholar 

  23. S. Zheng, Y. Liu, Mu. Ziyi Meng, Z.T. Qiao, X. Yang, S. Han, X. Yuan, Deep plug-and-play priors for spectral snapshot compressive imaging. Photonics Res. 9, 2 (2021)

    Article  Google Scholar 

  24. M. Tassano, J. Delon, and T. Veit, “Fastdvdnet: towards real-time deep video denoising without flow estimation,” IEEE/CVF conference on computer vision and pattern recognition (CVPR), 1354–1363, (2020)

  25. X. Yuan, Y. Liu, J. Suo, and Q. Dai, “Plug-and-play algorithms for large-scale snapshot compressive imaging,” IEEE conference on computer vision and pattern recognition (CVPR), 1447–1457, (2020)

  26. https://www.phantomhighspeed.com/resourcesandsupport/phantomresources/videolibrary#Science

  27. https://www.phantomhighspeed.com/resourcesandsupport/phantomresources/videolibrary#Science/VEO4K25MicronMicrospheres

Download references

Author information

Authors and Affiliations

  1. Key Laboratory for Physical Electronics and Devices of the Ministry of Education, School of Electronic Science and Engineering, Xi’an Jiaotong University, Xi’an, 710049, China

    Xiaoya Lei & Shengli Wu

  2. Faculty of Engineering, University of Strathclyde, Glasgow, G4 0NW, Scotland, UK

    David U-Lei Li

Authors
  1. Xiaoya Lei
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. David U-Lei Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shengli Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaoya Lei.

Ethics declarations

Conflict of interest

The authors declare no conflicts of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lei, X., Li, D.UL. & Wu, S. Single-shot compressed ultrafast photography using a novel reconstruction algorithm based on plug-and-play frame. J Opt 52, 332–338 (2023). https://doi.org/10.1007/s12596-022-00893-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12596-022-00893-1

Keywords

Search

Navigation