Advertisement

Improved Video Reconstruction Basing on Single-Pixel Camera By Dual-Fiber Collecting

  • Linjie HuangEmail author
  • Zhe Zhang
  • Shaohua Wu
  • Junjun Xiao
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 516)

Abstract

The single-pixel camera is a new architecture of camera proposed in recent years. The difference between a traditional camera and a single-pixel camera is that one image can be reconstructed by acquiring less amount of data with the latter. Most existing single-pixel cameras only collect data for one light path. In this paper, in order to reduce the impact of measurement noise, we adopt a way of dual-fiber acquisition to collect data. We compared the result of traditional single-fiber acquisition with our proposed dual-fibers acquisition. For video reconstruction, we use a dual-scale matrix as the image measurement matrix which can restore images with two different spatial resolutions as needed. We use the low-resolution video as a preview to acquire optical flow, and then we reconstruct a better-quality video by using the optical flow as a restrictive condition. We built an actual single-pixel camera hardware platform based on dual-fiber acquisition, and we show that our high-quality video can be restored by collecting data from our single-pixel camera.

Keywords

Single-pixel camera Dual-fiber acquisition Dual-scale matrix Optical flow Low frame rate 

Notes

Acknowledgments

The authors sincerely thanks to the financial support from National Natural Science Foundation of China (61371102, 61001092) and in part by the Shenzhen Municipal Science and Technology Plan under Grant JCYJ20170811160142808, JCYJ20170811154309920.

References

  1. 1.
    Baraniuk RG. Compressive sensing [lecture notes]. IEEE signal processing magazine. 2007;24(4):118–21.CrossRefGoogle Scholar
  2. 2.
    Donoho DL. Compressed sensing. IEEE Transactions on information theory. 2006;52(4):1289–306.MathSciNetCrossRefGoogle Scholar
  3. 3.
    D. Takhar, J. N. Laska, M. B. Wakin, et al. "A new compressive imaging camera architecture using optical-domain compression." Computational Imaging IV. Vol. 6065. International Society for Optics and Photonics, 2006.Google Scholar
  4. 4.
    Park JY, Michael BW. Multiscale algorithm for reconstructing videos from streaming compressive measurements. Journal of Electronic Imaging. 2013;22(2):021001.CrossRefGoogle Scholar
  5. 5.
    Baraniuk RG, Goldstein T, Sankaranarayanan AC, et al. Compressive video sensing: algorithms, architectures, and applications. IEEE Signal Processing Magazine. 2017;34(1):52–66.CrossRefGoogle Scholar
  6. 6.
    M. Wakin, J. Laska, M. F. Duarte, et al. "Compressive imaging for video representation and coding." Picture Coding Symposium. Vol. 1. 2006.Google Scholar
  7. 7.
    S. Mun, and J. E. Fowler. "Residual reconstruction for block-based compressed sensing of video." Data Compression Conference (DCC), 2011. IEEE, 2011.Google Scholar
  8. 8.
    J. E. Fowler, S. Mun, and E. W. Tramel. "Block-based compressed sensing of images and video." Foundations and Trends? in Signal Processing 4.4 (2012): 297-416.Google Scholar
  9. 9.
    A. C. Sankaranarayanan, P. k. Turaga, et al. "Compressive acquisition of linear dynamical systems." SIAM Journal on Imaging Sciences 6.4 (2013): 2109-2133.MathSciNetCrossRefGoogle Scholar
  10. 10.
    Sankaranarayanan AC, Xu L, Studer C, et al. Video compressive sensing for spatial multiplexing cameras using motion-flow models. SIAM Journal on Imaging Sciences. 2015;8(3):1489–518.MathSciNetCrossRefGoogle Scholar
  11. 11.
    J. Kim, L. J. Kwon, and L. K. Mu. "Deeply-recursive convolutional network for image super-resolution." Proceedings of the IEEE conference on computer vision and pattern recognition. 2016.Google Scholar
  12. 12.
    Li C. An efficient algorithm for total variation regularization with applications to the single pixel camera and compressive sensing. Diss: Rice University; 2010.Google Scholar
  13. 13.
    Candes EJ. The restricted isometry property and its implications for compressed sensing. Comptes rendus mathematique. 2008;346(9-10):589–92.MathSciNetCrossRefGoogle Scholar
  14. 14.
    Horn BK, Schunck BG. Determining optical flow. Artificial intelligence. 1981;17(1-3):185–203.CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  • Linjie Huang
    • 1
    Email author
  • Zhe Zhang
    • 1
  • Shaohua Wu
    • 1
  • Junjun Xiao
    • 1
  1. 1.College of Electronic and Information EngineeringHarbin Institute of TechnologyShenzhenChina

Personalised recommendations