Advertisement

Transient imaging with a time-of-flight camera and its applications

  • Jing-yu Lin
  • Ri-hui Wu
  • Hong-man Wang
  • Ye-bin Liu
Review

Abstract

Transient imaging is a technique in photography that records the process of light propagation before it reaches a stationary state such that events at the light speed level can be observed. In this review we introduce three main models for transient imaging with a time-of-flight (ToF) camera: correlation model, frequency-domain model, and compressive sensing model. Transient imaging applications usually involve resolving the problem of light transport and separating the light rays arriving along different paths. We discuss two of the applications: imaging objects inside scattering media and recovering both the shape and texture of an object around a corner.

Key words

Transient imaging Time-of-flight (ToF) camera Scattering media Around corners 

CLC number

TP37 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bhandari, A., Raskar, R., 2016. Signal processing for time-offlight imaging sensors: an introduction to inverse problems in computational 3-D imaging. IEEE Signal Process. Mag., 33(5):45–58. https://doi.org/10.1109/MSP.2016.2582218CrossRefGoogle Scholar
  2. Bhandari, A., Feigin, M., Izadi, S., et al., 2014. Resolving multipath interference in Kinect: an inverse problem approach. Proc. IEEE Sensors, p.614–617. https://doi.org/10.1109/ICSENS.2014.6985073Google Scholar
  3. Heide, F., Hullin, M.B., Gregson, J., et al., 2013. Low-budget transient imaging using photonic mixer devices. ACM Trans. Graph., 32(4), Article 45. https://doi.org/10.1145/2461912.2461945Google Scholar
  4. Heide, F., Xiao, L., Heidrich, W., et al., 2014. Diffuse mirrors: 3D reconstruction from diffuse indirect illumination using inexpensive time-of-flight sensors. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, p.3222–3229. https://doi.org/10.1109/CVPR.2014.418Google Scholar
  5. Kadambi, A., Whyte, R., Bhandari, A., et al., 2013. Coded time of flight cameras: sparse deconvolution to address multipath interference and recover time profiles. ACM Trans. Graph., 32(6), Article 167. https://doi.org/10.1145/2508363.2508428Google Scholar
  6. Kirmani, A., Hutchison, T., Davis, J., et al., 2009. Looking around the corner using transient imaging. Proc. IEEE 12th Int. Conf. on Computer Vision, p.159–166. https://doi.org/10.1109/ICCV.2009.5459160Google Scholar
  7. Lin, J.Y., Liu, Y.B., Hullin, M.B., et al., 2014. Fourier analysis on transient imaging with a multifrequency time-of-flight camera. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, p.3230–3237. https://doi.org/10.1109/CVPR.2014.419Google Scholar
  8. Lin, J.Y., Liu, Y.B., Suo, J.L., et al., 2017. Frequency-domain transient imaging. IEEE Trans. Patt. Anal. Mach. Intell., 39(5):937–950. https://doi.org/10.1109/TPAMI.2016.2560814CrossRefGoogle Scholar
  9. Nishita, T., Miyawaki, Y., Nakamae, E., 1987. A shading model for atmospheric scattering considering luminous intensity distribution of light sources. ACM SIGGRAPH Comput. Graph., 21(4):303–310. https://doi.org/10.1145/37402.37437CrossRefGoogle Scholar
  10. Peters, C., Klein, J., Hullin, M.B., et al., 2015. Solving trigonometric moment problems for fast transient imaging. ACM Trans. Graph., 34(6), Article 220. https://doi.org/10.1145/2816795.2818103Google Scholar
  11. Qiao, H., Lin, J.Y., Liu, Y.B., et al., 2015. Resolving transient time profile in ToF imaging via log-sum sparse regularization. Opt. Lett., 40(6):918–921. https://doi.org/10.1364/OL.40.000918CrossRefGoogle Scholar
  12. Shim, H., Lee, S., 2016. Recovering translucent objects using a single time-of-flight depth camera. IEEE Trans. Circ. Syst. Video Technol., 26(5):841–854. https://doi.org/10.1109/TCSVT.2015.2397231CrossRefGoogle Scholar
  13. Tropp, J.A., Gilbert, A.C., 2007. Signal recovery from random measurements via orthogonal matching pursuit. IEEE Trans. Inform. Theory, 53(12):4655–4666. https://doi.org/10.1109/TIT.2007.909108MathSciNetCrossRefzbMATHGoogle Scholar
  14. Velten, A., Wu, D., Jarabo, A., et al., 2013. Femtophotography: capturing and visualizing the propagation of light. ACM Trans. Graph., 32(4), Article ai]44. https://doi.org/10.1145/2461912.2461928Google Scholar

Copyright information

© Zhejiang University and Springer-Verlag GmbH Germany, part of Springer Nature 2017

Authors and Affiliations

  1. 1.College of Electrical EngineeringGuangxi UniversityNanningChina
  2. 2.University of Chinese Academy of SciencesBeijingChina
  3. 3.School of Computer and Information TechnologyLiaoning Normal UniversityDalianChina
  4. 4.Department of AutomationTsinghua UniversityBeijingChina

Personalised recommendations