Transient imaging with a time-of-flight camera and its applications

  • Jing-yu Lin
  • Ri-hui Wu
  • Hong-man Wang
  • Ye-bin Liu


Transient imaging is a technique in photography that records the process of light propagation before it reaches a stationary state such that events at the light speed level can be observed. In this review we introduce three main models for transient imaging with a time-of-flight (ToF) camera: correlation model, frequency-domain model, and compressive sensing model. Transient imaging applications usually involve resolving the problem of light transport and separating the light rays arriving along different paths. We discuss two of the applications: imaging objects inside scattering media and recovering both the shape and texture of an object around a corner.

Key words

Transient imaging Time-of-flight (ToF) camera Scattering media Around corners 

CLC number



Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Bhandari, A., Raskar, R., 2016. Signal processing for time-offlight imaging sensors: an introduction to inverse problems in computational 3-D imaging. IEEE Signal Process. Mag., 33(5):45–58. Scholar
  2. Bhandari, A., Feigin, M., Izadi, S., et al., 2014. Resolving multipath interference in Kinect: an inverse problem approach. Proc. IEEE Sensors, p.614–617. Scholar
  3. Heide, F., Hullin, M.B., Gregson, J., et al., 2013. Low-budget transient imaging using photonic mixer devices. ACM Trans. Graph., 32(4), Article 45. Scholar
  4. Heide, F., Xiao, L., Heidrich, W., et al., 2014. Diffuse mirrors: 3D reconstruction from diffuse indirect illumination using inexpensive time-of-flight sensors. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, p.3222–3229. Scholar
  5. Kadambi, A., Whyte, R., Bhandari, A., et al., 2013. Coded time of flight cameras: sparse deconvolution to address multipath interference and recover time profiles. ACM Trans. Graph., 32(6), Article 167. Scholar
  6. Kirmani, A., Hutchison, T., Davis, J., et al., 2009. Looking around the corner using transient imaging. Proc. IEEE 12th Int. Conf. on Computer Vision, p.159–166. Scholar
  7. Lin, J.Y., Liu, Y.B., Hullin, M.B., et al., 2014. Fourier analysis on transient imaging with a multifrequency time-of-flight camera. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, p.3230–3237. Scholar
  8. Lin, J.Y., Liu, Y.B., Suo, J.L., et al., 2017. Frequency-domain transient imaging. IEEE Trans. Patt. Anal. Mach. Intell., 39(5):937–950. Scholar
  9. Nishita, T., Miyawaki, Y., Nakamae, E., 1987. A shading model for atmospheric scattering considering luminous intensity distribution of light sources. ACM SIGGRAPH Comput. Graph., 21(4):303–310. Scholar
  10. Peters, C., Klein, J., Hullin, M.B., et al., 2015. Solving trigonometric moment problems for fast transient imaging. ACM Trans. Graph., 34(6), Article 220. Scholar
  11. Qiao, H., Lin, J.Y., Liu, Y.B., et al., 2015. Resolving transient time profile in ToF imaging via log-sum sparse regularization. Opt. Lett., 40(6):918–921. Scholar
  12. Shim, H., Lee, S., 2016. Recovering translucent objects using a single time-of-flight depth camera. IEEE Trans. Circ. Syst. Video Technol., 26(5):841–854. Scholar
  13. Tropp, J.A., Gilbert, A.C., 2007. Signal recovery from random measurements via orthogonal matching pursuit. IEEE Trans. Inform. Theory, 53(12):4655–4666. Scholar
  14. Velten, A., Wu, D., Jarabo, A., et al., 2013. Femtophotography: capturing and visualizing the propagation of light. ACM Trans. Graph., 32(4), Article ai]44. Scholar

Copyright information

© Zhejiang University and Springer-Verlag GmbH Germany, part of Springer Nature 2017

Authors and Affiliations

  1. 1.College of Electrical EngineeringGuangxi UniversityNanningChina
  2. 2.University of Chinese Academy of SciencesBeijingChina
  3. 3.School of Computer and Information TechnologyLiaoning Normal UniversityDalianChina
  4. 4.Department of AutomationTsinghua UniversityBeijingChina

Personalised recommendations