A Physical Model of Time-of-Flight 3D Imaging Systems, Including Suppression of Ambient Light

  • Mirko Schmidt
  • Bernd Jähne
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5742)


We have developed a physical model of continuous-wave Time-of-Flight cameras, which focuses on a realistic reproduction of the sensor data. The derived simulation gives the ability to simulate data acquired by a ToF system with low computational effort. The model is able to use an arbitrary optical excitation and to simulate the sampling of a target response by a two-tap sensor, which can use any switching function. Nonlinear photo response and pixel saturation, as well as spatial variations from pixel to pixel like photo response non-uniformity (PRNU) and dark signal non-uniformity (DSNU) can be modeled. Also the influence of interfering background light and on-sensor suppression of ambient light can be simulated.

The model was verified by analyzing two scenarios: The cameras response to an increasing, homogeneous irradiation as well as the systematic phase deviation caused by higher harmonics of the optical excitation. In both scenarios the model gave a precise reproduction of the observed data.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Erz, M., Jähne, B.: Radiometric, spectrometric and range calibrations of ToF cameras. In: Koch, R., Kolb, A. (eds.) 3rd Workshop on Dynamic 3D Imaging. LNCS, vol. 5742, pp. 16–27. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  2. 2.
    EMVA Standard 1288: EMVA Standard 1288 - Standard for Characterization of Image Sensors and Cameras. European Machine Vision Association, release 3.0, draft 1e 2009 edn. (February 2009) (to appear)Google Scholar
  3. 3.
    Elkhalili, O., Schrey, O., Ulfig, W., Brockherde, W., Hosticka, B.J., Mengel, P., Listl, L.: A 64x8 pixel 3-D CMOS time-of flight image sensor for car safety applications (2006)Google Scholar
  4. 4.
    Gokturk, S.B., Yalcin, H., Bamji, C.: A time-of-flight depth sensor - System description, issues and solutions, http://www.canesta.com/assets/pdf/technicalpapers/CVPR_Submission_TOF.pdf
  5. 5.
    Hasouneh, F., Knedlik, S., Peters, V., Loffeld, O.: PMD based mobile node position monitoring. In: Position, Location, And Navigation Symposium, pp. 569–57. IEEE, New York (2006)Google Scholar
  6. 6.
    Keller, M., Orthmann, J., Kolb, A., Peters, V.: A Simulation Framework for Time-Of-Flight Sensors. In: Proc. of the Int. IEEE Symp. on Signals, Circuits & Systems (ISSCS), vol. 1, pp. 125–128 (2007)Google Scholar
  7. 7.
    Keller, M., Kolb, A.: Real-time Simulation of time-of-flight Sensors. J Simulation Practice and Theory 17, 967–978 (2009)CrossRefGoogle Scholar
  8. 8.
    Oggier, T., Lehmann, M., Kaufmann, R., Schweizer, M., Richter, M., Metzler, P., Lang, G., Lustenberger, F., Blanc, N.: An all-solid-state optical range camera for 3D real-time imaging with sub-centimeter depth resolution (2004)Google Scholar
  9. 9.
    Peters, V., Loffeld, O., Hartmann, K., Knedlik, S.: Modeling and Bistatic Simulation of a High Resolution 3D PMD-Camera. In: EUROSIM 2007 (6th EUROSIM Congress on Modelling and Simulation), Ljubljana, Slovenia (2007)Google Scholar
  10. 10.
    Plaue, M.: Analysis of the PMD imaging system: Technical report, Interdisciplinary Center for Scientific Computing (IWR), University of Heidelberg (2006)Google Scholar
  11. 11.
    Rapp, H.: Experimental and Theoretical Investigation of Correlating TOF-Camera Systems. Diploma thesis, Interdisciplinary Center for Scientific Computing(IWR), University of Heidelberg (2007)Google Scholar
  12. 12.
    Ringbeck, T., Hagebeuker, B.: A 3D time of flight camera for object detection (2007)Google Scholar
  13. 13.
    Schmidt, M.: Spatiotemporal Analysis of Range Imagery. Dissertation, IWR, Fakultät für Physik und Astronomie, University of Heidelberg (2008)Google Scholar
  14. 14.
    Schwarte, R., Heinol, H.G., Xu, Z., Hartmann, K.: New active 3D vision system based on rf-modulation interferometry of incoherent light. In: Casasent, D.P. (ed.) Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, vol. 2588, pp. 126–134 (1995)Google Scholar
  15. 15.
    Spirig, T., Seitz, P., Heitger, F.: The lock-in CCD. Two-dimensional synchronous detection of light. IEEE J.Quantum Electronics 31, 1705–1708 (1995)CrossRefGoogle Scholar
  16. 16.
    Yahav, G., Iddan, G.J., Mandelboum, D.: 3D Imaging Camera for Gaming Application (2006), http://www.3dvsystems.com/technology/3D%20Camera%20for%20Gaming-1.pdf

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Mirko Schmidt
    • 1
  • Bernd Jähne
    • 1
  1. 1.Heidelberg Collaboratory for Image Processing (HCI), Interdisciplinary Center for Scientific Computing (IWR)University of HeidelbergHeidelbergGermany

Personalised recommendations