Abstract
The ability to detect motion and track a moving object hidden around a corner or behind a wall provides a crucial advantage when physically going around the obstacle is impossible or dangerous. Previous methods have demonstrated that it is possible to reconstruct the shape of an object hidden from view. However, these methods do not enable the tracking of movement in real time. We demonstrate a compact non-line-of-sight laser ranging technology that relies on the ability to send light around an obstacle using a scattering floor and then detect the return signal from a hidden object within only a few seconds of acquisition time. By detecting this signal with a single-photon avalanche diode (SPAD) camera, we follow the movement of an object located a metre away from the camera with centimetre precision. We discuss the possibility of applying this technology to a variety of real-life situations in the near future.
Similar content being viewed by others
References
Kirmani, A. et al. First-photon imaging. Science 343, 58–61 (2014).
Sun, B. et al. 3d computational imaging with single-pixel detectors. Science 340, 844–847 (2013).
Wandinger, U. Introduction to Lidar (Springer, 2005).
Massa, J. S., Wallace, A. M., Buller, G. S., Fancey, S. J. & Walker, A. C. Laser depth measurement based on time-correlated single-photon counting. Opt. Lett. 22, 543–545 (1997).
Velten, A. et al. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nature Commun. 3, 745 (2012).
Gao, L., Liang, J., Li, C. & Wang, L. V. Single-shot compressed ultrafast photography at one hundred billion frames per second. Nature 516, 74–77 (2015).
Gariepy, G. et al. Single-photon sensitive light-in-flight imaging. Nature Commun. 6, 6021 (2015).
Buttafava, M., Zeman, J., Tosi, A., Eliceiri, K. & Velten, A. Non-line-of-sight imaging using a time-gated single photon avalanche diode. Opt. Express 23, 20997 (2015).
Sume, A. et al. Radar detection of moving objects around corners. Proc. SPIE 7308, 73080V (2009).
Chakraborty, B. et al. in 2010 IEEE Int. Conf. Acoust, Speech Signal Process. 3894–3897 (2010).
Gupta, O., Willwacher, T., Velten, A., Veeraraghavan, A. & Raskar, R. Reconstruction of hidden 3d shapes using diffuse reflections. Opt. Express 20, 19096–19108 (2012).
Repasi, E. et al. Advanced short-wavelength infrared range-gated imaging for ground applications in monostatic and bistatic configurations. Appl. Opt. 48, 5956–5969 (2009).
Vellekoop, I. M. & Mosk, A. P. Universal optimal transmission of light through disordered materials. Phys. Rev. Lett. 101, 120601 (2008).
Mosk, A. P., Lagendijk, A., Lerosey, G. & Fink, M. Controlling waves in space and time for imaging and focusing in complex media. Nature Photon. 6, 283–292 (2012).
Bertolotti, J. et al. Non-invasive imaging through opaque scattering layers. Nature 491, 232–234 (2012).
Katz, O., Small, E. & Silberberg, Y. Looking around corners and through thin turbid layers in real time with scattered incoherent light. Nature Photon. 6, 459–553 (2012).
Katz, O., Heidmann, P., Fink, M. & Gigan, S. Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations. Nature Photon. 8, 784–790 (2014).
Richardson, J. et al. A 32×32 50ps resolution 10 bit time to digital converter array in 130nm CMOS for time correlated imaging. In Custom Integr. Circ. Conf. 2009 77–80 (IEEE, 2009).
Richardson, J., Grant, L. & Henderson, R. Low dark count single-photon avalanche diode structure compatible with standard nanometer scale CMOS technology. Photon. Technol. Lett. IEEE 21, 1020–1022 (2009).
Niclass, C., Rochas, A., Besse, P.-A. & Charbon, E. Design and characterization of a CMOS 3-d image sensor based on single photon avalanche diodes. IEEE J. Solid-State Circuits 40, 1847–1854 (2005).
O'Connor, D. & Phillips, D. Time-Correlated Single Photon Counting (Academic Press, 1984).
Becker, W. Advanced Time-correlated Single Photon Counting Techniques (Springer, 2005).
Anderson, B. D. & Moore, J. B. Optimal Filtering (Prentice-Hall, 1979).
Cucchiara, R., Grana, C., Piccardi, M. & Prati, A. Detecting moving objects, ghosts, and shadows in video streams. IEEE Trans. Pattern Anal. Machine Intel. 25, 1337–1342 (2003).
Cutler, R. & Davis, L. in Proc. Int. Conf. Pattern Recog. 1, 495 (IEEE, 1998).
Buller, G. S. & Wallace, A. M. Ranging and three-dimensional imaging using time-correlated single-photon counting and point-by-point acquisition. IEEE J. Sel. Top. Quant. Electron. 13, 1006–1015 (2007).
Ho, C. et al. Demonstration of literal three-dimensional imaging. Appl. Opt. 38, 1833–1840 (1999).
Albota, M. A. et al. Three-dimensional imaging laser radar with a photon-counting avalanche photodiode array and microchip laser. Appl. Opt. 41, 7671–7678 (2002).
Acknowledgements
We acknowledge support from the European Research Council under the European Union's Seventh Framework Programme (FP/2007-2013)/ERC GA 306559, the Engineering and Physical Sciences Research Council (EPSRC, UK, grants EP/M006514/1, EP/M01326X/1, EP/ K03197X/1), and ST Microelectronics, Imaging Division, Edinburgh, for their support in the manufacture of the Megaframe chip. The Megaframe project has been supported by the European Community within the Sixth Framework Programme IST FET Open. G.G. acknowledges the financial support of the Fonds de Recherche Nature et Technologies du Quebec (grant no. 173779).
Author information
Authors and Affiliations
Contributions
D.F. and J.L. conceived the experiment. R.K.H. designed the CMOS SPAD pixel architecture. G.G.performed the experiment. F.T. developed the tracking algorithm. G.G. and F.T. analysed the data and drafted the manuscript. All authors discussed the data and contributed to the manuscript.
Corresponding authors
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Supplementary information
Supplementary information
Supplementary information (PDF 860 kb)
Supplementary information
Supplementary Movie 1 (MP4 206 kb)
Rights and permissions
About this article
Cite this article
Gariepy, G., Tonolini, F., Henderson, R. et al. Detection and tracking of moving objects hidden from view. Nature Photon 10, 23–26 (2016). https://doi.org/10.1038/nphoton.2015.234
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/nphoton.2015.234
- Springer Nature Limited
This article is cited by
-
High-resolution single-photon imaging with physics-informed deep learning
Nature Communications (2023)
-
Fundamental limits to depth imaging with single-photon detector array sensors
Scientific Reports (2023)
-
Learning diffractive optical communication around arbitrary opaque occlusions
Nature Communications (2023)
-
Non-line-of-sight snapshots and background mapping with an active corner camera
Nature Communications (2023)
-
Compact light field photography towards versatile three-dimensional vision
Nature Communications (2022)