Skip to main content
SpringerLink
Log in

Unstructured Light Scanning Robust to Indirect Illumination and Depth Discontinuities

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

Reconstruction from structured light can be greatly affected by indirect illumination such as interreflections between surfaces in the scene and sub-surface scattering. This paper introduces band-pass white noise patterns designed specifically to reduce the effects of indirect illumination, and still be robust to standard challenges in scanning systems such as scene depth discontinuities, defocus and low camera-projector pixel ratio. While this approach uses unstructured light patterns that increase the number of required projected images, it is up to our knowledge the first method that is able to recover scene disparities in the presence of both indirect illumination and scene discontinuities. Furthermore, the method does not require calibration (geometric nor photometric) or post-processing such as phase unwrapping or interpolation from sparse correspondences. We show results for a few challenging scenes and compare them to correspondences obtained with the Phase-shift method and the recently introduced method by Gupta et al., designed specifically to handle indirect illumination.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

Notes

  1. In the literature, indirect illumination is sometimes called global illumination.

  2. The camera-projector pixel ratio is defined as one camera pixel over the number of projector pixels it can see.

  3. Photometric distortion includes gamma factors, scene albedo and aperture (Caspi et al. 1998).

  4. For a \(800\times 600\) projector resolution, the Gupta et al. method requires 10 patterns for each set of codes, plus an all white and an all black pattern to get a good estimate of the mean gray intensity for decoding purposes (Gupta et al. 2012).

    Fig. 14
    figure 14

    The four scenes that we tested, namely (a) Ball, (b) Games, (c) Grapes & Peppers and (d) Corner

    Full size image

  5. Generating 1D unstructured light patterns reduces the number of required patterns, but the longer vertical strips create more indirect illumination than 2D patterns.

  6. We computed Phase-shift using three 64 cycles per frame patterns and calibrating the nonlinearities related to gamma coefficients of the camera and the projector. We here ignore issues related to the ambiguous periodicity of the signal as we are only interested in how well the phase can be recovered. Thus, we performed phase unwrapping by looking at the reference match and finding the most likely period for each pixel independently.

References

  • Andoni, A. (2006). Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions. In: IEEE Symposium on Foundations of Computer Science 2006 (pp. 459–468), IEEE Computer Society.

  • Andoni, A., & Indyk, P. (2008). Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions. Communications of the ACM, 51(1), 117–122.

    Article  Google Scholar 

  • Boyer, K., & Kak, A. (1987). Color-encoded structured light for rapid active ranging. In: IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-, 9(1), 14–28.

  • Bracewell, R. N. (1965). The fourier transform and its applications. New York: McGraw-Hill.

    MATH  Google Scholar 

  • Caspi, D., Kiryati, N., & Shamir, J. (1998). Range imaging with adaptive color structured light. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20, 470–480.

    Article  Google Scholar 

  • Chen, T., Seidel, H.P., Lensch, H.P.A. (2008). Modulated phase-shifting for 3d scanning. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008.

  • Couture, V., Martin, N., Roy, S. (2011). Unstructured light scanning to overcome interreflections. In: IEEE International Conference on Computer Vision (ICCV) ((in press) Nov. 2011).

  • Davis, J., Nehab, D., Ramamoorthi, R., & Rusinkiewicz, S. (2005). Spacetime stereo: A unifying framework for depth from triangulation. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 27(2), 296–302.

    Article  Google Scholar 

  • Gionis, A., Indyk, P., Motwani, R. (1999). Similarity search in high dimensions via hashing. In: VLDB ’99: Proceedings of the 25th International Conference on Very Large Data Bases 1999, (pp. 518–529). San Francisco, USA: Morgan Kaufmann Publishers Inc.,

  • Goddyn, L., & Gvozdjak, P. (2003). Binary gray codes with long bit runs. Electronic Journal of Combinatorics, 10, 27.

    MathSciNet  Google Scholar 

  • Gortler, S. J., Grzeszczuk, R., Szeliski, R., Cohen, M. F. (1996). The lumigraph. In: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques 1996, (pp. 43–54). SIGGRAPH ’96 New York, NY, USA, ACM.

  • Gu, J., Kobayashi, T., Gupta, M., Nayar, S.K. (2011). Multiplexed illumination for scene recovery in the presence of global illumination. In: IEEE International Conference on Computer Vision (ICCV) 2011, (pp. 1–8).

  • Gühring, J. (2001). Dense 3-d surface acquisition by structured light using off-the-shelf components. Videometrics and Optical Methods for 3D Shape Measurement, 4309, 220–231.

    Article  Google Scholar 

  • Gupta, M., Agrawal, A., Veeraraghavan, A., Narasimhan, S.G. (2011) Structured light 3d scanning in the presence of global illumination. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2011, (pp. 713–720). IEEE Computer Society.

  • Gupta, M., Agrawal, A., Veeraraghavan, A., Narasimhan, S.G. (2012). A practical approach to 3d scanning in the presence of interreflections, subsurface scattering and defocus. In: International Journal of Computer Vision 2012, ( pp. 1–23 ).

  • Hermans, C., Francken, Y., Cuypers, T., Bekaert, P. (2009). Depth from sliding projections. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2009, ( pp. 1865–1872 ).

  • Inokuchi, S., Sato, K., Matsuda, F. (1984). Range imaging system for 3-d object recognition. In: ICPR84 1984, (pp. 806–808).

  • Kushnir, A., Kiryati, N. (2007). Shape from unstructured light. In: 3DTV07 2007, (pp. 1–4).

  • Levoy, M., Hanrahan, P. (1996). Light field rendering. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’96 New York 1996 (pp. 31–42). NY, USA: ACM.

  • Minou, M., Kanade, T., & Sakai, T. (1981). A method of time-coded parallel planes of light for depth measurement. Transactions of the Institute of Electronics and Communication Engineers of Japan, E64(8), 521–528.

    Google Scholar 

  • Nayar, S. K., Krishnan, A., Grossberg, M. D., & Raskar, R. (2006). Fast separation of direct and global components of a scene using high frequency illumination. ACM Transactions on Graphics, 25, 935–944.

    Article  Google Scholar 

  • Peers, P., Mahajan, D. K., Lamond, B., Ghosh, A., Matusik, W., Ramamoorthi, R., et al. (2009). Compressive light transport sensing. New York: ACM.

    Google Scholar 

  • Posdamer, J., & Altschuler, M. (1982). Surface measurement by space-encoded projected beam systems. Computer Graphics and Image Processing, 18, 1–17.

    Article  Google Scholar 

  • Proesmans, M., Van Gool, L., Oosterlinck, A. (1996). One-shot active 3d shape acquisition. Pattern Recognition, 1996: Proceedings of the 13th International Conference on 3, 1996 (pp.336–340) vol. 3.

  • Salvi, J., Batlle, J., & Mouaddib, E. (1998). A robust-coded pattern projection for dynamic 3d scene measurement. Pattern Recognition Letters, 19(11), 1055–1065.

    Article  Google Scholar 

  • Salvi, J., Pagès, J., & Batlle, J. (2004). Pattern codification strategies in structured light systems. Pattern Recognition, 37, 827–849.

    Article  MATH  Google Scholar 

  • Scharstein, D., Szeliski, R. (2003). High-accuracy stereo depth maps using structured light. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR) 2003, vol. 1, (pp. 195–202).

  • Vuylsteke, P., & Oosterlinck, A. (1990). Range image acquisition with a single binary-encoded light pattern. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(2), 148–164.

    Article  Google Scholar 

  • Tardif, J.-P., Roy, S., Trudeau, M. (2003). Multi-projectors for arbitrary surfaces without explicit calibration nor reconstruction. In: International Conference on 3-D Digital Imaging and Modeling 2003, ( pp. 217–224 ).

  • Wexler, Y., Fitzgibbon, A. W., Zisserman, A. (2003). Learning epipolar geometry from image sequences. Computer Vision and Pattern Recognition. In: IEEE Computer Society Conference on 2, 209, 2003.

  • Wust, C., & Capson, D. (1991). Surface profile measurement using color fringe projection. Machine Vision and Applications, 4(3), 193–203.

    Article  Google Scholar 

  • Xu, Y., & Aliaga, D. G. (2009). An adaptive correspondence algorithm for modeling scenes with strong interreflections. IEEE Transactions on Visualization and Computer Graphics, 15, 465–480.

    Google Scholar 

  • Zhang, S., & Yau, S. (2007). High-speed three-dimensional shape measurement system using a modified two-plus-one phase-shifting algorithm. Optical Engineering, 46(11), 113603.

    Article  Google Scholar 

  • Zhang, L., Curless, B., Seitz, S. (2002). Rapid shape acquisition using color structured light and multi-pass dynamic programming. In: International Symposium on 3D Data Processing Visualization and Transmission. 3DPVT 2002, (pp. 24–36).

Download references

Author information

Authors and Affiliations

  1. Département d’Informatique et recherche opérationnelle, Université de Montréal, Montréal, QC , H3T 1J4, Canada

    Vincent Couture, Nicolas Martin & Sébastien Roy

Authors
  1. Vincent Couture
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nicolas Martin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sébastien Roy
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vincent Couture.

Additional information

Communicated by K. Ikeuchi.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Couture, V., Martin, N. & Roy, S. Unstructured Light Scanning Robust to Indirect Illumination and Depth Discontinuities. Int J Comput Vis 108, 204–221 (2014). https://doi.org/10.1007/s11263-014-0701-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11263-014-0701-0

Keywords

Search

Navigation