On Making Projector Both a Display Device and a 3D Sensor

  • Jingwen Dai
  • Ronald Chung
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7431)


We describe a system of embedding codes into projection display for structured light based sensing, with the purpose of letting projector serve as both a display device and a 3D sensor. The challenge is to make the codes imperceptible to human eyes so as not to disrupt the content of the original projection. There is the temporal resolution limit of human vision that one can exploit, by having a higher than necessary frame rate in the projection and stealing some of the frames for code projection. Yet there is still the conflict between imperceptibility of the embedded codes and the robustness of code retrieval that has to be addressed. We introduce noise-tolerant schemes to both the coding and decoding stages. At the coding end, specifically designed primitive shapes and large Hamming distance are employed to enhance tolerance toward noise. At the decoding end, pre-trained primitive shape detectors are used to detect and identify the embedded codes – a task difficult to achieve by segmentation that is used in regular structured light methods, for the weakly embedded information is generally interfered by substantial noise. Extensive experiments including evaluations of both code imperceptibility and decoding accuracy show that the proposed system is effective, even with the prerequisite of incurring minimum disturbance to the original projection.


Feature Point Augmented Reality Subtraction Image Structure Light Cross Shape 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Salvi, J., Fernandez, S., Pribanic, T., Llado, X.: A state of the art in structured light patterns for surface profilometry. Pattern Recognition 43, 2666–2680 (2010)zbMATHCrossRefGoogle Scholar
  2. 2.
    Bimber, O., Iwai, D., Wetzstein, G., Grundhöfer, A.: The visual computing of projector-camera systems. In: ACM SIGGRAPH 2008 Classes. SIGGRAPH 2008, pp. 1–25 (2008)Google Scholar
  3. 3.
    Fofi, D., Sliwa, T., Voisin, Y.: A comparative survey on invisible structured light. In: Proc. of Machine Vision Applications in Industrial Inspection XII, pp. 90–98 (2004)Google Scholar
  4. 4.
    Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., Fuchs, H.: The office of the future: A unified approach to image-based modeling and spatially immersive displays. In: Proc. of SIGGRAPH 1998, pp. 179–188 (1998)Google Scholar
  5. 5.
    Cotting, D., Naef, M., Cross, M., Fuchs, H.: Embedding imperceptible patterns into projected images for simultaneous acquisition and display. In: Proc. of IEEE and ACM ISMAR, pp. 100–109 (2004)Google Scholar
  6. 6.
    Park, H., Seo, B.-K., Park, J.-I.: Subjective evaluation on visual perceptibility of embedding complementary patterns for nonintrusive projection-based augmented reality. IEEE Trans. Circuits Syst. Video Technol. 20(5), 687–696 (2010)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Park, H., et al.: Content adaptive embedding of complementary patterns for nonintrusive direct-projected augmented reality. In: HCI International, pp. 132–141 (2007)Google Scholar
  8. 8.
    Grundhofer, A., Seeger, M., Hantsch, F., Bimber, O.: Dynamic adaptation of projected imperceptible codes. In: Proc. of IEEE and ACM ISMAR, pp. 1–10 (2007)Google Scholar
  9. 9.
    Etzion, T.: Constructions for perfect maps and pseudorandom arrays. IEEE Transactions on Information Theory 34, 1308–1316 (1988)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Graebling, P.: Robust structured light coding for 3d reconstruction. In: Proc. of IEEE ICCV, pp. 1–6 (2007)Google Scholar
  11. 11.
    Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proc. of IEEE CVPR, pp. 511–518 (2001)Google Scholar
  12. 12.
    Lienhart, R., Kuranov, A., Pisarevsky, V.: Empirical analysis of detection cascades of boosted classifiers for rapid object detection. In: Proc. of DAGM PRS, pp. 297–304 (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Jingwen Dai
    • 1
  • Ronald Chung
    • 1
  1. 1.Department of Mechanical and Automation EngineeringThe Chinese University of Hong KongHong Kong

Personalised recommendations