On Making Projector Both a Display Device and a 3D Sensor
We describe a system of embedding codes into projection display for structured light based sensing, with the purpose of letting projector serve as both a display device and a 3D sensor. The challenge is to make the codes imperceptible to human eyes so as not to disrupt the content of the original projection. There is the temporal resolution limit of human vision that one can exploit, by having a higher than necessary frame rate in the projection and stealing some of the frames for code projection. Yet there is still the conflict between imperceptibility of the embedded codes and the robustness of code retrieval that has to be addressed. We introduce noise-tolerant schemes to both the coding and decoding stages. At the coding end, specifically designed primitive shapes and large Hamming distance are employed to enhance tolerance toward noise. At the decoding end, pre-trained primitive shape detectors are used to detect and identify the embedded codes – a task difficult to achieve by segmentation that is used in regular structured light methods, for the weakly embedded information is generally interfered by substantial noise. Extensive experiments including evaluations of both code imperceptibility and decoding accuracy show that the proposed system is effective, even with the prerequisite of incurring minimum disturbance to the original projection.
KeywordsFeature Point Augmented Reality Subtraction Image Structure Light Cross Shape
Unable to display preview. Download preview PDF.
- 2.Bimber, O., Iwai, D., Wetzstein, G., Grundhöfer, A.: The visual computing of projector-camera systems. In: ACM SIGGRAPH 2008 Classes. SIGGRAPH 2008, pp. 1–25 (2008)Google Scholar
- 3.Fofi, D., Sliwa, T., Voisin, Y.: A comparative survey on invisible structured light. In: Proc. of Machine Vision Applications in Industrial Inspection XII, pp. 90–98 (2004)Google Scholar
- 4.Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., Fuchs, H.: The office of the future: A unified approach to image-based modeling and spatially immersive displays. In: Proc. of SIGGRAPH 1998, pp. 179–188 (1998)Google Scholar
- 5.Cotting, D., Naef, M., Cross, M., Fuchs, H.: Embedding imperceptible patterns into projected images for simultaneous acquisition and display. In: Proc. of IEEE and ACM ISMAR, pp. 100–109 (2004)Google Scholar
- 7.Park, H., et al.: Content adaptive embedding of complementary patterns for nonintrusive direct-projected augmented reality. In: HCI International, pp. 132–141 (2007)Google Scholar
- 8.Grundhofer, A., Seeger, M., Hantsch, F., Bimber, O.: Dynamic adaptation of projected imperceptible codes. In: Proc. of IEEE and ACM ISMAR, pp. 1–10 (2007)Google Scholar
- 10.Graebling, P.: Robust structured light coding for 3d reconstruction. In: Proc. of IEEE ICCV, pp. 1–6 (2007)Google Scholar
- 11.Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proc. of IEEE CVPR, pp. 511–518 (2001)Google Scholar
- 12.Lienhart, R., Kuranov, A., Pisarevsky, V.: Empirical analysis of detection cascades of boosted classifiers for rapid object detection. In: Proc. of DAGM PRS, pp. 297–304 (2003)Google Scholar