Belief Propagation for Improved Color Assessment in Structured Light

  • Christoph Schmalz
  • Elli Angelopoulou
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6376)


Single-Shot Structured Light is a well-known method for acquiring 3D surface data of moving scenes with simple and compact hardware setups. Some of the biggest challenges in these systems is their sensitivity to textured scenes, subsurface scattering and low-contrast illumination. Recently, a graph-based method has been proposed that largely eliminates these shortcomings. A key step in the graph-based pattern decoding algorithm is the estimation of color of local image regions which correspond to the vertex colors of the graph. In this work we propose a new method for estimating the color of a vertex based on belief propagation (BP). The BP framework allows the explicit inclusion of cues from neigboring vertices in the color estimation. This is especially beneficial for low-contrast input images. The augmented method is evaluated using typical low-quality real-world test sequences of the interior of a pig stomach. We demonstrate a significant improvement in robustness. The number of 3D data points generated increases by 30 to 50 percent over the plain decoding.


Belief Propagation Texture Scene Color Enhancement Projected Color Subsurface Scattering 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Salvi, J., Fernandez, S., Pribanic, T., Llado, X.: A state of the art in structured light patterns for surface profilometry. Pattern Recognitio (2010) (in Press) (Corrected Proof)Google Scholar
  2. 2.
    Sansoni, G., Carocci, M., Rodella, R.: Three-dimensional vision based on a combination of gray-code and phase-shift light projection: Analysis and compensation of the systematic errors. Appl. Opt. 38(31), 6565–6573 (1999)CrossRefGoogle Scholar
  3. 3.
    Schmalz, C., Angelopoulou, E.: Belief propagation for improved color assessment in structured light. In: 7th IEEE International Workshop on Projector-Camera Systems (PROCAMS) (CVPR 2010) (2010)Google Scholar
  4. 4.
    Paterson, K.G.: Perfect maps. IEEE Transactions on Information Theory 40(3), 743–753 (1994)zbMATHCrossRefMathSciNetGoogle Scholar
  5. 5.
    Mitchell, C.J.: Aperiodic and semi-periodic perfect maps. IEEE Transactions on Information Theory 41(1), 88–95 (1995)zbMATHCrossRefGoogle Scholar
  6. 6.
    Zhang, L., Curless, B., Seitz, S.M.: Rapid shape acquisition using color structured light and multi-pass dynamic programming. In: Proc. First International Symposium on 3D Data Processing Visualization and Transmission, June 19-21, pp. 24–36 (2002)Google Scholar
  7. 7.
    Annexstein, F.: Generating de bruijn sequences: An efficient implementation. IEEE Transactions on Computers 46(2), 198–200 (1997)CrossRefGoogle Scholar
  8. 8.
    Koninckx, T.P., Van Gool, L.: Real-time range acquisition by adaptive structured light. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(3), 432–445 (2006)CrossRefGoogle Scholar
  9. 9.
    Kawasaki, H., Furukawa, R., Sagawa, R., Yagi, Y.: Dynamic scene shape reconstruction using a single structured light pattern. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition CVPR 2008, pp. 1–8 (June 2008)Google Scholar
  10. 10.
    Forster, F.: A high-resolution and high accuracy real-time 3d sensor based on structured light. In: International Symposium on 3D Data Processing Visualization and Transmission, pp. 208–215. IEEE Computer Society, Los Alamitos (2006)CrossRefGoogle Scholar
  11. 11.
    Roerdink, J.B.T.M., Meijster, A.: The watershed transform: definitions, algorithms and parallelization strategies. Fundam. Inf. 41(1-2), 187–228 (2000)zbMATHMathSciNetGoogle Scholar
  12. 12.
    Wainwright, M.J., Jordan, M.I.: Graphical Models, Exponential Families, and Variational Inference. Now Publishers Inc., Hanover (2008)Google Scholar
  13. 13.
    Felzenszwalb, P.F., Huttenlocher, D.R.: Efficient belief propagation for early vision. In: Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, 27 June-July 2, vol. 1, pp. I-261–I-268 (2004)Google Scholar
  14. 14.
    Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(11), 1222–1239 (2001)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Christoph Schmalz
    • 1
    • 2
  • Elli Angelopoulou
    • 1
  1. 1.Pattern Recognition LabUniversity of Erlangen-NurembergGermany
  2. 2.Siemens CT T HW 2MunichGermany

Personalised recommendations