Belief Propagation for Improved Color Assessment in Structured Light
Single-Shot Structured Light is a well-known method for acquiring 3D surface data of moving scenes with simple and compact hardware setups. Some of the biggest challenges in these systems is their sensitivity to textured scenes, subsurface scattering and low-contrast illumination. Recently, a graph-based method has been proposed that largely eliminates these shortcomings. A key step in the graph-based pattern decoding algorithm is the estimation of color of local image regions which correspond to the vertex colors of the graph. In this work we propose a new method for estimating the color of a vertex based on belief propagation (BP). The BP framework allows the explicit inclusion of cues from neigboring vertices in the color estimation. This is especially beneficial for low-contrast input images. The augmented method is evaluated using typical low-quality real-world test sequences of the interior of a pig stomach. We demonstrate a significant improvement in robustness. The number of 3D data points generated increases by 30 to 50 percent over the plain decoding.
KeywordsBelief Propagation Texture Scene Color Enhancement Projected Color Subsurface Scattering
Unable to display preview. Download preview PDF.
- 1.Salvi, J., Fernandez, S., Pribanic, T., Llado, X.: A state of the art in structured light patterns for surface profilometry. Pattern Recognitio (2010) (in Press) (Corrected Proof)Google Scholar
- 3.Schmalz, C., Angelopoulou, E.: Belief propagation for improved color assessment in structured light. In: 7th IEEE International Workshop on Projector-Camera Systems (PROCAMS) (CVPR 2010) (2010)Google Scholar
- 6.Zhang, L., Curless, B., Seitz, S.M.: Rapid shape acquisition using color structured light and multi-pass dynamic programming. In: Proc. First International Symposium on 3D Data Processing Visualization and Transmission, June 19-21, pp. 24–36 (2002)Google Scholar
- 9.Kawasaki, H., Furukawa, R., Sagawa, R., Yagi, Y.: Dynamic scene shape reconstruction using a single structured light pattern. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition CVPR 2008, pp. 1–8 (June 2008)Google Scholar
- 12.Wainwright, M.J., Jordan, M.I.: Graphical Models, Exponential Families, and Variational Inference. Now Publishers Inc., Hanover (2008)Google Scholar
- 13.Felzenszwalb, P.F., Huttenlocher, D.R.: Efficient belief propagation for early vision. In: Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, 27 June-July 2, vol. 1, pp. I-261–I-268 (2004)Google Scholar