DAGM 2005: Pattern Recognition pp 109-116 | Cite as

Three-Dimensional Shape Knowledge for Joint Image Segmentation and Pose Estimation

  • Thomas Brox
  • Bodo Rosenhahn
  • Joachim Weickert
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3663)

Abstract

This paper presents the integration of 3D shape knowledge into a variational model for level set based image segmentation and tracking. Having a 3D surface model of an object that is visible in the image of a calibrated camera, the object contour stemming from the segmentation is applied to estimate the 3D pose parameters, whereas the object model projected to the image plane helps in a top-down manner to improve the extraction of the contour and the region statistics. The present approach clearly states all model assumptions in a single energy functional. This keeps the model manageable and allows further extensions for the future. While common alternative segmentation approaches that integrate 2D shape knowledge face the problem that an object can look very different from various viewpoints, a 3D free form model ensures that for each view the model can perfectly fit the data in the image. Moreover, one solves the higher level problem of determining the object pose including its distance to the camera. Experiments demonstrate the performance of the method.

Keywords

Image Segmentation Rigid Motion Active Contour Model Cluttered Scene Pose Estimation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Brox, T., Rousson, M., Deriche, R., Weickert, J.: Unsupervised segmentation incorporating colour, texture, and motion. In: Petkov, N., Westenberg, M.A. (eds.) CAIP 2003. LNCS, vol. 2756, pp. 353–360. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  2. 2.
    Brox, T., Weickert, J.: A TV flow based local scale measure for texture discrimination. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3022, pp. 578–590. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  3. 3.
    Caselles, V., Catté, F., Coll, T., Dibos, F.: A geometric model for active contours in image processing. Numerische Mathematik 66, 1–31 (1993)MATHCrossRefMathSciNetGoogle Scholar
  4. 4.
    Chan, T., Vese, L.: An active contour model without edges. In: Nielsen, M., Johansen, P., Fogh Olsen, O., Weickert, J. (eds.) Scale-Space 1999. LNCS, vol. 1682, pp. 141–151. Springer, Heidelberg (1999)CrossRefGoogle Scholar
  5. 5.
    Cremers, D., Osher, S., Soatto, S.: A multi-modal translation-invariant shape prior for level set segmentation. In: Rasmussen, C.-E., Bülthoff, H., Giese, M., Schölkopf, B. (eds.) DAGM 2004. LNCS, vol. 3175, pp. 36–44. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  6. 6.
    Cremers, D., Tischhäuser, F., Weickert, J., Schnörr, C.: Diffusion snakes: introducing statistical shape knowledge into the Mumford-Shah functional. International Journal of Computer Vision 50(3), 295–313 (2002)MATHCrossRefGoogle Scholar
  7. 7.
    Dervieux, A., Thomasset, F.: A finite element method for the simulation of Rayleigh–Taylor instability. In: Rautman, R. (ed.) Approximation Methods for Navier–Stokes Problems. Lecture Notes in Mathematics, vol. 771, pp. 145–158. Springer, Heidelberg (1979)CrossRefGoogle Scholar
  8. 8.
    Grimson, W.E.L.: Object Recognition by Computer. MIT Press, Cambridge (1990)Google Scholar
  9. 9.
    Leventon, M.E., Grimson, W.E.L., Faugeras, O.: Statistical shape influence in geodesic active contours. In: Proc. 2000 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Hilton Head, SC, vol. 1, pp. 316–323. IEEE Computer Society Press, Los Alamitos (2000)Google Scholar
  10. 10.
    Murray, R., Li, Z., Sastry, S.: Mathematical Introduction to Robotic Manipulation. CRC Press, Boca Raton (1994)MATHGoogle Scholar
  11. 11.
    Osher, S., Sethian, J.A.: Fronts propagating with curvature-dependent speed: Algorithms based on Hamilton–Jacobi formulations. Journal of Computational Physics 79, 12–49 (1988)MATHCrossRefMathSciNetGoogle Scholar
  12. 12.
    Paragios, N., Deriche, R.: Unifying boundary and region-based information for geodesic active tracking. In: Proc. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Forth Collins, Colorado, June 1999, vol. 2, pp. 300–305 (1999)Google Scholar
  13. 13.
    Riklin-Raviv, T., Kiryati, N., Sochen, N.: Unlevel-sets: geometry and prior-based segmentation. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3024, pp. 50–61. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  14. 14.
    Rosenhahn, B.: Pose estimation revisited. Technical Report TR-0308, Institute of Computer Science, University of Kiel, Germany (October 2003)Google Scholar
  15. 15.
    Rosenhahn, B., Sommer, G.: Pose estimation of free-form objects. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3021, pp. 414–427. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  16. 16.
    Rousson, M., Paragios, N.: Shape priors for level set representations. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2351, pp. 78–92. Springer, Heidelberg (2002)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Thomas Brox
    • 1
  • Bodo Rosenhahn
    • 2
  • Joachim Weickert
    • 1
  1. 1.Mathematical Image Analysis Group, Faculty of Mathematics and Computer ScienceSaarland UniversitySaarbrückenGermany
  2. 2.Centre for Imaging Technology and Robotics (CITR)University of AucklandNew Zealand

Personalised recommendations