Abstract
We present a dynamic near-regular texture (NRT) tracking algorithm nested in a lattice-based Markov-Random-Field (MRF) model of a 3D spatiotemporal space. One basic observation used in our work is that the lattice structure of a dynamic NRT remains invariant despite its drastic geometry or appearance variations. On the other hand, dynamic NRT imposes special computational challenges to the state of the art tracking algorithms: including highly ambiguous correspondences, occlusions, and drastic illumination and appearance variations. Our tracking algorithm takes advantage of the topological invariant property of the dynamic NRT by combining a global lattice structure that characterizes the topological constraint among multiple textons and an image observation model that handles local geometry and appearance variations. Without any assumptions on the types of motion, camera model or lighting conditions, our tracking algorithm can effectively capture the varying underlying lattice structure of a dynamic NRT in different real world examples, including moving cloth, underwater patterns and marching crowd.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Liu, Y., Lin, W.C., Hays, J.: Near-regular texture analysis and manipulation. In: ACM SIGGRAPH, pp. 368–376 (2004)
Liu, Y., Tsin, Y., Lin, W.C.: The promise and perils of near-regular texture. International Journal of Computer Vision 62(1-2), 145–159 (2005)
House, D.H., Breen, D.E. (eds.): Cloth Modeling and Animation. A.K. Peters, Ltd., Natick, Massachusetts (2000)
Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. In: Burkhardt, H., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1407, pp. 484–498. Springer, Heidelberg (1998)
Matthews, I., Baker, S.: Active appearance models revisited. International Journal of Computer Vision 60(2), 135–164 (2004)
Sclaroff, S., Isidoro, J.: Active blobs. In: ICCV, pp. 1146–1153 (1998)
Guskov, I.: Multiscale inverse compositional alignment for subdivision surface maps. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3021, pp. 133–145. Springer, Heidelberg (2004)
Pilet, J., Lepetit, V., Fua, P.: Real-time non-rigid surface detection. In: CVPR, pp. 822–828 (2005)
Scholz, V., Stich, T., Keckeisen, M., Wacker, M., Magnor, M.: Garment motion capture using color-coded patterns. In: Eurographics, pp. 439–448 (2005)
Guskov, I., Klibanov, S., Bryant, B.: Trackable surfaces. In: ACM Symposium on Computer Animation, pp. 251–257 (2003)
Pritchard, D., Heidrich, W.: Cloth motion capture. In: Eurographics (2003)
Guskov, I.: Efficient tracking of regular patterns on non-rigid geometry. In: Proceedings of ICPR (2002)
Khan, Z., Balch, T., Dellaert, F.: An MCMC-based particle filter for tracking multiple interacting targets. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3024, pp. 279–290. Springer, Heidelberg (2004)
Yu, T., Wu, Y.: Decentralized multiple target tracking using netted collaborative autonomous trackers. In: CVPR, pp. 939–946 (2005)
Sudderth, E.B., Mandel, M.I., Freeman, W.T., Willsky, A.S.: Distributed occlusion reasoning for tracking with nonparametric belief propagation. In: Neural Information Processing Systems, pp. 1369–1376 (2004)
Yedidia, J., Freeman, W., Weiss, Y.: Understanding belief propagation and its generalizations. In: International Joint Conference on Artificial Intelligence (2001)
Freeman, W.T., Pasztor, E.C., Carmichael, O.T.: Learning low-level vision. Int. J. Comput. Vision 40(1), 25–47 (2000)
Lin, W.C.: A lattice-based mrf model for dynamic near-regular texture tracking and manipulation. Technical Report CMU-RI-TR-05-58, Ph.D. Thesis, Robotics Institute, Carnegie Mellon University (2005)
Sudderth, E., Ihler, A., Freeman, W., Willsky, A.: Nonparametric belief propagation. In: CVPR, pp. 605–612 (2003)
Isard, M.: Pampas: real-valued graphical models for computer vision. In: CVPR, pp. 613–620 (2003)
Isard, M., Blake, A.: Condensation – conditional density propagation for visual tracking. Int. J. Comput. Vision 29(1), 5–28 (1998)
Doucet, A., Freitas, N.D., Gordon, N.: Sequential Monte Carlo Methods in Practice. Springer, Heidelberg (2001)
Matthews, I., Ishikawa, T., Baker, S.: The template update problem. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(6), 810–815 (2004)
Black, M.J., Anandan, P.: The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields. Computer Vision and Image Understanding 63(1), 75–104 (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lin, WC., Liu, Y. (2006). Tracking Dynamic Near-Regular Texture Under Occlusion and Rapid Movements. In: Leonardis, A., Bischof, H., Pinz, A. (eds) Computer Vision – ECCV 2006. ECCV 2006. Lecture Notes in Computer Science, vol 3952. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11744047_4
Download citation
DOI: https://doi.org/10.1007/11744047_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33834-5
Online ISBN: 978-3-540-33835-2
eBook Packages: Computer ScienceComputer Science (R0)