Abstract
We present a new framework for robust 3D tracking, using a dynamic data driven coupling of continuous and discrete methods to overcome their limitations. Our method uses primarily the continuous-based tracking which is replaced by the discrete one, to obtain model re-initializations when necessary. We use the error in the continuous tracking to learn off-line, based on SVMs, when the continuous-based tracking fails and switch between the two methods. We develop a novel discrete method for 3D shape configuration estimation, which utilizes both frame and multi-frame features, taking into account the most recent input frames, using a time-window. We therefore overcome the error accumulation over time, that most continuous methods suffer from and simultaneously reduce the discrete method’s complexity and prevent possible multiple solutions in shape estimation. We demonstrate the power of our framework in complex hand tracking sequences with large rotations, articulations, lighting changes and occlusions.
This research has been funded by an NSF-ITR/NGS-0313134 and an NSF-ITR-[ASE+ECS]-0428231 Collaborative Project to the first author.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Abbasi, S., Mokhtarian, F., Kittler, J.: Curvature Scale Space Image in Shape Similarity Retrieval. Multimedia Systems 7(6), 467–476 (1999)
Athitsos, V., Sclaroff, S.: Database Indexing Methods for 3D Hand Pose Estimation. In: Gesture Workshop, Genova, Italy (April 2003)
Athitsos, V., Sclaroff, S.: Estimating 3D Hand Pose from a Cluttered Image. In: IEEE Conference on Computer Vision and Pattern Recognition, Wisconsin (June 2003)
Lee, J., Kunii, T.: Model-based Analysis of Hand Posture. IEEE Computer Graphics and Applications 15, 77–86 (1995)
Lin, J., Wu, Y., Huang, T.S.: Modeling the Constraints of Human Hand Motion. In: 5th Annual Federated Laboratory Symposium (ARL 2001), Maryland (2001)
Lu, S., Metaxas, D., Samaras, D., Oliensis, J.: Using Multiple Cues for Hand Tracking and Model Refinement. In: IEEE Conference on Computer Vision and Pattern Recognition, Wisconsin (June 2003)
Mokhtarian, F., Mackworth, A.: A Theory of Multiscale, Curvature-based Shape Representation for Planar Curves. Pattern Analysis and Machine Intelligence 14(8), 789–805 (1992)
Rehg, J., Kanade, T.: Model-based Tracking of Self-occluding Articulated Objects. In: IEEE International Conference on Computer Vision, Cambridge, MA (June 1995)
Rosales, R., Athitsos, V., Sigal, L., Sclaroff, S.: 3D Hand Pose Reconstruction Using Specialized Mappings. In: IEEE International Conference on Computer Vision, Vancouver, Canada (July 2001)
Shimada, N., Kimura, K., Shirai, Y.: Real-time 3D Hand Posture Estimation based on 2D Appearance Retrieval Using Monocular Camera. In: IEEE ICCV Workshop on Recognition, Analysis and Tracking of Faces and Gestures in Real-time Systems, Vancouver, Canada (July 2001)
de Silva, V., Tenenbaum, J.B.: Global versus Local Methods in Nonlinear Dimensionality Reduction. In: Baker, M.S., Thrun, S., Obermayer, K. (eds.) Advances in Neural Information Processing Systems 15, pp. 705–712. MIT Press, Cambridge (2002)
Stenger, B., Mendonca, P.R.S., Cipolla, R.: Model-based 3D Tracking of an Articulated Hand. In: IEEE Conference on Computer Vision and Pattern Recognition, Kauai (December 2001)
Stenger, B., Thayananthan, A., Torr, P.H.S., Cipolla, R.: Hand Pose Estimation Using Hierarchical Detection. In: International Workshop on Human-Computer Interaction, Prague, Czech Republic (May 2004)
Tenenbaum, J.B., de Silva, V., Langford, J.C.: A Global Geometric Framework for Nonlinear Dimensionality Reduction. Science Magazine 290, 2319–2323 (2000)
Thayananthan, A., Stenger, B., Torr, P.H.S., Cipolla, R.: Shape Context and Chamfer Matching in Cluttered Scenes. In: IEEE Conference on Computer Vision and Pattern Recognition, Madison (June 2003)
Triesch, J., von der Malsburg, C.: A System for Person-Independent Hand Posture Recognition against Complex Backgrounds. Pattern Analysis and Machine Intelligence 23(12) (December 1999)
Vapnik, V.: Statistical Learning Theory. Wiley, New York (1998)
Zhou, H., Huang, T.S.: Tracking Articulated Hand Motion with Eigen Dynamics Analysis. In: IEEE International Conference on Computer Vision, Nice, France (October 2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Metaxas, D., Tsechpenakis, G. (2005). Dynamic Data Driven Coupling of Continuous and Discrete Methods for 3D Tracking. In: Sunderam, V.S., van Albada, G.D., Sloot, P.M.A., Dongarra, J.J. (eds) Computational Science – ICCS 2005. ICCS 2005. Lecture Notes in Computer Science, vol 3515. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11428848_92
Download citation
DOI: https://doi.org/10.1007/11428848_92
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26043-1
Online ISBN: 978-3-540-32114-9
eBook Packages: Computer ScienceComputer Science (R0)