Abstract
Self-occlusion is a common problem in silhouette based motion capture, which often results in ambiguous pose configurations. In most works this is compensated by a priori knowledge about the motion or the scene, or by the use of multiple cameras. Here we suggest to overcome this problem by splitting the surface model of the object and tracking the silhouette of each part rather than the whole object. The splitting can be done automatically by comparing the appearance of the different parts with the Jensen-Shannon divergence. Tracking is then achieved by maximizing the appearance differences of all involved parts and the background simultaneously via gradient descent. We demonstrate the improvements with tracking results from simulated and real world scenes.
We acknowledge funding by the German Research Foundation under the projects We 2602/5-1 and SO 320/4-2, and by the Max-Planck Center for Visual Computing and Communication.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Brox, T., Rosenhahn, B., Cremers, D., Seidel, H.-P.: Nonparametric density estimation with adaptive anisotropic kernels for human motion tracking. In: Elgammal, A., Rosenhahn, B., Klette, R. (eds.) Human Motion 2007. LNCS, vol. 4814, pp. 152–165. Springer, Heidelberg (2007)
Fossati, A., Dimitrijevic, M., Lepetit, V., Fua, P.: Bridging the gap between detection and tracking for 3D monocular video-based motion capture. In: Proc. 2007 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Minneapolis, MI, June 2007, pp. 1–8. IEEE Computer Society Press, Los Alamitos (2007)
Gavrila, D.M.: The visual analysis of human movement: a survey. Computer Vision and Image Understanding 73(1), 82–98 (1999)
Kullback, S., Leibler, R.A.: On information and sufficiency. Annals of Mathematical Statistics 22, 79–86 (1951)
Micilotta, A., Ong, E., Bowden, R.: Detection and tracking of humans by probabilistic body part assembly. In: Proceedings of the British Machine Vision Conference (BMVC 2005), Oxford, UK, September 2005, pp. 429–438 (2005)
Moeslund, T.B., Hilton, A., Krüger, V.: A survey of advances in vision-based human motion capture and analysis. International Journal of Computer Vision 104(2), 90–126 (2006)
Poppe, R.: Vision-based human motion analysis: An overview. Computer Vision and Image Understanding 108(1-2), 4–18 (2007)
Rosenhahn, B., Brox, T., Weickert, J.: Three-dimensional shape knowledge for joint image segmentation and pose tracking. International Journal of Computer Vision 73(3), 243–262 (2007)
Schmaltz, C., Rosenhahn, B., Brox, T., Cremers, D., Weickert, J., Wietzke, L., Sommer, G.: Region-based pose tracking. In: Martí, J., Benedí, J.M., Mendonça, A.M., Serrat, J. (eds.) IbPRIA 2007. LNCS, vol. 4478, pp. 56–63. Springer, Heidelberg (2007)
Schmaltz, C., Rosenhahn, B., Brox, T., Weickert, J., Cremers, D., Wietzke, L., Sommer, G.: Occlusion modeling by tracking multiple objects. In: Hambrecht, F., Schnörr, C., Jähne, B. (eds.) DAGM 2007. LNCS, vol. 4713, pp. 173–183. Springer, Heidelberg (2007)
Shreiner, D., Woo, M., Neider, J., Davis, T.: OpenGL programming guide, 5th edn. Addison-Wesley, Upper Saddle River (2006)
Sidenbladh, H., Black, M.J., Sigal, L.: Implicit probabilistic models of human motion for synthesis and tracking. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 784–800. Springer, Heidelberg (2002)
Sigal, L., Black, M.J.: Humaneva: Synchronized video and motion capture dataset for evaluation of articulated motion. Technical Report CS-06-08, Department of Computer Science, Brown University (September 2006)
Sigal, L., Sidharth, B., Roth, S., Black, M., Isard, M.: Tracking loose-limbed people. In: Proc. 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, June 2004, vol. 1, pp. 421–428. IEEE Computer Society Press, Los Alamitos (2004)
Urtasun, R., Fleet, D., Fua, P.: 3D people tracking with gaussian process dynamical models. In: Proc. 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York, September 2006, pp. 238–245. IEEE Computer Society Press, Los Alamitos (2006)
Wong, A.K.C., You, M.: Entropy and distance of random graphs with application of structural pattern recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 7(5), 599–609 (1985)
Zhang, J., Collins, R., Liu, Y.: Bayesian body localization using mixture of nonlinear shape models. In: Proc. Tenth International Conference on Computer Vision, Beijing, China, October 2005, pp. 725–732. IEEE Computer Society Press, Los Alamitos (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schmaltz, C., Rosenhahn, B., Brox, T., Weickert, J., Wietzke, L., Sommer, G. (2008). Dealing with Self-occlusion in Region Based Motion Capture by Means of Internal Regions. In: Perales, F.J., Fisher, R.B. (eds) Articulated Motion and Deformable Objects. AMDO 2008. Lecture Notes in Computer Science, vol 5098. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-70517-8_11
Download citation
DOI: https://doi.org/10.1007/978-3-540-70517-8_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-70516-1
Online ISBN: 978-3-540-70517-8
eBook Packages: Computer ScienceComputer Science (R0)