Abstract
Tracking multiple people under occlusion and across cameras is a challenging question for discussion. Furthermore, the cameras in this study are used to extend the field of view, which are distinguished from the same field of view. Such correspondence between multiple cameras is a burgeoning research subject in the area of computer vision. This paper effectively solves the problems of tracking multiple people who pass from one camera to another and segmenting people under occlusion using probabilistic models. The probabilistic models are composed of blob model, motion model and color model, which make the most of the space, motion and color information. First, we present a color model that uses maximum likelihood estimation based on non-parametric kernel density estimation. Second, we introduce a blob model based on mean shift, which segments the body into many regions according to the color of each person in order to spatially localize the color features corresponding to the way people are dressed. Clothes can be any mixture of colors. Third, we bring forward a motion model based on statistical probability which indicates the movement position of the same person between two successive frames in a single camera. Finally, we effectively unify the three models into a general probabilistic model and attain a maximization likelihood probability image, which is used to segment the foreground region under occlusion and to match people across multiple cameras.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Angel, D.S., Aifanti, N., Malassiotis, S., Strintzis, M.G., 2005. Prior knowledge based motion model representation. Electr. Lett. Comput. Vis. Image Anal., 5(3):55–67.
Black, J., Ellis, T., Rosin, P., 2002. Multi-view Image Surveillance and Tracking. IEEE Workshop on Motion and Video Computing, p.169–174. [doi:10.1109/MOTION. 2002.1182230]
Comaniciu, D., Meer, P., 1999. Mean Shift: analysis and Applications. IEEE Int. Conf. on Computer Vision, Kerkyra, Greece, p.1197–1203.
Comaniciu, D., Meer, P., 2002. Mean shift: A robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell., 24(5):603–619. [doi:10.1109/34.1000236]
Cucchiara, R., Grana, C., Piccardi, M., Prati, A., 2003. Detecting moving objects, ghosts, and shadows in video streams. IEEE. Trans. Pattern Anal. Mach. Intell., 25(10):1337–1342. [doi:10.1109/TPAMI.2003.1233909]
Du, W., Piater, J., 2007. Multi-camera People Tracking by Collaborative Particle Filters and Principal Axis-based Integration. Asian Conf. on Computer Vision, p.365–374.
Duong, T., Hazelton, M.L., 2005. Cross-validation bandwidth matrices for multivariate kernel density estimation. Scandinav. J. Statist., 32(3):485–506. [doi:10.1111/j. 1467-9469.2005.00445.x]
Fleuret, F., Berclaz, J., Lengagne, R., Fua, P., 2007. Multicamera people tracking with a probabilistic occupancy map. IEEE. Trans. Pattern Anal. Mach. Intell., 30(2):267–282. [doi:10.1109/TPAMI.2007.1174]
Giné, E., Koltchinskii, V., Zinn, J., 2004. Weighted uniform consistency of kernel density estimators. Inst. Math. Stat. Ann. Probab., 32(3B):2570–2605.
Han, M., Xu, W., Tao, H., Gong, Y., 2004. An Algorithm for Multiple Object Trajectory Tracking. Conf. on Computer Vision and Pattern Recognition, 1:864–871.
Isard, M., MacCormick, J., 2001. Bramble: A Bayesian Multiple-blob Tracker. Conf. on Computer Vision and Pattern Recognition, 2:34–41.
Javed, O., Rasheed, Z., Shafique, K., Shah, M., 2003. Tracking Across Multiple Cameras with Disjoint Views. Proc. 9th IEEE Int. Conf. on Computer Vision, 2:952–957. [doi:10.1109/ICCV.2003.1238451]
Kang, J., Cohen, I., Medioni, G., 2004. Tracking People in Crowded Scenes Across Multiple Cameras. Asian Conf. on Computer Vision.
Khan, S., Shah, M., 2000. Tracking People in Presence of Occlusion. Asian Conf. on Computer Vision.
Khan, S., Shah, M., 2003. Consistent labeling of tracked objects in multiple cameras with overlapping field of view. IEEE Trans. Pattern Anal. Mach. Intell., 25(10):1355–1360. [doi:10.1109/TPAMI.2003.1233912]
Khan, S., Shah, M., 2006. A Multiview Approach to Tracking People in Crowded Scenes Using a Planar Homography Constraint. Proc. European Conf. on Computer Vision.
Lim, H., Morariu, V.I., Camps, O.I., Sznaier, M., 2006. Dynamic Appearance Modeling for Human Tracking. Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition.
Mittal, A., Davis, L.S., 2003. M2tracker: A multi-view approach to segmenting and tracking people in a cluttered scene. Int. J. Comput. Vis., 51(3):189–203. [doi:10. 1023/A:1021849801764]
Otsuka, K., Mukawa, N., 2004. Multi-view Occlusion Analysis for Tracking Densely Populated Objects Based on 2-D Visual Angles. Conf. on Computer Vision and Pattern Recognition.
Romano, R., Lee, L., Stein, G., 2000. Monitoring activities from multiple video streams: Establishing a common coordinate frame. IEEE Trans. PAMI, 22(8):758–768.
Scott, D.W., Sain, S.R., 2004. Multi-dimensional Density Estimation. Elsevier Science.
Smith, K., Gatica-Perez, D., Odobez, J.M., 2005. Using Particles to Track Varying Numbers of Interacting People. Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, 1:962–969.
Stauffer, C., Grimson, W.E.L., 1999. Adaptive Background Mixture Models for Real-time Tracking. Proc. IEEE Conf. on Computer Vision and Pattern Recognition.
Sullivan, J., Blake, A., Isard, M., MacCormick, J., 1999. Object Localization by Bayesian Correlation. Proc. 7th Int. Conf. on Computer Vision, 2:1068–1075.
Vega, I.R., Sarkar, S., 2003. Statistical motion model based on the change of feature relation ships: human gait-based recognition. IEEE Trans. Pattern Anal. Mach. Intell., 25(10):1323–1328. [doi:10.1109/TPAMI.2003.1233906]
Wren, C.R., Pentland, A.P., 1998. Dynamic Modeling of Human Motion. Proc. 3rd IEEE Int. Conf. on Automatic Face and Gesture Recognition, p.22–27.
Yu, Y., Harwood, D., Yoon, K., Davis, L.S., 2007. Human appearance modeling for matching across video sequences. Mach. Vis. Appl., 18(3–4):139–149. [doi:10. 1007/s00138-006-0061-z]
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wang, Xh., Liu, Jl. Tracking multiple people under occlusion and across cameras using probabilistic models. J. Zhejiang Univ. Sci. A 10, 985–996 (2009). https://doi.org/10.1631/jzus.A0820474
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1631/jzus.A0820474