Multi-Camera Tracking with Adaptive Resource Allocation
Sensor fusion for object tracking is attractive since the integration of multiple sensors and/or algorithms with different characteristics can improve performance. However, there exist several critical limitations to sensor fusion techniques: (1) the measurement cost increases typically as many times as the number of sensors, (2) it is not straightforward to measure the confidence of each source and give it a proper weight for state estimation, and (3) there is no principled dynamic resource allocation algorithm for better performance and efficiency. We describe a method to fuse information from multiple sensors and estimate the current tracker state by using a mixture of sequential Bayesian filters (e.g., particle filter)—one filter for each sensor, where each filter makes a different level of contribution to estimate the combined posterior in a reliable manner. In this framework, multiple sensors interact to determine an appropriate sensor for each particle dynamically; each particle is allocated to only one of the sensors for measurement and a different number of particles is assigned to each sensor. The level of the contribution of each sensor changes dynamically based on its prior information and relative measurement confidence. We apply this technique to visual tracking with multiple cameras, and demonstrate its effectiveness through tracking results in videos.
KeywordsObject tracking Resource allocation Multi-camera tracking Sensor fusion Kernel-based Bayesian filtering Mixture model
Unable to display preview. Download preview PDF.
- Adlers, M. (2000). Topics in sparse least squares problems. PhD thesis, Linköpings Universitet, Sweden. Available at http://www.math.liu.se/~milun/thesis.
- Azoz, Y., Devi, L., & Sharma, R. (1998). Reliable tracking of human arm dynamics by multiple cue integration and constraint fusion. In Proc. IEEE conf. on computer vision and pattern recognition, Santa Barbara, CA. Google Scholar
- Birchfield, S. (1998). Elliptical head tracking using intensity gradients and color histograms. In Proc. IEEE conf. on computer vision and pattern recognition, Santa Barbara, CA (pp. 232–237). Google Scholar
- Cantarella, J., & Piatek, M. (2004). tsnnls: A solver for large sparse least squares problem with non-negative variables. Preprint, available at http://www.cs.duq.edu/~piatek/tsnnls/.
- Han, B., Joo, S.-W., & Davis, L. (2007). Probabilistic fusion tracking using mixture kernel-based Bayesian filtering. In Proc. 11th intl. conf. on computer vision, Rio de Janeiro, Brazil. Google Scholar
- Isard, M., & Blake, A. (1998). ICONDENSATION: Unifying low-level and high-level tracking in a stochastic framework. In Proc. European conf. on computer vision, Freiburg, Germany (pp. 893–908). Google Scholar
- Julier, S., & Uhlmann, J. (1997). A new extension of the Kalman filter to nonlinear systems. In Proceedings SPIE (Vol. 3068, pp. 182–193). Google Scholar
- Khan, S., & Shah, M. (2006). A multiview approach to tracking people in crowded scenes using a planar homography constraint. In Proc. European conf. on computer vision, Graz, Austria (Vol. IV, pp. 133–146). Google Scholar
- Kim, K., & Davis, L. (2006). Multi-camera tracking and segmentation of occluded people on ground plane using search-guided particle filtering. In Proc. European conf. on computer vision, Graz, Austria (Vol. III, pp. 98–109). Google Scholar
- Leichter, I., Lindenbaum, M., & Rivlin, E. (2006). A probabilistic framework for combining tracking algorithms. In Proc. IEEE conf. on computer vision and pattern recognition, Washington DC (pp. 445–451). Google Scholar
- Musicki, D., & La Scala, B. L. (2008). Multi-target tracking in clutter without measurement assignment. IEEE Transactions on Aerospace and Electronic Systems, 44(3). Google Scholar
- Okuma, K., Taleghani, A., de Freitas, N., Little, J., & Lowe, D. (2004). A boosted particle filter: multitarget detection and tracking. In Proc. European conf. on computer vision, Prague, Czech Republic, May 2004. Google Scholar
- Rui, Y., & Chen, Y. (2001). Better proposal distributions: object tracking using unscented particle filter. In Proc. IEEE conf. on computer vision and pattern recognition, Kauai, Hawaii (Vol. II, pp. 786–793). Google Scholar
- Salmond, D. (1990). Mixture reduction algorithms for target tracking in clutter. In SPIE signal and data processing of small targets, Orlando, FL (Vol. 1305, pp. 434–445). Google Scholar
- Sherrah, J., & Gong, S. (2001). Continuous global evidence-based Bayesian modality fusion for simultaneous tracking of multiple objects. In Proc. 8th intl. conf. on computer vision, Vancouver, Canada. Google Scholar
- Siebel, N. T., & Maybank, S. J. (2002). Fusion of multiple tracking algorithms for robust people tracking. In Proc. European conf. on computer vision, Copenhagen, Denmark (Vol. IV, pp. 373–387). Google Scholar
- van der Merwe, R., Doucet, A., Freitas, N., & Wan, E. (2000). The unscented particle filter (Technical Report CUED/F-INFENG/TR 380). Cambridge University Engineering Department. Google Scholar
- Vermaak, J., Gangnet, M., Blake, A., & Perez, P. (2001). Sequential Monte Carlo fusion of sound and vision for speaker tracking. In Proc. 8th intl. conf. on computer vision, Vancouver, Canada (Vol. I, pp. 741–746). Google Scholar
- Vermaak, J., Doucet, A., & Perez, P. (2003). Maintaining multi-modality through mixture tracking. In Proc. 9th intl. conf. on computer vision, Nice, France (Vol. II). Google Scholar
- Williams, J., & Maybeck, P. (2003). Cost-function-based Gaussian mixture reduction for target tracking. In Int. conf. information fusion (Vol. 2, pp. 1047–1054). Google Scholar
- Wu, Y., & Huang, T. (2001). A co-inference approach to robust visual tracking. In Proc. 8th intl. conf. on computer vision, Vancouver, Canada (Vol. II, pp. 26–33). Google Scholar
- Yang, C., Duraiswami, R., & Davis, L. (2005). Fast multiple object tracking via a hierarchical particle filter. In Proc. 10th intl. conf. on computer vision, Beijing, China (Vol. I, pp. 212–219). Google Scholar
- Zhong, X., Xue, J., & Zheng, N. (2006). Graphical model based cue integration strategy for head tracking. In Proc. British machine vision conference, Edinburgh, UK. Google Scholar