SCOOP: A Real-Time Sparsity Driven People Localization Algorithm
Detecting and tracking people in scenes monitored by cameras is an important step in many application scenarios such as surveillance, urban planning or behavioral studies to name a few. The amount of data produced by camera feeds is so large that it is also vital that these steps be performed with the utmost computational efficiency and often even real-time. We propose SCOOP, a novel algorithm that reliably localizes people in camera feeds, using only the output of a simple background removal technique. SCOOP can handle a single or many video feeds. At the heart of our technique there is a sparse model for binary motion detection maps that we solve with a novel greedy algorithm based on set covering. We study the convergence and performance of the algorithm under various degradation models such as noisy observations and crowded environments, and we provide mathematical and experimental evidence of both its efficiency and robustness using standard datasets. This clearly shows that SCOOP is a viable alternative to existing state-of-the-art people localization algorithms, with the marked advantage of real-time computations.
KeywordsPeople localization Sparse representation Dictionary Multi-view Greedy algorithm Matching pursuit SCOOP Group testing
Part of this work was funded by the EU under research projects FET-OPEN 225913 (SMALL), ICT-216023 (APIDIS), and by the Swiss National Science Foundation under grant 200021-117884.
- 2.Berclaz, J., Fleuret, F., Fua, P.: Robust people tracking with global trajectory optimization. In: Conference on Computer Vision and Pattern Recognition (2006) Google Scholar
- 3.Black, J., Ellis, T., Rosin, P.: Multi view image surveillance and tracking. In: Proc. IEEE Workshop on Motion and Video Computing, p. 169 (2002) Google Scholar
- 7.Cheraghchi, M., Hormati, A., Karbasi, A., Vetterli, M.: Group testing with probabilistic tests: Theory, design and application. IEEE Trans. Inf. Theory (2010) Google Scholar
- 8.Delannay, D., Danhier, N., De Vleeschouwer, C.: Detection and recognition of sports(wo)man from multiple views. In: Proc. ACM/IEEE Int’l Conference on Distributed Smart Cameras, Como, Italy (2009) Google Scholar
- 10.Du, D.Z., Hwang, F.: Combinatorial Group Testing and Its Applications. World Scientific Series on Applied Mathematics (1999) Google Scholar
- 11.Ellis, A., Shahrokni, A., Ferryman, J.: Overall evaluation of the pets2009 results. In: Proc. IEEE Int’l Workshop on Performance Evaluation of Tracking and Surveillance. Snowbird, Utah (2009) Google Scholar
- 12.Eshel, R., Moses, Y.: Homography based multiple camera detection and tracking of people in a dense crowd. In: Proc. IEEE Int’l Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008) Google Scholar
- 15.Golbabaee, M., Vandergheynst, P.: Average case analysis of sparse recovery with Thresholding: New bounds based on average dictionary coherence. In: IEEE Int. Conf. on Acoustics, Speech & Signal Processing (ICASSP) (2008) Google Scholar
- 17.Khan, S., Shah, M.: A multiview approach to tracking people in crowded scenes using a planar homography constraint. In: Proc. European Conference on Computer Vision, pp. 133–146 (2006) Google Scholar
- 24.Stauffer, C., Grimson, W.: Adaptive background mixture models for real-time tracking. In: Proc. IEEE Int’l Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 246–252 (1999) Google Scholar
- 25.Stauffer, C., Tieu, K.: Automated multi-camera planar tracking correspondence modeling. In: Proc. IEEE Int’l Conference on Computer Vision and Pattern Recognition, pp. 259–266 (2003) Google Scholar
- 27.Vazirani, V.: Approximation Algorithms. Springer, Berlin (2001) Google Scholar