Journal of Signal Processing Systems

, Volume 86, Issue 1, pp 27–39 | Cite as

Robust Human Tracking Based on DPM Constrained Multiple-Kernel from a Moving Camera

  • Li Hou
  • Wanggen Wan
  • Kuan-Hui Lee
  • Jenq-Neng Hwang
  • Greg Okopal
  • James Pitton
Article

Abstract

In this paper, we attempt to solve the challenging task of precise and robust human tracking from a moving camera. We propose an innovative human tracking approach, which efficiently integrates the deformable part model (DPM) into multiple-kernel tracking from a moving camera. The proposed approach consists of a two-stage tracking procedure. For each frame, we first iteratively mean-shift several spatially weighted color histograms, called kernels, from the current frame to the next frame. Each kernel corresponds to a part model of a DPM-detected human. In the second step, conditioned on the tracking results of these kernels on the later frame, we then iteratively mean-shift the part models on that frame. The part models are represented by histogram of gradient (HOG) features, and the deformation cost of each part model provided by the trained DPM detector is used to constrain the movement of each detected body part from the first step. The proposed approach takes advantage of not only low computation owing to the kernel-based tracking, but also robustness of the DPM detector without the need of laborious human detection for each frame. Experimental results have shown that the proposed approach makes it possible to successfully track humans robustly with high accuracy under different scenarios from a moving camera.

Keywords

Human tracking Deformable part model Multiple-kernel tracking Histogram of gradient 

References

  1. 1.
    Yilmaz, A., Javed, O., & Shah, M. (2006). Object tracking: a survey. ACM Computing Surveys, 38(4), 1–45.CrossRefGoogle Scholar
  2. 2.
    Gerόnimo, D., Lόpez, A. M., Sappa, A. D., & Graf, T. (2010). Survey of pedestrian detection for advanced driver assistance systems. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(7), 1239–1258.CrossRefGoogle Scholar
  3. 3.
    Comaniciu, D., & Meer, P. (2002). Mean shift: a robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(5), 603–619.CrossRefGoogle Scholar
  4. 4.
    Comaniciu, D., Ramesh, V., & Meer, P. (2003). Kernel-based object tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(5), 564–577.CrossRefGoogle Scholar
  5. 5.
    Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010). Object detection with discriminatively trained part-based models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(9), 1627–1645.CrossRefGoogle Scholar
  6. 6.
    Felzenszwalb, P.F., Girshick, R.B., & McAllester, D. A. (2010). Cascade object detection with deformable part models. IEEE Conference on Computer Vision and Pattern Recognition, 2241–2248.Google Scholar
  7. 7.
    Girshick, R.B., Felzenszwalb, P.F., & McAllester, D.A. (2011). Object detection with grammar models. Advances in Neural Information Processing Systems, 442–450.Google Scholar
  8. 8.
    Chu, C.-T., Hwang, J.-N., Pai, H.-I., & Lan, K.-M. (2013). Tracking human under occlusion based on adaptive multiple kernels with projected gradients. IEEE Transactions on Multimedia, 5(7), 1602–1615.CrossRefGoogle Scholar
  9. 9.
    Martinez, B., Ferraz, L., Binefa, X., & Diaz-Caro, J. (2006). Multiple kernel two-step tracking. IEEE International Conference on Image Processing, 2785–2788.Google Scholar
  10. 10.
    Porikli, F., & Tuzel, O. (2005). Multi-kernel object tracking. IEEE International Conference Multimedia and Expo, 1234–1237.Google Scholar
  11. 11.
    Fang, J., Yang, J., & Liu, H. (2011). Efficient and robust fragments-based multiple kernels tracking. International Journal of Electronics and Communications, 65, 915–923.CrossRefGoogle Scholar
  12. 12.
    Liu, C., & Cheng, H. D. (2014). Multi-object tracking and occlusion reasoning based on adaptive weighing particle filter. New Mathematics and Natural Computation, 10(3), 225–238.CrossRefGoogle Scholar
  13. 13.
    Cheng, H. Y., & Hwang, J. N. (2009). Adaptive particle sampling and adaptive appearance for multiple video object tracking. Signal Processing, 89(9), 1844–1849.CrossRefMATHGoogle Scholar
  14. 14.
    Hager, G.D., Dewan, M., & Stewart, C.V. (2004). Multiple kernel tracking with SSD. IEEE Conference on Computer Vision and Pattern Recognition, 790–797.Google Scholar
  15. 15.
    Parameswaran, V., Ramesh, V., & Zoghlami, I. (2006). Tunable kernels for tracking. IEEE Conference on Computer Vision and Pattern Recognition, 2, 2179–2186.Google Scholar
  16. 16.
    Fan, Z., Wu, Y., & Yang, M. (2005). Multiple collaborative kernel tracking. IEEE Conference on Computer Vision and Pattern Recognition, 2, 502–509.Google Scholar
  17. 17.
    Adnriluka, M., Roth, S., & Schiele, B. (2008). People-tracking-by-detection and people-detection-by-tracking. IEEE Conference on Computer Vision and Pattern Recognition, 1–8.Google Scholar
  18. 18.
    Branson, S., Perona, P., & Belongie, S. (2011). Strong supervision from weak annotation: Interactive training of deformable part models. IEEE International Conference on Computer Vision, 1832–1839.Google Scholar
  19. 19.
    Azizpour, H., & Laptev, I. (2012). Object detection using strongly-supervised deformable part models. European Conference on Computer Vision, 836–849.Google Scholar
  20. 20.
    Niknejad, H. T., Takeuchi, A., Mita, S., & McAllester, D. (2012). On-road multivehicle tracking using deformable object model and particle filter with improved likelihood estimation. IEEE Transactions on Intelligent Transportation Systems, 13(2), 748–758.CrossRefGoogle Scholar
  21. 21.
    Shu, G., et al. (2012). Part-based multiple-person tracking with partial occlusion handling. IEEE Conference on Computer Vision and Pattern Recognition, 1815–1821.Google Scholar
  22. 22.
    Yao, R., et al. (2013). Part-based visual tracking with online latent structural learning. IEEE Conference on Computer Vision and Pattern Recognition, 2363–2370.Google Scholar
  23. 23.
    Pirsiavash, H., Ramanan, D., & Fowlkes, C.C. (2011). Globally-optimal greedy algorithms for tracking a variable number of objects. IEEE Conference on Computer Vision and Pattern Recognition, 1201–1208.Google Scholar
  24. 24.
    Wu, Z., Thangali, A., Sclaroff, S. & Betke, M. (2012). Coupling detection and data association for multiple object tracking. IEEE Conference on Computer Vision and Pattern Recognition, 1948–1955.Google Scholar
  25. 25.
    Butt, A.A., & Collins, R.T. (2013). Multi-target tracking by lagrangian relaxation to min-cost network flow. IEEE Conference on Computer Vision and Pattern Recognition, 1846–1853.Google Scholar
  26. 26.
    Hu, J. S., Juan, C. W., & Wang, J. J. (2008). A spatial-color mean-shift object tracking algorithm with scale and orientation estimation. Pattern Recognition Letters, 29(16), 2165–2173.CrossRefGoogle Scholar
  27. 27.
    Collins, R. T. (2003). Mean-shift blob tracking through scale space. IEEE Conference on Computer Vision and Pattern Recognition, 2, II-234.Google Scholar
  28. 28.
    Yilmaz, A. (2011). Kernel-based object tracking using asymmetric kernels with adaptive scale and orientation selection. Machine Vision and Applications, 22(2), 255–268.CrossRefGoogle Scholar
  29. 29.
    Wang, J., et al. (2004). Image and video segmentation by anisotropic mean shift. European Conference on Computer Vision, 238–249.Google Scholar
  30. 30.
    Bishop, C. M. (2006). Pattern Recognition and Machine Learning. Springer.Google Scholar
  31. 31.
    Ess, A., Leibe, B., Schindler, K., & VanGool, L. (2009). Robust multiperson tracking from a mobile platform. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(10), 1831–1846.CrossRefGoogle Scholar
  32. 32.
    Wu, Y., Lim, J., & Yang, M.H. (2013). Online object tracking: a benchmark. IEEE Conference on Computer Vision and Pattern Recognition, 2411–2418.Google Scholar
  33. 33.
    AR Drone 2.0, link: http://ardrone2.parrot.com/

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  • Li Hou
    • 1
    • 2
    • 3
  • Wanggen Wan
    • 1
    • 3
  • Kuan-Hui Lee
    • 4
  • Jenq-Neng Hwang
    • 4
  • Greg Okopal
    • 5
  • James Pitton
    • 5
  1. 1.School of Communication and Information EngineeringShanghai UniversityShanghaiChina
  2. 2.School of Information EngineeringHuangshan UniversityHuangshanChina
  3. 3.Institute of Smart CityShanghai UniversityShanghaiChina
  4. 4.Department of Electrical EngineeringUniversity of WashingtonSeattleUSA
  5. 5.Applied Physics LaboratoryUniversity of WashingtonSeattleUSA

Personalised recommendations