Multiple Pedestrian Tracking Based on Multi-layer Graph with Tracklet Segmentation and Merging

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9967)

Abstract

Multiple pedestrian tracking is regarded as a challenging work due to difficulties of occlusion, abrupt motion and changes in appearance. In this paper, we propose a multi-layer graph based data association framework to address occlusion problem. Our framework is hierarchical with three association layers and each layer has its corresponding association method. We generate short tracklets and segment some of them into small pieces based on the segmentation condition in the first layer. The segmented tracklets are merged into long tracklets using spatial-temporal information in the second layer. In the last layer, tracklets in neighboring frame-window are merged to form object track mainly by searching the global maximum overlap ratio of the tracklets. Since appearance information is not available in various scenarios, we don’t use any appearance features in our work. We evaluate our algorithm on extensive sequences including two categories and demonstrate superior experimental results.

Keywords

Multiple pedestrian tracking Multi-layer graph based Tracklet segmentation and merging 

References

  1. 1.
    Nagai, Y., Kamisaka, D., Makibuchi, N., Xu, J., Sakazawa, S.: 3D person tracking in world coordinates and attribute estimation with PDR. In: Proceedings of the 23rd ACM International Conference on Multimedia, MM 2015, pp. 1139–1142. ACM, New York (2015)Google Scholar
  2. 2.
    Tsokas, N.A., Kyriakopoulos, K.J.: Multi-robot multiple hypothesis tracking for pedestrian tracking. Auton. Robots 32(1), 63–79 (2012)CrossRefGoogle Scholar
  3. 3.
    Kasuya, N., Kitahara, I., Kameda, Y., Ohta, Y.: Real-time soccer player tracking method by utilizing shadow regions. In: Proceedings of the 18th ACM International Conference on Multimedia, MM 2010, pp. 1319–1322. ACM, New York (2010)Google Scholar
  4. 4.
    Chu, C.-T., Hwang, J.-N., Pai, H.-I., Lan, K.-M.: Tracking human under occlusion based on adaptive multiple kernels with projected gradients. IEEE Trans. Multimedia 15(7), 1602–1615 (2013)CrossRefGoogle Scholar
  5. 5.
    Wang, Z., Yoon, S., Park, D.S.: Online adaptive multiple pedestrian tracking in monocular surveillance video. Neural Comput. Appl. 1–15 (2016)Google Scholar
  6. 6.
    Kim, D., Kim, D.: Self-occlusion handling for human body motion tracking from 3D TOF image sequence. In: Proceedings of the 1st International Workshop on 3D Video Processing, 3DVP 2010, pp. 57–62. ACM, New York (2010)Google Scholar
  7. 7.
    Wen, L., Li, W., Yan, J., Lei, Z., Yi, D., Li, S.Z.: Multiple target tracking based on undirected hierarchical relation hypergraph. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1282–1289. IEEE (2014)Google Scholar
  8. 8.
    Shu, G., Dehghan, A., Oreifej, O., Hand, E., Shah, M.: Part-based multiple-person tracking with partial occlusion handling. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1815–1821. IEEE (2012)Google Scholar
  9. 9.
    Amitha Perera, A.G., Srinivas, C., Hoogs, A., Brooksby, G., Hu, W.: Multi-object tracking through simultaneous long occlusions and split-merge conditions. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 666–673. IEEE (2006)Google Scholar
  10. 10.
    Tang, S., Andriluka, M., Schiele, B.: Detection and tracking of occluded people. Int. J. Comput. Vis. 110(1), 58–69 (2014)CrossRefGoogle Scholar
  11. 11.
    Possegger, H., Mauthner, T., Roth, P., Bischof, H.: Occlusion geodesics for online multi-object tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1306–1313 (2014)Google Scholar
  12. 12.
    Lee, D.-Y., Sim, J.-Y., Kim, C.-S.: Multihypothesis trajectory analysis for robust visual tracking. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015Google Scholar
  13. 13.
    Lu, Y., Wu, T., Zhu, S.: Online object tracking, learning and parsing with and-or graphs. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3462–3469 (2014)Google Scholar
  14. 14.
    Li, Y., Zhu, J., Hoi, S.C.H.: Reliable patch trackers: robust visualtracking by exploiting reliable patches. In: The IEEE Conference on ComputerVision and Pattern Recognition (CVPR), June 2015Google Scholar
  15. 15.
    Hong, Z., Chen, Z., Wang, C., Mei, X., Prokhorov, D., Tao, D.: Multi-store tracker (muster): a cognitive psychology inspired approach toobject tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 749–758 (2015)Google Scholar
  16. 16.
    Vadivel, K.S., Ngo, T., Eckstein, M., Manjunath, B.S.: Eye tracking assisted extraction of attentionally important objects from videos. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015Google Scholar
  17. 17.
    Tang, S., Andres, B., Andriluka, M., Schiele, B.: Subgraph decomposition for multi-target tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5033–5041 (2015)Google Scholar
  18. 18.
    Chari, V., Lacoste-Julien, S., Laptev, I., Sivic, J.: On pairwise costs for network flow multi-object tracking. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015Google Scholar
  19. 19.
    Kuhn, H.W.: The hungarian method for the assignment problem. Navalresearch Logistics Q. 2(1–2), 83–97 (1955)MathSciNetCrossRefMATHGoogle Scholar
  20. 20.
    Hofmann, M., Tiefenbacher, P., Rigoll, G.: Background segmentation with feedback: the pixel-based adaptivesegmenter. In: 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 38–43. IEEE (2012)Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  • Wencheng Duan
    • 1
  • Tao Yang
    • 1
  • Jing Li
    • 2
  • Yanning Zhang
    • 1
  1. 1.School of Computer ScienceNorthwestern Polytechnical UniversityXianChina
  2. 2.School of Telecommunications EngineeringXidian UniversityXianChina

Personalised recommendations