Unsupervised Pedestrian Re-identification for Loitering Detection

  • Chung-Hsien Huang
  • Yi-Ta Wu
  • Ming-Yu Shih
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5414)


This paper presents a framework of detecting loitering pedestrians in a video surveillance system. First, to represent pedestrians an appearance feature which contains geometric information and color structure is proposed. After feature extraction, pedestrians are tracked by a proposed Bayesian-based appearance tracker. The tracker takes the advantage of Bayesian decision to associate the detected pedestrians according to their color appearances and spatial location among consecutive frames. The pedestrian’s appearance is modeled as a multivariate normal distribution and recorded in a pedestrian database. The database also records time stamps when the pedestrian appears as an appearing history. Therefore, even though the pedestrian leaves and returns to the scene, he/she can still be re-identified as a loitering suspect. However, a critical threshold which determines whether two appearances are associated or not is needed to be set. Thus we propose a method to learn the associating threshold by observing two specific events from on-line video. A 10-minute video about three loitering pedestrians is used to test the proposed system. They are successfully detected and recognized from other passing-by pedestrians.


Video surveillance loitering detection pedestrian re-identification Bayesian decision tracking 


  1. 1.
    ObjectVideo, Inc.,
  2. 2.
  3. 3.
    Adam, A., Rivlin, E., Shimshoni, I., Reinitz, D.: Robust Real-Time Unusual Event Detection Using Multiple Fixed-Location Monitors. IEEE Trans. Pattern Analysis and Machine Intelligence 30(3), 555–560 (2008)CrossRefGoogle Scholar
  4. 4.
    Hsieh, J.-W., Hsu, Y.-T., Liao, H.-Y., Chen, C.-C.: Video-Based Human Movement Analysis and Its Application to Surveillance Systems. IEEE Trans. Multimedia 10(3), 372–384 (2008)CrossRefGoogle Scholar
  5. 5.
    Siebel, N.T., Maybank, S.: Fusion of multiple tracking algorithms for robust people tracking. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2353, pp. 373–387. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  6. 6.
    Black, J., Velastin, S., Boghossian, B.: A Real Time Surveillance System for Metropolitan Railways. In: Proceedings of IEEE Conference on Advanced Video and Signal Based Surveillance, pp. 189–194 (2005)Google Scholar
  7. 7.
    Bird, N.D., Masoud, O., Paapnikolopoulos, P.P., Isaacs, A.: Detection of Loitering Individuals in Public Transportation Areas. IEEE Trans. Intelligent Transportation Systems 6(2), 167–177 (2005)CrossRefGoogle Scholar
  8. 8.
    Stauffer, C., Grimson, W.E.L.: Adaptive Background Mixture Models for Real-time Tracking. Proc. IEEE Comput. Vision Pattern Recognit. 2, 246–252 (1999)Google Scholar
  9. 9.
    Martel-Brisson, N., Zaccarin, A.: Learning and Removing Cast Shadows through a Multidistribution Apprach. IEEE Trans. Pattern Analysis and Machine Intelligence 29(7), 1133–1146 (2007)CrossRefGoogle Scholar
  10. 10.
    Kullback, S.: Information Theory and Statistics. Dover Publications, New York (1968)zbMATHGoogle Scholar
  11. 11.
    Duda, O.R., Hart, P.E., Stork, D.G.: Pattern Classification. A Wiley-Interscience Publication, Hoboken (2000)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Chung-Hsien Huang
    • 1
  • Yi-Ta Wu
    • 1
  • Ming-Yu Shih
    • 1
  1. 1.Advanced Technology Center, Information & Communications Research LaboratoriesIndustrial Technology Research InstituteHsinchiuTaiwan

Personalised recommendations