People Counter: Counting of Mostly Static People in Indoor Conditions

  • Amit Khemlani
  • Kester Duncan
  • Sudeep Sarkar
Part of the Studies in Computational Intelligence book series (SCI, volume 409)

Abstract

The ability to count people from video is a challenging problem. The scientific challenge arises from the fact that although the task is relatively well-defined, the imaging scenario is not well constrained. The background scene can be uncontrolled along with the illumination being complex and varying. Additionally, the spatial and temporal image resolution is usually poor. The context of most works in people counting is in counting pedestrians from single frames in outdoor settings or moving subjects in indoor settings from standard frame rate video. There is little work done on counting of persons in varying poses, who are mostly static (sitting, lying down), in very low frame rate video (4 frames per minute), and under harsh illumination variations. In this chapter, we explore a design that handles illumination issues at the pixel level using photometry-based normalization, and pose and low-movement issues at feature level by exploiting the spatio-temporal coherence that is present among small body part movements. The motion of each body part, such as the hands or the head, will be present even in mostly static poses. These short duration motions will occur spatially close together over the image location occupied by the subject. We accumulate these using a spatio-temporal autoregressive (AR) model to arrive at blob representations that are further grouped into people counts. We show quantitative performance on real datasets.

Keywords

Illumination Change Frame Difference Indoor Condition Connected Component Analysis Frame Rate Video 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Beymer, D.J.: Person counting using stereo. In: Workshop on Human Motion, pp. 127–134 (2000)Google Scholar
  2. 2.
    Boyer, K., Sarkar, S.: Perceptual Organization for Artificial Vision Systems. Kluwer (March 2000)Google Scholar
  3. 3.
    Celik, H., Hanjalic, A., Hendriks, E.: Towards a robust solution to people counting. In: IEEE International Conference on Image Processing, pp. 2401–2404 (October 2006)Google Scholar
  4. 4.
    Conrad, G., Johnsonbaugh, R.: A Real-time People Counter. In: ACM Symposium on Applied Computing, pp. 20–24. ACM, New York (1994)Google Scholar
  5. 5.
    Fehr, D., Sivalingam, R., Morellas, V., Papanikolopoulos, N., Lotfallah, O., Park, Y.: Counting people in groups. In: IEEE International Conference on Advanced Video and Signal Based Surveillance, pp. 152–157 (September 2009)Google Scholar
  6. 6.
    Haralick, M., Shapiro, G.: Computer and Robot Vision. Addison-Wesley Longman Publishing Co., Inc. (1992)Google Scholar
  7. 7.
    Haritaoglu, I., Flickner, M.: Attentive billboards. In: Conference on Image Analysis and Processing, pp. 162–167 (2001)Google Scholar
  8. 8.
    Hou, Y.-L., Pang, G.: People counting and human detection in a challenging situation. IEEE Transactions on Systems, Man and Cybernetics, Part A 41(1), 24–33 (2011)CrossRefGoogle Scholar
  9. 9.
    Huang, D., Tommy, W., Chow, S., Chau, W.: Neural network based system for counting people. In: Industrial Electrical Society, pp. 2197–2201 (2002)Google Scholar
  10. 10.
    Jabri, S., Duric, Z., Wechsler, H., Rosenfeld, A.: Detection and location of people in video images using adaptive fusion of color and edge information. In: International Conference on Pattern Recognition, pp. 627–630 (2000)Google Scholar
  11. 11.
    Kettnaker, V., Zabih, R.: Counting people from multiple cameras. In: IEEE International Conference on Multimedia Computing and Systems, pp. 267–271 (1999)Google Scholar
  12. 12.
    Kim, J., Choi, K., Choi, B., Lee, J., Ko, S.: Real-time system for counting the number of passing people using a single camera, 466–473 (2003)Google Scholar
  13. 13.
    Kuno, Y., Watanabe, T., Shimosakoda, Y., Nakagawa, S.: Automated detection of human for visual surveillance system. In: International Conference on Pattern Recognition, p. C92.2 (1996)Google Scholar
  14. 14.
    Lee, M.: Detecting people in cluttered indoor scenes. In: Computer Vision and Pattern Recognition, pp. 804–809 (2000)Google Scholar
  15. 15.
    Mohan, A., Papageorgiou, C.P., Poggio, T.: Example-based object detection in images by components. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(4), 349–361 (2001)CrossRefGoogle Scholar
  16. 16.
    Ramanan, D., Forsyth, D., Zisserman, A.: Tracking people by learning their appearance. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(1), 65–81 (2007)CrossRefGoogle Scholar
  17. 17.
    Ramoser, H., Schlogl, T., Beleznai, C., Winter, M., Bischof, H.: Shape-based detection of humans for video surveillance applications. In: International Conference on Image Processing, pp. III: 1013–III: 1016 (2003)Google Scholar
  18. 18.
    Rossi, M., Bozzoli, A.: Tracking and counting moving people. In: International Conference on Image Processing, pp. 212–216 (1994)Google Scholar
  19. 19.
    Schofield, A., Mehta, P., Stonham, T.: A system for counting people in video images using neural networks to identify the background scene. In: International Conference on Pattern Recognition, vol. 29(8), pp. 1421–1428 (1996)Google Scholar
  20. 20.
    Segen, J., Pingali, G.: A camera-based system for tracking people in real time. In: International Conference on Pattern Recognition, pp. 63–67 (1996)Google Scholar
  21. 21.
    Shi, J., Malik, J.: Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(8), 888–905 (2000)CrossRefGoogle Scholar
  22. 22.
    Stillman, S., Tanawongsuwan, R., Essa, I.: Tracking multiple people with multiple cameras. In: Workshop on Perceptual User Interfaces (1998)Google Scholar
  23. 23.
    Wong, A., You, M.: Entropy and distance of random graphs with application to structural pattern recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 7(5), 599–609 (1985)MATHCrossRefGoogle Scholar
  24. 24.
    Wu, Z., Leahy, R.: An optimal graph theoretic approach to data clustering: Theory and its application to image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 15(11), 1101–1113 (1993)CrossRefGoogle Scholar
  25. 25.
    Yang, D.B., Gonzalez-Banos, H.H.: Counting people in crowds with a real-time network of simple image sensors. In: International Conference on Computer Vision, pp. 122–129 (2003)Google Scholar
  26. 26.
    Yoshida, D., Terada, K., Oe, S., Yamaguchi, J.: A method of counting the passing people by using the stereo images. In: International Conference on Image Processing, p. 26AP3 (1999)Google Scholar
  27. 27.
    Yu, S., Chen, X., Sun, W., Xie, D.: A robust method for detecting and counting people. In: International Conference on Audio, Language and Image Processing, pp. 1545–1549 (July 2008)Google Scholar
  28. 28.
    Zhao, T., Nevatia, R.: Tracking multiple humans in complex situations. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(9), 1208–1221 (2004)CrossRefGoogle Scholar
  29. 29.
    Zhao, X., Delleandrea, E., Chen, L.: A people counting system based on face detection and tracking in a video. In: IEEE International Conference on Advanced Video and Signal Based Surveillance, pp. 67–72 (September 2009)Google Scholar

Copyright information

© Springer Berlin Heidelberg 2012

Authors and Affiliations

  • Amit Khemlani
    • 1
  • Kester Duncan
    • 1
  • Sudeep Sarkar
    • 1
  1. 1.Computer Science and EngineeringUniversity of South FloridaTampaUSA

Personalised recommendations