Face Occlusion Detection for Automated Teller Machine Surveillance

  • Daw-Tung Lin
  • Ming-Ju Liu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4319)


Real time automatic alarm systems play an essential role in security management, as evidenced by the surveillance cameras installed in nearly all automated teller machines (ATMs). Whereas manual video surveillance requires constant staff monitoring, fatigue or distraction is a common human error. Therefore, this work presents an effective detection system for facial occlusion to assist security personnel in surveillance by providing both valuable information for further video indexing applications and important clues for investigating a crime. A series of methods that include identifying and segmenting moving objects is formed. The moving edge is then captured using change detection of the inter-frame difference and the Sobel operator. Next, a Straight Line Fitting (MSLF) algorithm is developed to merge the splitting blobs. Additionally, a mechanism involving moving forward or backward justification is used to determine whether an individual is approaching a camera. Moreover, the lower boundary of a head is computed, followed by use of an elliptical head tracker to match the head region. Finally, skin area ratio is calculated to determine whether the face is occluded or not. The proposed detection system can achieve 100% and 96.15% accuracy for non-occlusive and occlusive detection, respectively, at a speed of up to 20 frames per second.


Video Clip Current Frame Automate Teller Machine Motion Edge Occlusion Detection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Stringa, E., Regazzoni, C.S.: Real-time video-shot detection for scene surveillance applications. IEEE Transactions on Image Processing 9(1), 69–79 (2000)CrossRefGoogle Scholar
  2. 2.
    Haritaoglu, I., Harwood, D., Davis, L.S.: W4:real-time surveillance of people and their activities. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(8), 809–830 (2000)CrossRefGoogle Scholar
  3. 3.
    Masoud, O., Papanikolopoulos, N.P.: A novel method for tracking and counting pedestrians in real-time using a single camera. IEEE Transactions on Vehicular Technology 50(5), 1267–1278 (2001)CrossRefGoogle Scholar
  4. 4.
    Kim, C., Hwang, J.-N.: Fast and automatic video object segmentation and tracking for content-based applications. IEEE Transactions on Circuits And Systems for Video Technology 12(2), 122–129 (2002)CrossRefGoogle Scholar
  5. 5.
    Lee, S.-J., Ouyang, C.-S., Du, S.-H.: A neuro-fuzzy approach for segmentation of human objects in image sequences. IEEE Transactions on Systems, Man, and CybernaticsXPart B 33(3), 420–437 (2003)CrossRefGoogle Scholar
  6. 6.
    Wren, C.R., Azarbayejani, A., Darrell, T., Pentland, A.: Pfinder: real-time tracking of the human body. IEEE Transactions on Pattern Analysis and Machine Intrelligence, 780–785 (1997)Google Scholar
  7. 7.
    Stauffer, C., Grimson, W.E.L.: Learning patterns of activity using real-time tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 747–757 (2000)Google Scholar
  8. 8.
    Zhao, W., Chellappa, R., Phillips, P., Rosenfeld, A.: Face recognition: A literature survey. ACM Computing Surveys 35(4), 399–458 (2003)CrossRefGoogle Scholar
  9. 9.
    Brunelli, R., Poggio, T.: Face recognition: Features versus templates. IEEE Transactions on Pattern Analysis and Machine Intelligence 15, 1042–1052 (1993)CrossRefGoogle Scholar
  10. 10.
    Fukumi, M., Mitsukura, Y., Akamatsu, N.: A design of face detection system by lip detection neural network and skin distinction neural network. In: IEEE International Conference on Systems, Man and Cybernetics, October 2000, vol. 4, pp. 2789–2793 (2000)Google Scholar
  11. 11.
    Kurita, T., Pic, M., Takahashi, T.: Recognition and detection of occluded faces by a neural network classifier with recursive data reconstruction. In: Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, pp. 53–58 (2003)Google Scholar
  12. 12.
    Ciocoiu, I.B.: Occluded face recognition using parts-based representation methods. In: Proceedings of the 2005 European Conference on Circuit Theory and Design, vol. 1, pp. 315–318 (2005)Google Scholar
  13. 13.
    Gonzalea, R.C., Woods, R.E.: Digital Image Processing, 3rd edn. Addision-Wesley, London (2003)Google Scholar
  14. 14.
    Anton, Rorres: Elementary Linear Algebra, Application Version, 8th edn. Wiley, Chichester (2002)Google Scholar
  15. 15.
    Birchfield, S.: Elliptical head tracking using intensity gradients and color histogram. In: IEEE Conference on Computer Vision and Pattern Recognition, June 1998, pp. 232–237 (1998)Google Scholar
  16. 16.
    Wang, Y., Yuan, B.: A novel approach for human face detection from color images under complex background. The Journal of the Pattern Recognition Society 34, 1983–1992 (2001)MATHCrossRefMathSciNetGoogle Scholar
  17. 17.
    Lin, H.-C.: Detection of faces with covers in a vision-based security. Master’s thesis, National Chiao-Tung University, Taiwan (June 2003)Google Scholar
  18. 18.
    Lin, H.-S.: Detection of facial occlusions by skin-color based and local-minimum based feature extractor. Master’s thesis, National Central University, Taiwan (June 2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Daw-Tung Lin
    • 1
  • Ming-Ju Liu
    • 2
  1. 1.Department of Computer Science and Information EngineeringNational Taipei UniversitySanshia, Taipei CountyTaiwan
  2. 2.Department of Computer Science and Information EngineeringChun-Hwa UniversityHsinchuTaiwan

Personalised recommendations