Robust Foreground Detection in Videos Using Adaptive Color Histogram Thresholding and Shadow Removal
Fundamental to advance video processing such as object tracking, gait recognition and video indexing is the issue of robust background and foreground segmentation. Several methods have been explored regarding this application, but they are either time or memory consuming or not so efficient in segmentation. This paper proposes an accurate and fast foreground detection technique for object tracking in videos with quasi-stationary backgrounds. The background is modeled using a novel real-time kernel density estimations approach based on online histogram learning. It is noted that shadows are classified as part of foreground pixels if further processing on illumination conditions of the foreground regions is not performed. A developed morphological approach to remove shadows from the segmented foreground image is used. The main contribution of the proposed foreground detection approach is its low memory requirements, low processing time, suitability for parallel processing, and accurate segmentation. The technique has been tested on a variety of both indoor and outdoor sequences for segmentation of foreground and background. The data is structured in such a way that it could be processed using multi-core parallel processing architectures. Tests on dual and quad core processors proved the two and four times speed up factors achieved by distributing the system on parallel hardware architectures. A potential direction for the proposed approach is to investigate its performance on a CUDA enabled Graphic Processing Unit (GPU) as parallel processing capabilities are built into our architecture.
KeywordsGraphic Processing Unit Kernel Density Estimation Foreground Pixel Gait Recognition Foreground Detection
Unable to display preview. Download preview PDF.
- 1.Wren, C., Azarbayejani, A., Darrell, T., Pentland, A.: Pfinder: real-time tracking of the human body. In: Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition. IEEE Computer Society, Los Alamitos (1996)Google Scholar
- 3.Charoenpong, T., Supasuteekul, A., Nuthong, C.: Background and foreground segmentation from sequence images by using mixture of gaussian method and k-means clustering. In: The 8th PSU Engineering Conference, pp. 400–403 (2010)Google Scholar
- 4.Sivabalakrishnan, M., Manjula, D.: Adaptive background subtraction in dynamic environments using fuzzy logic. International Journal on Computer Science and Engineering 2, 270–273 (2010)Google Scholar
- 6.Mittal, A., Paragios, N.: Motion-based background subtraction using adaptive kernel density estimation. In: Computer Vision and Pattern Recognition, pp. 302–309 (2004)Google Scholar
- 7.Miyoshi, M., Tan, J., Ishikawa, S.: Extracting moving objects from a video by sequential background detection employing a local correlation map. In: IEEE International Conference on Systems, Man and Cybernetics, pp. 3365–3369 (2008)Google Scholar
- 8.Hung, M.H., Pan, J.S., Hsieh, C.H.: Speed up temporal median filter for background subtraction. In: 2010 First International Conference on Pervasive Computing Signal Processing and Applications PCSPA, pp. 297–300 (2010)Google Scholar
- 9.Jaikumar, M., Singh, A., Mitra, S.: Background subtraction in videos using bayesian learning with motion information. In: Theoretical Aspects of Computer Software (2008)Google Scholar
- 10.Landabaso, J.L., Pardas, M., Xu, L.Q.: Shadow removal with morphological reconstruction. In: Proceedings of the Jornades de Recerca en Automatica, Visio i Robotica (AVR), Barcelona, Spain (2004)Google Scholar
- 11.Xu, L.Q., Landabaso, J.L., Pardàs, M.: Shadow removal with blob-based morphological reconstruction for error correction. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). IEEE Computer Society, Philadelphia (2005)Google Scholar