Abstract
This paper aims to address two of the key research issues in computer vision — the detection and tracking of multiple objects in the cluttered dynamic scene — that underpin the intelligence aspects of advanced visual surveillance systems aiming at automated visual events detection and behaviour analysis. We discuss two major contributions in resolving these problems within a systematic framework. Firstly, for accurate object detection, an efficient and effective scheme is proposed to remove cast shadows/highlights with error corrections based on a conditional morphological reconstruction. Secondly, for effective tracking, a temporal-template-based tracking scheme is introduced, using multiple descriptive cues (velocity, shape, colour, etc) of the 2-D object appearance together with their respective variances over time. A scaled Euclidean distance is used as the matching metric, and the template is updated using Kalman filters when a matching is found or by linear mean prediction in the case of occlusion. Extensive experiments are carried out on video sequences from various real-world scenarios. The results show very promising tracking performance.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Lipton A J, Heartwell C H, Haering N Madden D: 'Automated video protection, monitoring and detection of critical infrastructure', IEEE Aerospace and Electronic Systems Magazine, 18, No 5 (May 2003).
Perrott A J, Lindsay A T and Parkes A P: 'Realtime multimedia tagging and content-based retrieval for CCTV surveillance system', Proc of SPIE: Internet Multimedia Management Systems III, Boston (2002).
Georis B, Maziere M, Bremond F Thonnat M: 'A video interpretation platform applied to bank agency monitoring', Proc of IEE IDSS'04, pp 46-50, London (February 2004).
Haritaoglu I Flickner M: 'Detection and tracking of shopping groups in stores', Proc of IEEE CVPR'2001, Kauai, Hawaii, USA (December 2001).
Senior A: 'Tracking people with probabilistic appearance models', Proc 3rd IEEE Intl Workshop on Performance Evaluation of Tracking and Surveillance (PETS'2002), pp 48-55, Copenhagen, Denmark (June 2002).
Cucchiara R, Grana C, Prati A, Tardini G Vezzani R: 'Using computer vision techniques for dangerous situation detection in domotics applications', Proc of IEE IDSS'04, pp 1-5, London (February 2004).
Haritaoglu I, Harwood D Davis L: 'W4: real time surveillance of people and their activities', IEEE Trans. on Pattern Analysis and Machine Intelligence, 22, No 8 (August 2000).
Javed O Shah M: 'Tracking and object classification for automated surveillance', Proc of ECCV'2002, Copenhagen, Denmark, pp 343-357 (May-June 2002).
Zhou Q Aggarwal J K: 'Tracking and classifying moving objects from video', Proc of 2nd IEEE Intl Workshop on Performance Evaluation of Tracking and Surveillance (PETS'2001), Kauai, Hawaii, USA (December 2001).
Li L Leung M K H: 'Integrating intensity and texture differences for robust change detection', IEEE Trans on Image Processing, 11, No 2, pp 105-112 (2002).
Javed O, Shafique K Shah M: 'A hierarchical approach to robust background subtraction using color and gradient information', Proc of IEEE Workshop on Motion and Video Computing, Orlando, USA (December 2002).
Jabri S, Duric Z, Wechsler H Rosenfeld A: 'Detection and location of people in video images using adaptive fusion of color and edge information', Proc of ICPR'2000, Barcelona, Spain (September 2000).
McKenna S J, Jabri S, Duric Z, Rosenfeld A Wechsler H: 'Tracking groups of people', Computer Vision and Image Understanding, 80, pp 42-56 (2000).
Stauffer C Grimson W E L: 'Learning patterns of activity using real-time tracking', IEEE Trans on Pattern Analysis and Machine Intelligence, 22, No 8 (August 2000).
Lee D S, Hull J J and Erol B: 'A Bayesian framework for Gaussian mixture background modelling', Proc of IEEE ICIP'2003, Barcelona, Spain (September 2003).
Elgamal A, Duraiswami R, Harwood D Davis L: 'Background and foreground modelling using nonparametric kernel density estimation for visual surveillance', Proc of the IEEE, 90, No 7 (July 2002).
Gao X, Boult T E, Coetzee F Ramesh V: 'Error analysis of background adaptation', Proc of IEEE CVPR'2000, South Carolina, USA, pp 503-510 (June 2000).
Toyama K, Krumm J, Brumitt B Meyers B: 'Wallflower: principles and practice of background maintenance', Proc of IEEE ICCV'99, pp 255-261, Kerkyra, Greece (September 1999).
Cucchiara R, Grana C, Piccardi M Prati A: 'Detecting moving objects, ghosts and shadows in video streams', IEEE Trans on Pattern Analysis and Machine Intelligence, 25, No 10, pp 1337-42 (2003).
Horprasert T, Harwood D Davis L: 'A statistical approach for real-time robust background subtraction and shadow detection', Proc of ICCV'99 FRAME-RATE Workshop (1999).
Bevilacqua A: 'Effective shadow detection in traffic monitoring applications', Proc of WSCG'2003, Plzen-Bory, Czech Republic (February 2003).
Stauffer C: 'Estimating tracking sources and sinks', Proc of 2nd IEEE Workshop on Event Mining (in conjunction with CVPR'2003), 4, Madison, Wisconsin (June 2003).
Xu M Ellis T J: 'Partial observation vs. blind tracking through occlusion', in Proc of BMVC'2002, Cardiff, pp 777-786 (September 2002).
Fitzgibbon A W and Fisher R B: 'A buyer's guide to conic fitting', Proc of 5th British Machine Vision Conference, Birmingham, pp 513-522 (1995).
Balcells Capellades M, Doermann D, DeMenthon D Chellappa R: 'An appearance based approach for human and object tracking', Proc of IEEE ICIP'2003, Barcelona, Spain (September 2003).
Author information
Authors and Affiliations
About this article
Cite this article
Xu, LQ., Landabaso, J.L. & Lei, B. Segmentation and Tracking of Multiple Moving Objects for Intelligent Video Analysis. BT Technology Journal 22, 140–150 (2004). https://doi.org/10.1023/B:BTTJ.0000047128.53316.f2
Issue Date:
DOI: https://doi.org/10.1023/B:BTTJ.0000047128.53316.f2