Beginning a transition from a local to a more global point of view in model-based vehicle tracking
Abstract
This contribution attempts to move beyond the status where single moving objects in video image sequences are tracked separately in the scene domain, based on individually adapted approaches and parameters. Instead, we investigate which performance can be achieved by a combination of approaches based on edge element orientation and on optical flow, applied to a variety of image sequences and vehicles. Five different image sequences of traffic scenes recorded under different conditions have been evaluated. Quantitative statements are provided about the success rates of the approach after evaluating over 5.500 full video-frames, i. e. more than 3 1/2 minutes of real-world video, using one single approach and a single parameter set. Remaining tracking failures are analyzed and classified.
Keywords
Optical Flow Edge Element Object Candidate Optical Flow Field Traffic SceneReferences
- 1.H. Buxton, S. Gong: Visual Surveillance in a Dynamic and Uncertain World. Artificial Intelligence 78 (1995) 431–459.CrossRefGoogle Scholar
- 2.C. Cédras, M. Shah: Motion-Based Recognition: A Survey. Image and Vision Computing 13:2 (1995) 129–155.CrossRefGoogle Scholar
- 3.S. Dance, T. Caelli, Z.-Q. Liu: A Concurrent, Hierarchical Approach to Symbolic Scene Interpretation. Pattern Recognition 29:11 (1996) 1891–1903.CrossRefGoogle Scholar
- 4.W.F. Gardner, D.T. Lawton: Interactive Model-Based Vehicle Tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence 18:11 (1996) 1115–1121.CrossRefGoogle Scholar
- 5.A. Gelb: Applied Optimal Estimation. The MIT Press, Cambridge / MA, 1974.Google Scholar
- 6.S. Gil, R. Milanese, and T. Pun: Combining Multiple Motion Estimates for Vehicle Tracking. Proc. Fourth European Conference on Computer Vision 1996 (ECCV '96), 15–18 April 1996, Cambridge / UK; B. Buxton and R. Cipolla (Eds.), Lecture Notes in Computer Science 1065 (Vol. II), Springer-Verlag, Berlin, Heidelberg 1996, pp. 307–320.Google Scholar
- 7.S. Gil, R. Milanese, and T. Pun: Comparing Features for Target Tracking in Traffic Scenes. Pattern Recognition 29 (1996) 1285–1296.CrossRefGoogle Scholar
- 8.M. Haag, Th. Frank, H. Kollnig, H.-H. Nagel: Influence of an Explicitly Modelled 3D Scene on the Tracking of Partially Occluded Vehicles. Computer Vision and Image Understanding 65:2 (1997) 206–225.CrossRefGoogle Scholar
- 9.F. Heimes, H.-H. Nagel, Th. Frank: Model-Based Tracking of Complex Innercity Road Intersections. Mathematical and Computer Modelling, 1998, in press.Google Scholar
- 10.R. Howarth, H. Buxton: Visual Surveillance Monitoring and Watching. Proc. Fourth European Conference on Computer Vision 1996 (ECCV '96), 15–18 April 1996, Cambridge / UK; B. Buxton and R. Cipolla (Eds.), Lecture Notes in Computer Science 1065 (Vol. II), Springer-Verlag, Berlin, Heidelberg 1996, pp. 321–334.Google Scholar
- 11.H. Kollnig, H.-H. Nagel: Matching Objects to Segments from an Optical Flow Field. Proc. Fourth European Conference on Computer Vision 1996 (ECCV '96), 15–18 April 1996, Cambridge / UK; B. Buxton and R. Cipolla (Eds.), Lecture Notes in Computer Science 1065 (Vol. II), Springer-Verlag, Berlin, Heidelberg 1996, pp. 388–399.Google Scholar
- 12.H. Kollnig, H.-H. Nagel: 3D Pose Estimation by Directly Matching Polyhedral Models to Gray Value Gradients. International Journal of Computer Vision 23:3 (1997) 283–302.CrossRefGoogle Scholar
- 13.S.J. Maybank, A.D. Worrall, G.D. Sullivan: A Filter for Visual Tracking Based on a Stochastic Model for Driver Behaviour. Proc. Fourth European Conference on Computer Vision 1996 (ECCV '96), 15–18 April 1996, Cambridge / UK; B. Buxton and R. Cipolla (Eds.), Lecture Notes in Computer Science 1065 (Vol. II), Springer-Verlag, Berlin, Heidelberg 1996, pp. 540–549.Google Scholar
- 14.S.J. Maybank, A.D. Worrall, G.D. Sullivan: Filter for Car Tracking Based on Acceleration and Steering Angle. Proc. of the 7th British Machine Vision Conference (BMVC '96), 9–12 September 1996, Edinburgh, England, R. B. Fisher and E. Trucco (Eds.), Vol. 2, ISBN 0 9521898 5 2, 1996, pp. 615–624.Google Scholar
- 15.H.-H. Nagel, M. Haag: Bias-Corrected Optical Flow Estimation for Road Vehicle Tracking. International Conference on Computer Vision (ICCV '98), 4–7 January 1998, Bombay/India, Narosa Publishing House New Delhi a. o. 1998, pp. 1006–1011.Google Scholar
- 16.M.K. Teal, T.J. Ellis: Spatial-Temporal Reasoning Based on Object Motion. Proc. of the 7th British Machine Vision Conference (BMVC '96), 9–12 September 1996, Edinburgh, England, R. B. Fisher and E. Trucco (Eds.), Vol. 2, ISBN 0 9521898 5 2, 1996, pp. 465–474.Google Scholar
- 17.M. Tonko, K. Schäfer, F. Heimes, H.-H. Nagel: Towards Visually Servoed Manipulation of Car Engine Parts. Proc. IEEE International Conference on Robotics and Automation, Albuquerque/NM, 20–25 April 1997, R. W. Harrigan (Ed.), IEEE Computer Society Press, Los Alamitos/CA, 1997, pp. 3166–3171.Google Scholar